-- Logs begin at Mon 2022-07-18 09:42:36 UTC, end at Mon 2022-07-18 10:59:05 UTC. -- Jul 18 10:21:39.896239 dv-cinder-837546-3-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 18 10:21:39.903723 dv-cinder-837546-3-smb devstack@keystone.service[80377]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 18 10:21:39.907391 dv-cinder-837546-3-smb devstack@keystone.service[80377]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 18 10:21:39 2022] *** Jul 18 10:21:39.907391 dv-cinder-837546-3-smb devstack@keystone.service[80377]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 18 10:21:39.907391 dv-cinder-837546-3-smb devstack@keystone.service[80377]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 18 10:21:39.907391 dv-cinder-837546-3-smb devstack@keystone.service[80377]: nodename: dv-cinder-837546-3-smb Jul 18 10:21:39.907391 dv-cinder-837546-3-smb devstack@keystone.service[80377]: machine: x86_64 Jul 18 10:21:39.907391 dv-cinder-837546-3-smb devstack@keystone.service[80377]: clock source: unix Jul 18 10:21:39.907391 dv-cinder-837546-3-smb devstack@keystone.service[80377]: pcre jit disabled Jul 18 10:21:39.907391 dv-cinder-837546-3-smb devstack@keystone.service[80377]: detected number of CPU cores: 4 Jul 18 10:21:39.907391 dv-cinder-837546-3-smb devstack@keystone.service[80377]: current working directory: / Jul 18 10:21:39.907391 dv-cinder-837546-3-smb devstack@keystone.service[80377]: detected binary path: /usr/bin/uwsgi-core Jul 18 10:21:39.907391 dv-cinder-837546-3-smb devstack@keystone.service[80377]: your processes number limit is 47680 Jul 18 10:21:39.907391 dv-cinder-837546-3-smb devstack@keystone.service[80377]: your memory page size is 4096 bytes Jul 18 10:21:39.907391 dv-cinder-837546-3-smb devstack@keystone.service[80377]: detected max file descriptor number: 2048 Jul 18 10:21:39.907391 dv-cinder-837546-3-smb devstack@keystone.service[80377]: lock engine: pthread robust mutexes Jul 18 10:21:39.907391 dv-cinder-837546-3-smb devstack@keystone.service[80377]: thunder lock: enabled Jul 18 10:21:39.907391 dv-cinder-837546-3-smb devstack@keystone.service[80377]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 18 10:21:39.907391 dv-cinder-837546-3-smb devstack@keystone.service[80377]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 18 10:21:39.947539 dv-cinder-837546-3-smb devstack@keystone.service[80377]: Python main interpreter initialized at 0x55b4c88299c0 Jul 18 10:21:39.947539 dv-cinder-837546-3-smb devstack@keystone.service[80377]: python threads support enabled Jul 18 10:21:39.947539 dv-cinder-837546-3-smb devstack@keystone.service[80377]: your server socket listen backlog is limited to 100 connections Jul 18 10:21:39.947539 dv-cinder-837546-3-smb devstack@keystone.service[80377]: your mercy for graceful operations on workers is 90 seconds Jul 18 10:21:39.950556 dv-cinder-837546-3-smb devstack@keystone.service[80377]: mapped 403077 bytes (393 KB) for 2 cores Jul 18 10:21:39.950556 dv-cinder-837546-3-smb devstack@keystone.service[80377]: *** Operational MODE: preforking *** Jul 18 10:21:39.950556 dv-cinder-837546-3-smb devstack@keystone.service[80377]: *** uWSGI is running in multiple interpreter mode *** Jul 18 10:21:39.950556 dv-cinder-837546-3-smb devstack@keystone.service[80377]: spawned uWSGI master process (pid: 80377) Jul 18 10:21:39.950556 dv-cinder-837546-3-smb devstack@keystone.service[80377]: spawned uWSGI worker 1 (pid: 80392, cores: 1) Jul 18 10:21:39.950556 dv-cinder-837546-3-smb devstack@keystone.service[80377]: spawned uWSGI worker 2 (pid: 80393, cores: 1) Jul 18 10:21:39.950556 dv-cinder-837546-3-smb devstack@keystone.service[80377]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 18 10:21:39.948461 dv-cinder-837546-3-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 18 10:21:45.478314 dv-cinder-837546-3-smb devstack@keystone.service[80393]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 10:21:45.478314 dv-cinder-837546-3-smb devstack@keystone.service[80393]: from cryptography.utils import int_from_bytes Jul 18 10:21:45.479064 dv-cinder-837546-3-smb devstack@keystone.service[80393]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 10:21:45.479064 dv-cinder-837546-3-smb devstack@keystone.service[80393]: from cryptography.utils import int_from_bytes Jul 18 10:21:45.483580 dv-cinder-837546-3-smb devstack@keystone.service[80392]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 10:21:45.483580 dv-cinder-837546-3-smb devstack@keystone.service[80392]: from cryptography.utils import int_from_bytes Jul 18 10:21:45.484038 dv-cinder-837546-3-smb devstack@keystone.service[80392]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 10:21:45.484038 dv-cinder-837546-3-smb devstack@keystone.service[80392]: from cryptography.utils import int_from_bytes Jul 18 10:21:45.528713 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 10:21:45.528915 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 10:21:45.529105 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] command line args: [] {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 10:21:45.529373 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 10:21:45.529548 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ================================================================================ {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 10:21:45.529797 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] admin_token = **** {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.530039 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] config_dir = [] {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.530223 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.530402 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] config_source = [] {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.530579 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] debug = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.530773 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.531138 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.531313 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.531561 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.531644 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 10:21:45.531771 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 10:21:45.531858 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.531972 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] command line args: [] {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 10:21:45.532057 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] list_limit = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.532186 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] log_config_append = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.532301 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 10:21:45.532399 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.532501 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] ================================================================================ {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 10:21:45.532608 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] log_dir = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.532702 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] admin_token = **** {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.532796 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] log_file = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.532896 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] config_dir = [] {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.533011 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.533135 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.533262 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.533344 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] config_source = [] {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.533465 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.533547 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] debug = True {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.533625 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.533730 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.533811 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.533888 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.534009 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.534091 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.534214 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.534296 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.534396 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.534474 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.534632 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.534756 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] list_limit = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.534843 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] log_config_append = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.534914 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.535028 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.535107 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.535237 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] log_dir = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.535464 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.535992 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] log_file = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.535992 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.536195 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.536195 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.536387 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.536473 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.536552 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.536552 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.536712 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.536831 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.39/identity {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.536914 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.537056 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] publish_errors = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.537155 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.537232 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.537355 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.537446 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.537519 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.537641 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.537762 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.537839 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.537994 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.538135 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.538212 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] standard_threads = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.538287 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.538439 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.538516 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.538676 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.538762 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.538833 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.538999 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.539098 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] use_journal = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.539179 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] use_json = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.539324 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] use_stderr = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.539497 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.39/identity {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.539576 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] use_syslog = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.539682 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] publish_errors = False {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.539760 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.539915 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.539994 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.540148 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.540225 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.540328 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.540407 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.540581 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.540659 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.540819 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.540902 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.541132 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] standard_threads = False {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.541213 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.541283 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.541352 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.541530 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.541616 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.541695 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.541796 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.541874 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] use_journal = False {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.542032 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] use_json = False {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.542109 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.542207 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] use_stderr = False {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.542295 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.542368 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] use_syslog = False {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.542490 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.542602 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:21:45.542734 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.542857 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.542968 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.543095 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.543211 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.543356 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.543455 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.543595 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.543682 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.543844 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.543921 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.544083 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.544173 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.544331 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.544419 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.544569 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.544647 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.544817 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.544902 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.545082 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.545177 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.545333 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.545411 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.545568 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.545647 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.545799 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.545878 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.546030 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.546107 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.546259 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.546343 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.546486 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.546561 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.546721 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.546799 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.546964 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.547047 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.547190 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.547269 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.547416 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.547493 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.547658 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.547735 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.547900 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.547979 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.548134 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.548212 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.548386 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.548464 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.548615 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.548694 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.548847 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.548924 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.549097 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.549176 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.549327 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.549413 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.549554 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.549638 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.549779 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.549857 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.550006 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.550085 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.550237 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.550321 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.550482 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.550570 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.550712 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.550803 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.551058 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.551524 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.551630 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.551727 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.551839 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.551939 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.552056 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.552139 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.552217 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.552335 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.552426 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.552500 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.552586 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.552660 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.552776 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.552851 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.552966 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.553078 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.553187 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.553268 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.553422 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.553501 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.553651 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.553742 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.553896 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.554018 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.554128 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.554214 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.554363 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.554457 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.554594 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.554672 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.554830 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.554913 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.555072 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.555158 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.555303 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.555381 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.555544 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.555630 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.555784 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.555872 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.556022 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.556101 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.556262 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.556341 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.556501 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.556589 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.556732 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.556816 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.556983 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.557127 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.557246 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.557337 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.557485 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.557562 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.557718 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.557806 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.557982 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.558136 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.558217 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.558289 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.558441 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.558519 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.558680 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.558765 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.558917 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.559017 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.559185 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.559263 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.559423 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.559517 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.559672 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.559758 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.559915 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.560021 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.560151 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.560268 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.560387 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.560520 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.560627 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.560779 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.560859 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.561031 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.561140 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.561309 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.561387 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.561555 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.561634 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.561804 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.561890 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.562042 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.562127 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.562277 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.562473 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.562557 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.562728 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.562807 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.562985 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.563062 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.563226 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.563304 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.563467 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.563546 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.563706 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.563790 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.563947 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.564026 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.564184 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.564304 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.564421 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.564615 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.564696 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.564877 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.564962 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.565130 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.565212 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.565366 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.565445 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] auth.external = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.565604 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.565694 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.565837 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.566021 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.566106 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.566286 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.566365 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.567361 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.567460 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] auth.password = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.567542 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.567621 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] auth.token = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.567694 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.567764 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.567867 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.568006 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.568096 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.568314 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] auth.external = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.568393 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.568607 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.568687 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.568921 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.569013 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.569194 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.569274 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.569427 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.569506 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] auth.password = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.569665 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] credential.caching = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.569757 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] auth.token = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.569913 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.569999 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.570162 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.570287 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.570411 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.570551 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.570653 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.570847 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.570925 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.571114 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.571192 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.571376 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.571457 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.571629 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.571717 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.571865 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.572007 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] credential.caching = True {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.572101 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.572225 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.572380 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.572540 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.572618 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.572806 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.572894 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.573121 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.573205 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.573378 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.573458 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.573611 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] federation.caching = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.573767 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.573845 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.573940 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.574076 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.574258 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.574345 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.574526 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.574606 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.574770 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.574849 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.575002 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.575115 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.575252 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.575442 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.575521 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.575709 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.575789 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.575944 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.576024 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.576190 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.576269 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.576422 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] identity.caching = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.576501 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] federation.caching = True {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.576658 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.576739 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.576901 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.576987 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.577154 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.577249 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.577387 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.577468 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.577631 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.577716 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.577860 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.577939 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.578094 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.578175 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.578338 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.578416 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.578585 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.578662 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.578815 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.578896 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.579043 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.579124 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.579269 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.579351 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] identity.caching = True {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.579498 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.579579 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.579740 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.579819 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.579981 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.580060 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.580220 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.580302 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.580459 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.580538 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.580688 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.580766 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.580928 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.581009 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.581207 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.581288 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.581437 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.581516 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.581673 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.581758 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.581903 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.581982 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.582758 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.582901 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.583195 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.583324 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.583437 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.583549 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.583684 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.583804 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.583920 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.584001 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.584156 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.584242 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.584413 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.584501 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.584650 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.584731 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.584896 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.584976 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.585171 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.585264 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.585407 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.585486 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.585647 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.585726 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.585876 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.585964 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.586116 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.586196 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.586353 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.586433 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.586592 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.586679 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.586829 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.586909 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.587064 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.587143 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.587311 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.587397 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.587559 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.587638 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.587791 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.587871 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.588020 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.588108 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.588266 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.588346 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.588503 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.588582 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.588737 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.588824 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.588976 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.589124 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.589237 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.589317 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.589469 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.user = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.589561 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.589709 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.589788 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.589950 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.590029 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.590182 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.590269 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.590429 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.590508 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.590659 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.590736 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.590892 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.590979 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.591123 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.591201 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.591351 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.591429 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.591583 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.591672 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.591814 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.591894 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.592048 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.592126 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.592275 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.592362 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] ldap.user = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.592514 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.592593 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.592755 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.592834 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.592997 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.593105 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.593269 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.593349 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.593510 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.593588 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.593738 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.593826 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.593976 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.594054 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.594207 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.594285 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.594443 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.594530 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.594673 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.594752 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.594905 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.594984 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.595135 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.595221 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.595379 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.595457 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.595614 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.595692 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.595864 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.595955 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.596088 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.596166 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.596328 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.596407 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.596559 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.596647 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.596789 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.596869 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.597023 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.597119 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.597283 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.597442 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.597525 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.597598 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.597862 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.598342 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.598342 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.598492 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.598492 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] resource.caching = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.598624 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.598624 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.598750 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.598750 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.598886 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.598986 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.599066 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.599229 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.599308 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.599469 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.599551 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.599698 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.599784 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.599941 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.600020 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.600170 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.600256 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.600407 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.600486 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.600637 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] role.caching = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.600716 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.600872 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.600952 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] role.driver = sql {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.601121 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.601205 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] resource.caching = True {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.601374 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.601454 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.601622 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.601704 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.601858 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.601936 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.602101 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.602180 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.602345 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.602427 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.602579 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.602657 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.602820 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.602898 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.603054 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.603135 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.603285 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.603363 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.603517 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] role.caching = True {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.603595 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.603760 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.603847 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] role.driver = sql {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.603990 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.604068 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.604240 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.604320 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.604490 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.604630 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.604738 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.604863 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.604985 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.605142 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.605259 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.605391 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.605506 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.605635 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.605752 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.605879 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.605998 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.606110 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.606232 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.606360 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.606481 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.606607 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.606728 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.606841 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.606976 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.607056 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.607223 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.607310 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.607500 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.607616 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.607747 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.607854 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.607998 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.608106 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.608241 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.608357 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.608474 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.608606 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.608705 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.608856 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.608941 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.609119 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.609204 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] token.caching = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.609377 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.609458 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.609626 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.609707 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.609858 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.609937 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.610089 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.610167 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.610321 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.610403 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.610553 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.610633 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.610790 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.610869 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.611028 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.611115 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.611269 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.611349 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.611501 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.611580 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.611734 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.611813 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.611962 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.612040 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.612195 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] token.caching = True {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.612272 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.612433 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.612520 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.612654 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.612732 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.612892 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.612971 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.613180 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.613278 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.613589 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.614029 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] database.connection = **** {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.614029 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.614189 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.614264 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.614343 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.614417 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.614489 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.614559 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.614630 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.614700 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.614835 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.614918 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.615078 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.615159 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.615314 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.615394 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.615563 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.615645 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.615806 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.615885 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.616035 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.616113 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.616264 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.616345 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.616508 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.616588 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.616742 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.616823 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] database.connection = **** {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.616985 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.617206 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.617294 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.617369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.617461 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.617530 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.617693 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.617773 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.617853 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 10:21:45.617981 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.618484 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.618722 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.618960 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.619205 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.619439 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.619684 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.619921 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.620168 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.620404 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.620648 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.620877 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.621141 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.621379 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:21:45.621549 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80392) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 10:21:45.649585 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:21:45.649811 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:21:45.650037 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:21:45.651880 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80392) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:21:45.652114 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80392) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:21:45.652340 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80392) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:21:45.658248 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:21:45.660728 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80392) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:21:45.686265 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:21:45.686491 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:21:45.687204 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80392) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:21:45.687440 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80392) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:21:45.830679 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:21:45.831374 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80392) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:21:45.880670 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:21:45.880893 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:21:45.881859 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80392) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:21:45.882101 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80392) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:21:45.945287 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:21:45.945459 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80392) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:21:45.945548 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:21:45.945694 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80392) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:21:45.945796 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:21:45.945921 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80392) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:21:45.946003 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:21:45.946133 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:21:45.946213 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80392) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:21:45.946345 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:21:45.946428 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80392) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:21:45.946555 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80392) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:21:45.970939 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:21:45.971060 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80392) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:21:45.971175 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:21:45.971274 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80392) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:21:45.971402 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:21:45.971483 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80392) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:21:45.971622 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:21:45.971702 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80392) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:21:45.971835 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:21:45.971918 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80392) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:21:45.972044 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:21:45.972125 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80392) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:21:45.972255 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:21:45.972344 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80392) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:21:45.983413 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80392) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:21:45.983653 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:21:45.996905 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80392) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:21:45.997161 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80392) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:21:45.997262 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:21:45.997394 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80392) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:21:45.997478 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:21:45.997620 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80392) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:21:45.997701 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:21:45.997834 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:21:45.997923 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80392) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:21:45.998046 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80392) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:21:45.998126 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:21:45.998250 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:21:45.998329 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80392) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:21:45.998458 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 10:21:46.016137 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.016349 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 18 10:21:46.016457 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.016688 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.016769 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 18 10:21:46.016888 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 18 10:21:46.017018 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.017179 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.017260 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 18 10:21:46.017437 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.017595 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.017695 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.017775 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.017950 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.018028 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.018209 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.029197 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.029435 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.029517 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.029708 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.029789 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.029973 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.030055 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.030250 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.038227 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80392) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:21:46.038635 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80393) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:21:46.041544 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80392) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:21:46.041828 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.041908 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80393) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:21:46.042109 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.042190 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.042441 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.042534 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.042772 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.042853 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.043032 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.043112 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.043300 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.043382 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.043570 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.043651 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.043836 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.043923 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.044101 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.044182 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.044363 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.044441 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.044622 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.071985 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.072210 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.073621 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80392) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:21:46.073843 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80393) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:21:46.073925 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.074116 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.079154 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80392) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:21:46.079362 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80393) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:21:46.079443 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.079635 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.079727 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.079908 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.087135 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80392) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:21:46.087312 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80393) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:21:46.087400 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.087596 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.091982 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80392) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:21:46.092197 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80393) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:21:46.092292 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.092482 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.092574 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.092758 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.092851 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.093031 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.093146 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.093320 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.093425 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.093587 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.093677 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.093850 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.093939 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.094109 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.112730 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.112897 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.113009 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.113204 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.118454 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80392) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:21:46.118807 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80393) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:21:46.122261 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.122506 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.122589 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.122795 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.127568 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80392) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:21:46.127768 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80393) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:21:46.131794 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80392) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:21:46.132621 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80393) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:21:46.135577 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.135878 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.136162 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.136383 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.136465 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.136674 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.136766 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.136953 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.137065 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.137257 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.137545 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.137831 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.155943 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80392) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:21:46.156316 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.156588 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.156800 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80393) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:21:46.156883 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.157206 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.157475 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.157744 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.164968 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.165831 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.166695 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.166970 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.167535 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.167806 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.170045 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80392) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:21:46.170324 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.170607 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.170842 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80393) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:21:46.170924 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.171136 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.171218 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.171420 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.171695 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.171980 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.185298 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80392) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:21:46.185576 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.185855 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.185936 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80393) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:21:46.186134 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.186230 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.186413 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.186495 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.186704 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.186785 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.186977 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.187059 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.187261 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.187529 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.206903 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80392) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:21:46.207491 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80393) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:21:46.210228 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80392) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:21:46.210759 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80393) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:21:46.213577 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.214063 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.215181 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.215656 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.216827 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80392) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:21:46.217127 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.217320 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80393) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:21:46.217460 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.217598 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.217873 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.225415 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.225829 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.227020 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80392) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:21:46.227427 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80393) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:21:46.230486 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.230682 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.230765 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.230974 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.231069 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.231253 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.231336 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.231527 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.241235 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80392) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:21:46.241502 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80393) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:21:46.241586 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.241784 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.241866 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.242063 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.249897 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80392) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:21:46.250101 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80393) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 10:21:46.250186 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.250375 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.250464 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.250650 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.250739 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.250920 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.251001 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.251184 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.251266 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.251461 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.251543 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.251731 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.251811 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.251992 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.252072 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.252253 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.252335 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.252526 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.252682 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.252794 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.252959 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.253058 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.253241 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.253322 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80392) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.253499 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.253765 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 10:21:46.291703 dv-cinder-837546-3-smb devstack@keystone.service[80392]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55b4c88299c0 pid: 80392 (default app) Jul 18 10:21:46.292417 dv-cinder-837546-3-smb devstack@keystone.service[80393]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55b4c88299c0 pid: 80393 (default app) Jul 18 10:21:46.295062 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae2253-a3ed-4110-bd11-34c1c7af403e None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:46.295357 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae2253-a3ed-4110-bd11-34c1c7af403e None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:46.295633 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae2253-a3ed-4110-bd11-34c1c7af403e None None] PATH_INFO: `/v3` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:46.299866 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1/1] 10.222.0.39 () {50 vars in 791 bytes} [Mon Jul 18 10:21:46 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:21:54.704782 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05002149-8e99-4e47-873c-0cf95fad2442 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:54.705440 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05002149-8e99-4e47-873c-0cf95fad2442 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:54.705440 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05002149-8e99-4e47-873c-0cf95fad2442 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:54.710387 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1/2] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:21:54 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:21:54.715926 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08366b40-c9fd-4ff6-a35e-2e0436c12421 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:54.716348 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08366b40-c9fd-4ff6-a35e-2e0436c12421 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:54.716482 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08366b40-c9fd-4ff6-a35e-2e0436c12421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:54.787457 dv-cinder-837546-3-smb devstack@keystone.service[80392]: INFO dbcounter [None req-08366b40-c9fd-4ff6-a35e-2e0436c12421 None None] Registered counter for database keystone Jul 18 10:21:54.808721 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG oslo_db.sqlalchemy.engines [None req-08366b40-c9fd-4ff6-a35e-2e0436c12421 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80392) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 10:21:54.814829 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writer thread running {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 10:21:54.995371 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG passlib.handlers.bcrypt [None req-08366b40-c9fd-4ff6-a35e-2e0436c12421 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80392) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 18 10:21:54.995785 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG passlib.handlers.bcrypt [None req-08366b40-c9fd-4ff6-a35e-2e0436c12421 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80392) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 18 10:21:55.051813 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-08366b40-c9fd-4ff6-a35e-2e0436c12421 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:21:55.053433 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-08366b40-c9fd-4ff6-a35e-2e0436c12421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:21:55.176560 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 2/3] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:21:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 18 10:21:55.323059 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05002149-8e99-4e47-873c-0cf95fad2442 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:55.394005 dv-cinder-837546-3-smb devstack@keystone.service[80393]: INFO dbcounter [None req-05002149-8e99-4e47-873c-0cf95fad2442 None None] Registered counter for database keystone Jul 18 10:21:55.413869 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG oslo_db.sqlalchemy.engines [None req-05002149-8e99-4e47-873c-0cf95fad2442 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80393) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 10:21:55.420085 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writer thread running {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 10:21:55.540501 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05002149-8e99-4e47-873c-0cf95fad2442 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:55.544719 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d03d032-a8e4-415f-9a5d-e1e48a1e31cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:55.545403 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03d032-a8e4-415f-9a5d-e1e48a1e31cf admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:55.545686 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03d032-a8e4-415f-9a5d-e1e48a1e31cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:55.545960 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d03d032-a8e4-415f-9a5d-e1e48a1e31cf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:55.553978 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d03d032-a8e4-415f-9a5d-e1e48a1e31cf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:55.606605 dv-cinder-837546-3-smb devstack@keystone.service[80393]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2d03d032-a8e4-415f-9a5d-e1e48a1e31cf admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 18 10:21:55.606891 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d03d032-a8e4-415f-9a5d-e1e48a1e31cf admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:55.616362 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 2/4] 10.222.0.39 () {58 vars in 1324 bytes} [Mon Jul 18 10:21:55 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 10:21:55.622573 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08366b40-c9fd-4ff6-a35e-2e0436c12421 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:55.637612 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08366b40-c9fd-4ff6-a35e-2e0436c12421 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:55.642070 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ad381-160b-45cb-9d4c-e691fef59ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:55.643195 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ad381-160b-45cb-9d4c-e691fef59ba7 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:55.643487 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ad381-160b-45cb-9d4c-e691fef59ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:55.643766 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ad381-160b-45cb-9d4c-e691fef59ba7 admin admin] PATH_INFO: `/v3/projects/ec4a529f46e64ec0b911c3fbc2a942cb` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:55.648660 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9ad381-160b-45cb-9d4c-e691fef59ba7 admin admin] RBAC: Authorizing `identity:get_project(project_id=ec4a529f46e64ec0b911c3fbc2a942cb)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:55.699831 dv-cinder-837546-3-smb devstack@keystone.service[80392]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5f9ad381-160b-45cb-9d4c-e691fef59ba7 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 18 10:21:55.700179 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9ad381-160b-45cb-9d4c-e691fef59ba7 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:55.704818 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 3/5] 10.222.0.39 () {56 vars in 1207 bytes} [Mon Jul 18 10:21:55 2022] GET /identity/v3/projects/ec4a529f46e64ec0b911c3fbc2a942cb => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:21:57.665298 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14dae32-6f2e-48f2-98d5-6594c2ca10ae None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:57.665829 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14dae32-6f2e-48f2-98d5-6594c2ca10ae None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:57.665829 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14dae32-6f2e-48f2-98d5-6594c2ca10ae None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:57.669941 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 3/6] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:21:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:21:57.675227 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f16cf-a3e8-489f-a4e6-18e0f93b11e0 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:57.675858 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f16cf-a3e8-489f-a4e6-18e0f93b11e0 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:57.676150 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f16cf-a3e8-489f-a4e6-18e0f93b11e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:57.694691 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-de6f16cf-a3e8-489f-a4e6-18e0f93b11e0 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:21:57.696207 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-de6f16cf-a3e8-489f-a4e6-18e0f93b11e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:21:57.703966 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 4/7] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:21:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 18 10:21:57.727105 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14dae32-6f2e-48f2-98d5-6594c2ca10ae None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:57.739158 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14dae32-6f2e-48f2-98d5-6594c2ca10ae None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:57.743705 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d8f49a-7391-46b3-9bd0-2420509ccd32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:57.744342 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8f49a-7391-46b3-9bd0-2420509ccd32 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:57.744629 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8f49a-7391-46b3-9bd0-2420509ccd32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:57.744909 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8f49a-7391-46b3-9bd0-2420509ccd32 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:57.752610 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d8f49a-7391-46b3-9bd0-2420509ccd32 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:57.754754 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d8f49a-7391-46b3-9bd0-2420509ccd32 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:57.763423 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 4/8] 10.222.0.39 () {58 vars in 1324 bytes} [Mon Jul 18 10:21:57 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 10:21:57.768620 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6f16cf-a3e8-489f-a4e6-18e0f93b11e0 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:21:57.778223 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6f16cf-a3e8-489f-a4e6-18e0f93b11e0 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:21:57.782548 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109e34a4-4b15-4c70-94df-87ba24b43ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:21:57.783410 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e34a4-4b15-4c70-94df-87ba24b43ec2 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:57.783693 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e34a4-4b15-4c70-94df-87ba24b43ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:57.783974 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e34a4-4b15-4c70-94df-87ba24b43ec2 admin admin] PATH_INFO: `/v3/users/0a2289135265475ab7faec00c36046b3` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:57.786010 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109e34a4-4b15-4c70-94df-87ba24b43ec2 admin admin] RBAC: Authorizing `identity:get_user(user_id=0a2289135265475ab7faec00c36046b3)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:21:57.787822 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109e34a4-4b15-4c70-94df-87ba24b43ec2 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:21:57.789407 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 5/9] 10.222.0.39 () {56 vars in 1198 bytes} [Mon Jul 18 10:21:57 2022] GET /identity/v3/users/0a2289135265475ab7faec00c36046b3 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:21:59.870558 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88cca3-f589-4f0a-aa30-5f863e345806 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:59.871143 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88cca3-f589-4f0a-aa30-5f863e345806 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:59.871143 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88cca3-f589-4f0a-aa30-5f863e345806 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:59.872512 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 5/10] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:21:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:21:59.877683 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d89b45e-8732-402c-98d0-c5dbc3bbba39 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:59.878060 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d89b45e-8732-402c-98d0-c5dbc3bbba39 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:59.878981 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d89b45e-8732-402c-98d0-c5dbc3bbba39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:59.880845 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33773140-8c26-4539-8528-a782f23ab628 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:59.881174 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33773140-8c26-4539-8528-a782f23ab628 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:59.881461 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33773140-8c26-4539-8528-a782f23ab628 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:59.882722 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 6/11] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:21:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:21:59.888015 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e583b-aae6-4b8b-adb5-6e31ebb133ca None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:21:59.888297 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e583b-aae6-4b8b-adb5-6e31ebb133ca None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:21:59.888569 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e583b-aae6-4b8b-adb5-6e31ebb133ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:21:59.895483 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-6d89b45e-8732-402c-98d0-c5dbc3bbba39 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:21:59.896666 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-6d89b45e-8732-402c-98d0-c5dbc3bbba39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:21:59.928139 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG passlib.handlers.bcrypt [None req-641e583b-aae6-4b8b-adb5-6e31ebb133ca None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80393) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 18 10:21:59.928552 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG passlib.handlers.bcrypt [None req-641e583b-aae6-4b8b-adb5-6e31ebb133ca None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80393) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 18 10:21:59.973999 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-641e583b-aae6-4b8b-adb5-6e31ebb133ca None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:21:59.975606 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-641e583b-aae6-4b8b-adb5-6e31ebb133ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:21:59.976745 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 6/12] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:21:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:22:00.000950 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d89b45e-8732-402c-98d0-c5dbc3bbba39 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:00.025061 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:00.075827 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 7/13] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:21:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 10:22:00.097449 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e583b-aae6-4b8b-adb5-6e31ebb133ca None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:00.107636 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d89b45e-8732-402c-98d0-c5dbc3bbba39 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:00.142512 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9db06e-f510-4ec6-b7e8-179089751e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:00.143531 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9db06e-f510-4ec6-b7e8-179089751e5b None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:00.143855 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9db06e-f510-4ec6-b7e8-179089751e5b None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:00.144235 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9db06e-f510-4ec6-b7e8-179089751e5b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:00.155286 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9db06e-f510-4ec6-b7e8-179089751e5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:22:00.167279 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-db9db06e-f510-4ec6-b7e8-179089751e5b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:22:00.167279 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:22:00.167279 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:22:00.167279 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:22:00.167279 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:22:00.167279 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:22:00.167279 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:22:00.167279 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:22:00.167279 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:22:00.167279 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:22:00.167279 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:22:00.167279 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:22:00.167279 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:22:00.167279 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:22:00.167279 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:22:00.167279 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:22:00.168254 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:22:00.168254 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:22:00.168254 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:22:00.168254 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:22:00.168254 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:22:00.168254 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:22:00.168254 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:22:00.168254 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:22:00.168254 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:22:00.168254 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:22:00.168254 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:22:00.168254 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:22:00.168254 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:22:00.168254 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:22:00.168254 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:22:00.168254 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:22:00.169151 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:22:00.169151 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:22:00.169151 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:22:00.169151 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:22:00.169151 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:22:00.169151 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:22:00.169151 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:22:00.169151 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:22:00.169151 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:22:00.169151 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:22:00.169151 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:22:00.169151 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:22:00.169151 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 7/14] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 10:21:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:22:00.174335 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9db06e-f510-4ec6-b7e8-179089751e5b None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:00.198079 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e583b-aae6-4b8b-adb5-6e31ebb133ca None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:00.200329 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:00.236193 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ff113-4de5-4b88-abc8-c5820d5f1f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:00.237118 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ff113-4de5-4b88-abc8-c5820d5f1f26 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:00.237406 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ff113-4de5-4b88-abc8-c5820d5f1f26 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:00.238294 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ff113-4de5-4b88-abc8-c5820d5f1f26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:00.258129 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:00.276235 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9db06e-f510-4ec6-b7e8-179089751e5b None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:00.305770 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4ff113-4de5-4b88-abc8-c5820d5f1f26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:00.307294 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4ff113-4de5-4b88-abc8-c5820d5f1f26 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:00.311754 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90759549-61f6-4c34-abbc-c5cc0ac8e054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:00.312428 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90759549-61f6-4c34-abbc-c5cc0ac8e054 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:00.312709 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90759549-61f6-4c34-abbc-c5cc0ac8e054 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:00.312981 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90759549-61f6-4c34-abbc-c5cc0ac8e054 None admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:00.313759 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90759549-61f6-4c34-abbc-c5cc0ac8e054 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:00.314065 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90759549-61f6-4c34-abbc-c5cc0ac8e054 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:00.315441 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90759549-61f6-4c34-abbc-c5cc0ac8e054 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:00.327813 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 8/15] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 10:22:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:00.333532 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90759549-61f6-4c34-abbc-c5cc0ac8e054 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:00.410423 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 8/16] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 10:22:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 18 10:22:00.415820 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ff113-4de5-4b88-abc8-c5820d5f1f26 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:00.419363 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:00.431841 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90759549-61f6-4c34-abbc-c5cc0ac8e054 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:00.466593 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6592d55-88ff-4a27-861a-d4ac1411eb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:00.467459 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6592d55-88ff-4a27-861a-d4ac1411eb83 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:00.467742 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6592d55-88ff-4a27-861a-d4ac1411eb83 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:00.468022 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6592d55-88ff-4a27-861a-d4ac1411eb83 None admin] PATH_INFO: `/v3/users/0a2289135265475ab7faec00c36046b3` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:00.469246 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6592d55-88ff-4a27-861a-d4ac1411eb83 None admin] RBAC: Authorizing `identity:get_user(user_id=0a2289135265475ab7faec00c36046b3)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:00.470700 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6592d55-88ff-4a27-861a-d4ac1411eb83 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:00.473086 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 9/17] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 10:22:00 2022] GET /identity/v3/users/0a2289135265475ab7faec00c36046b3 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:22:00.478314 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6592d55-88ff-4a27-861a-d4ac1411eb83 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:00.493791 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:00.515583 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ff113-4de5-4b88-abc8-c5820d5f1f26 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:00.548333 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee193aa1-cb2d-40e2-8375-dc45db10bcfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:00.549160 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee193aa1-cb2d-40e2-8375-dc45db10bcfe None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:00.549454 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee193aa1-cb2d-40e2-8375-dc45db10bcfe None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:00.549734 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee193aa1-cb2d-40e2-8375-dc45db10bcfe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:00.571658 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee193aa1-cb2d-40e2-8375-dc45db10bcfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:00.573163 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee193aa1-cb2d-40e2-8375-dc45db10bcfe None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:00.582086 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6592d55-88ff-4a27-861a-d4ac1411eb83 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:00.593753 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-ee193aa1-cb2d-40e2-8375-dc45db10bcfe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:22:00.593753 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:22:00.593753 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:22:00.593753 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:22:00.593753 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:22:00.593753 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:22:00.593753 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:22:00.593753 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:22:00.593753 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:22:00.593753 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:22:00.593753 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:22:00.593753 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:22:00.593753 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:22:00.593753 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:22:00.593753 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:22:00.594577 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:22:00.594577 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:22:00.594577 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:22:00.594577 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:22:00.594577 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:22:00.594577 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:22:00.594577 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:22:00.594577 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:22:00.594577 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:22:00.594577 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:22:00.594577 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:22:00.594577 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:22:00.594577 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:22:00.594577 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:22:00.594577 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:22:00.594577 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:22:00.594577 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:22:00.595583 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:22:00.595583 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:22:00.595583 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:22:00.595583 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:22:00.595583 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 9/18] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:22:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:22:00.601460 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee193aa1-cb2d-40e2-8375-dc45db10bcfe None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:00.618654 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef81f856-8f86-420e-862f-61075b235ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:00.619462 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef81f856-8f86-420e-862f-61075b235ec1 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:00.619747 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef81f856-8f86-420e-862f-61075b235ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:00.620021 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef81f856-8f86-420e-862f-61075b235ec1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:00.621234 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef81f856-8f86-420e-862f-61075b235ec1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:00.622684 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef81f856-8f86-420e-862f-61075b235ec1 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:00.624275 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 10/19] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:22:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:22:00.631052 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef81f856-8f86-420e-862f-61075b235ec1 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:00.658391 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:00.705091 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee193aa1-cb2d-40e2-8375-dc45db10bcfe None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:00.713502 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:00.732090 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef81f856-8f86-420e-862f-61075b235ec1 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:00.744555 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c23d6-5da1-4a7b-b5ba-c6e373bed3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:00.745352 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c23d6-5da1-4a7b-b5ba-c6e373bed3f6 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:00.745704 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c23d6-5da1-4a7b-b5ba-c6e373bed3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:00.746055 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c23d6-5da1-4a7b-b5ba-c6e373bed3f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:00.746862 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295c23d6-5da1-4a7b-b5ba-c6e373bed3f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:00.747241 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295c23d6-5da1-4a7b-b5ba-c6e373bed3f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:00.748701 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295c23d6-5da1-4a7b-b5ba-c6e373bed3f6 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:00.766060 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 10/20] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:22:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:22:00.768301 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f5c0d0-1450-455e-8ff8-65e6581bd489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:00.769519 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5c0d0-1450-455e-8ff8-65e6581bd489 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:00.769839 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5c0d0-1450-455e-8ff8-65e6581bd489 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:00.770188 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5c0d0-1450-455e-8ff8-65e6581bd489 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:00.771037 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f5c0d0-1450-455e-8ff8-65e6581bd489 None admin] RBAC: Adding query filter params (role.id=e7b6a55ecf6c491487955aaefbf9c388, scope.domain.id=default, user.id=0a2289135265475ab7faec00c36046b3) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:00.771348 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f5c0d0-1450-455e-8ff8-65e6581bd489 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:00.772823 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f5c0d0-1450-455e-8ff8-65e6581bd489 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:00.780510 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 11/21] 10.222.0.39 () {56 vars in 1322 bytes} [Mon Jul 18 10:22:00 2022] GET /identity/v3/role_assignments?user.id=0a2289135265475ab7faec00c36046b3&scope.domain.id=default&role.id=e7b6a55ecf6c491487955aaefbf9c388 => generated 233 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:22:03.111794 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9c5fc-7ef0-4fde-80f3-3599bfe423aa None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:03.112307 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9c5fc-7ef0-4fde-80f3-3599bfe423aa None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:03.113060 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9c5fc-7ef0-4fde-80f3-3599bfe423aa None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:03.114391 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 11/22] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:22:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:22:03.120014 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f52d2df-ba8f-4842-ab32-dabd6d428084 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:03.120843 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f52d2df-ba8f-4842-ab32-dabd6d428084 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:03.121342 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f52d2df-ba8f-4842-ab32-dabd6d428084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:03.146064 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-0f52d2df-ba8f-4842-ab32-dabd6d428084 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:22:03.147610 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-0f52d2df-ba8f-4842-ab32-dabd6d428084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:22:03.236407 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 12/23] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:22:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:22:03.272053 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a9c5fc-7ef0-4fde-80f3-3599bfe423aa None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:03.357795 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4cb64c-3a24-4099-af4b-0897a09ab060 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:03.358427 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4cb64c-3a24-4099-af4b-0897a09ab060 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:03.358909 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4cb64c-3a24-4099-af4b-0897a09ab060 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:03.360470 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 13/24] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:22:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:22:03.369676 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ba6c2-5983-46ab-8b24-e481d6ec3769 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:03.370243 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ba6c2-5983-46ab-8b24-e481d6ec3769 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:03.370724 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ba6c2-5983-46ab-8b24-e481d6ec3769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:03.410129 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-c03ba6c2-5983-46ab-8b24-e481d6ec3769 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:22:03.411725 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-c03ba6c2-5983-46ab-8b24-e481d6ec3769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:22:03.442940 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a9c5fc-7ef0-4fde-80f3-3599bfe423aa None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:03.473524 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:03.507032 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8fe3e3-77dd-4cec-8246-add175b52daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:03.507955 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8fe3e3-77dd-4cec-8246-add175b52daf None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:03.508249 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8fe3e3-77dd-4cec-8246-add175b52daf None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:03.508529 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8fe3e3-77dd-4cec-8246-add175b52daf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:03.524030 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8fe3e3-77dd-4cec-8246-add175b52daf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:22:03.545154 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-0e8fe3e3-77dd-4cec-8246-add175b52daf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:22:03.545154 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:22:03.545154 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:22:03.545154 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:22:03.545154 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:22:03.545154 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:22:03.545154 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:22:03.545154 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:22:03.545154 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:22:03.545154 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:22:03.545154 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:22:03.545154 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:22:03.545154 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:22:03.545154 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:22:03.545154 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:22:03.545154 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:22:03.546077 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:22:03.546077 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:22:03.546077 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:22:03.546077 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:22:03.546077 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:22:03.546077 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:22:03.546077 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:22:03.546077 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:22:03.546077 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:22:03.546077 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:22:03.546077 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:22:03.546077 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:22:03.546077 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:22:03.546077 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:22:03.546077 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:22:03.546077 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:22:03.547022 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:22:03.547022 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:22:03.547022 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:22:03.547022 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:22:03.547022 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:22:03.547022 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:22:03.547022 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:22:03.547022 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:22:03.547022 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:22:03.547022 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:22:03.547022 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:22:03.547022 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:22:03.547022 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 12/25] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 10:22:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:22:03.553793 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8fe3e3-77dd-4cec-8246-add175b52daf None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:03.578399 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 14/26] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:22:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 10:22:03.619548 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ba6c2-5983-46ab-8b24-e481d6ec3769 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:03.629417 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:03.702506 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8fe3e3-77dd-4cec-8246-add175b52daf None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:03.761321 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88947124-c63d-4409-bcd6-d23451931551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:03.762009 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88947124-c63d-4409-bcd6-d23451931551 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:03.762290 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88947124-c63d-4409-bcd6-d23451931551 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:03.762569 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88947124-c63d-4409-bcd6-d23451931551 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:03.763330 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88947124-c63d-4409-bcd6-d23451931551 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:03.763638 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88947124-c63d-4409-bcd6-d23451931551 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:03.765053 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88947124-c63d-4409-bcd6-d23451931551 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:03.798566 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 13/27] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 10:22:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:03.802811 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca44d34-9bfb-4b02-95e2-55d7d6693493 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:03.803375 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca44d34-9bfb-4b02-95e2-55d7d6693493 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:03.803992 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca44d34-9bfb-4b02-95e2-55d7d6693493 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:03.805666 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 14/28] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:22:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:22:03.807044 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50c20e-917e-4268-bc69-bece2cb9a8be None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:03.807541 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50c20e-917e-4268-bc69-bece2cb9a8be None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:03.808016 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50c20e-917e-4268-bc69-bece2cb9a8be None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:03.809734 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 15/29] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:22:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:22:03.810674 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df50c20e-917e-4268-bc69-bece2cb9a8be None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:03.832630 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ba6c2-5983-46ab-8b24-e481d6ec3769 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:03.860399 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:03.874595 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8990cec2-66c2-4236-9a55-d29368701c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:03.874595 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990cec2-66c2-4236-9a55-d29368701c56 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:03.874595 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990cec2-66c2-4236-9a55-d29368701c56 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:03.874595 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990cec2-66c2-4236-9a55-d29368701c56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:03.885781 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8990cec2-66c2-4236-9a55-d29368701c56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:03.887521 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8990cec2-66c2-4236-9a55-d29368701c56 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:03.910798 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-8990cec2-66c2-4236-9a55-d29368701c56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:22:03.910798 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:22:03.910798 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:22:03.910798 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:22:03.910798 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:22:03.910798 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:22:03.910798 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:22:03.910798 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:22:03.910798 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:22:03.910798 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:22:03.910798 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:22:03.910798 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:22:03.910798 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:22:03.910798 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:22:03.910798 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:22:03.911658 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:22:03.911658 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:22:03.911658 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:22:03.911658 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:22:03.911658 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:22:03.911658 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:22:03.911658 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:22:03.911658 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:22:03.911658 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:22:03.911658 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:22:03.911658 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:22:03.911658 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:22:03.911658 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:22:03.911658 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:22:03.911658 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:22:03.911658 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:22:03.911658 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:22:03.912616 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:22:03.912616 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:22:03.912616 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:22:03.912616 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:22:03.912616 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 15/30] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:22:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:22:03.919052 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37568f3d-1b73-46ca-afea-07c5f2a4e966 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:03.919415 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37568f3d-1b73-46ca-afea-07c5f2a4e966 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:03.919887 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37568f3d-1b73-46ca-afea-07c5f2a4e966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:03.935487 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df50c20e-917e-4268-bc69-bece2cb9a8be None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:03.939041 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-37568f3d-1b73-46ca-afea-07c5f2a4e966 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:22:03.940311 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-37568f3d-1b73-46ca-afea-07c5f2a4e966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:22:03.973291 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4126334a-14cd-47db-9e43-43349d78d069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:03.974263 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126334a-14cd-47db-9e43-43349d78d069 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:03.974607 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126334a-14cd-47db-9e43-43349d78d069 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:03.974914 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126334a-14cd-47db-9e43-43349d78d069 None admin] PATH_INFO: `/v3/users/0a2289135265475ab7faec00c36046b3` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:03.976791 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4126334a-14cd-47db-9e43-43349d78d069 None admin] RBAC: Authorizing `identity:get_user(user_id=0a2289135265475ab7faec00c36046b3)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:03.978435 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4126334a-14cd-47db-9e43-43349d78d069 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:03.980148 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 16/31] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 10:22:03 2022] GET /identity/v3/users/0a2289135265475ab7faec00c36046b3 => generated 247 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:03.985819 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800378dd-6e61-4334-8658-cbaa9f93a2b6 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:03.986123 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800378dd-6e61-4334-8658-cbaa9f93a2b6 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:03.986400 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800378dd-6e61-4334-8658-cbaa9f93a2b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:03.999983 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:04.007058 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-800378dd-6e61-4334-8658-cbaa9f93a2b6 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:22:04.012714 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-800378dd-6e61-4334-8658-cbaa9f93a2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:22:04.020165 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 16/32] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:22:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:22:04.025236 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37568f3d-1b73-46ca-afea-07c5f2a4e966 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:04.082993 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 17/33] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:22:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:22:04.083846 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800378dd-6e61-4334-8658-cbaa9f93a2b6 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:04.122350 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:04.159458 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37568f3d-1b73-46ca-afea-07c5f2a4e966 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:04.194737 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800378dd-6e61-4334-8658-cbaa9f93a2b6 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:04.197610 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d59b72c-db29-420b-a517-feff836c764d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:04.198484 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59b72c-db29-420b-a517-feff836c764d None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:04.198925 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59b72c-db29-420b-a517-feff836c764d None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:04.199367 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59b72c-db29-420b-a517-feff836c764d None admin] PATH_INFO: `/v3/domains` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:04.200245 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d59b72c-db29-420b-a517-feff836c764d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:04.200703 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d59b72c-db29-420b-a517-feff836c764d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:04.202262 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d59b72c-db29-420b-a517-feff836c764d None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:04.227808 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 17/34] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:22:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:04.228967 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d59b72c-db29-420b-a517-feff836c764d None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:04.231234 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d203313e-81de-47d7-bcfe-286c0940f24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:04.232347 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203313e-81de-47d7-bcfe-286c0940f24a None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:04.232881 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203313e-81de-47d7-bcfe-286c0940f24a None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:04.233347 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203313e-81de-47d7-bcfe-286c0940f24a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:04.234737 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d203313e-81de-47d7-bcfe-286c0940f24a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:04.236349 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d203313e-81de-47d7-bcfe-286c0940f24a None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:04.239051 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 18/35] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:22:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:04.240028 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d203313e-81de-47d7-bcfe-286c0940f24a None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:04.282589 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:04.346203 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d59b72c-db29-420b-a517-feff836c764d None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:04.352618 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d203313e-81de-47d7-bcfe-286c0940f24a None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:04.355749 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:04.386737 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad9887-c007-4aad-aa82-c2e1c7d8c95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:04.387426 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad9887-c007-4aad-aa82-c2e1c7d8c95f None admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:04.387711 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad9887-c007-4aad-aa82-c2e1c7d8c95f None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:04.387992 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad9887-c007-4aad-aa82-c2e1c7d8c95f None admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:04.388742 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ad9887-c007-4aad-aa82-c2e1c7d8c95f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:04.390236 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ad9887-c007-4aad-aa82-c2e1c7d8c95f None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:04.391078 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3728443d-c5db-4a57-a63d-e3e746710c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:04.391754 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728443d-c5db-4a57-a63d-e3e746710c48 None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:04.392040 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728443d-c5db-4a57-a63d-e3e746710c48 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:04.392323 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728443d-c5db-4a57-a63d-e3e746710c48 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:04.393089 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3728443d-c5db-4a57-a63d-e3e746710c48 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:04.394548 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3728443d-c5db-4a57-a63d-e3e746710c48 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:04.601070 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 18/36] 10.222.0.39 () {60 vars in 1131 bytes} [Mon Jul 18 10:22:04 2022] POST /identity/v3/roles => generated 225 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:22:04.601070 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad9887-c007-4aad-aa82-c2e1c7d8c95f None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:04.629800 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 19/37] 10.222.0.39 () {60 vars in 1131 bytes} [Mon Jul 18 10:22:04 2022] POST /identity/v3/roles => generated 219 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:22:04.631162 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3728443d-c5db-4a57-a63d-e3e746710c48 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:04.730375 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad9887-c007-4aad-aa82-c2e1c7d8c95f None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:04.739720 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:04.854353 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3728443d-c5db-4a57-a63d-e3e746710c48 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:04.888978 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a068c20e-07dd-4d6c-b553-04a41abb9171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:04.889686 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068c20e-07dd-4d6c-b553-04a41abb9171 None admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:04.889974 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068c20e-07dd-4d6c-b553-04a41abb9171 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:04.890253 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068c20e-07dd-4d6c-b553-04a41abb9171 None admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:04.890974 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a068c20e-07dd-4d6c-b553-04a41abb9171 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:04.892628 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a068c20e-07dd-4d6c-b553-04a41abb9171 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:04.895778 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87742dd3-52dc-4a0f-93d3-95dd16dbb73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:04.896844 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87742dd3-52dc-4a0f-93d3-95dd16dbb73e None admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:04.897322 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87742dd3-52dc-4a0f-93d3-95dd16dbb73e None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:04.897741 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87742dd3-52dc-4a0f-93d3-95dd16dbb73e None admin] PATH_INFO: `/v3/domains/default/users/0a2289135265475ab7faec00c36046b3/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:04.901893 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87742dd3-52dc-4a0f-93d3-95dd16dbb73e None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=0a2289135265475ab7faec00c36046b3, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:04.904378 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87742dd3-52dc-4a0f-93d3-95dd16dbb73e None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:05.015008 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 20/38] 10.222.0.39 () {58 vars in 1361 bytes} [Mon Jul 18 10:22:04 2022] PUT /identity/v3/domains/default/users/0a2289135265475ab7faec00c36046b3/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:22:05.016412 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976a198-5a26-45f1-9d58-b545a35f33ba None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:05.016705 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976a198-5a26-45f1-9d58-b545a35f33ba None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:05.016988 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976a198-5a26-45f1-9d58-b545a35f33ba None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:05.018313 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 21/39] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:22:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:22:05.019588 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468864e8-9d23-4546-b5c6-9e4cf4f79d5b None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:05.020035 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468864e8-9d23-4546-b5c6-9e4cf4f79d5b None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:05.020233 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468864e8-9d23-4546-b5c6-9e4cf4f79d5b None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:05.021634 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 22/40] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:22:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:22:05.026810 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b4425-f8b2-42b0-8db5-0613bce6f5a6 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:05.027111 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b4425-f8b2-42b0-8db5-0613bce6f5a6 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:05.027400 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b4425-f8b2-42b0-8db5-0613bce6f5a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:05.029841 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 19/41] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Jul 18 10:22:04 2022] POST /identity/v3/projects => generated 301 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:22:05.031216 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f426be3-bf18-4c8a-a6bb-3a203c5591e2 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:05.031510 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f426be3-bf18-4c8a-a6bb-3a203c5591e2 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:05.031790 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f426be3-bf18-4c8a-a6bb-3a203c5591e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:05.048673 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-c21b4425-f8b2-42b0-8db5-0613bce6f5a6 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:22:05.051021 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c21b4425-f8b2-42b0-8db5-0613bce6f5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:22:05.052804 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-9f426be3-bf18-4c8a-a6bb-3a203c5591e2 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:22:05.055199 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-9f426be3-bf18-4c8a-a6bb-3a203c5591e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:22:05.074537 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:05.142377 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 20/42] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:22:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:22:05.153977 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 23/43] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:22:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:22:05.173534 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f426be3-bf18-4c8a-a6bb-3a203c5591e2 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:05.178600 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b4425-f8b2-42b0-8db5-0613bce6f5a6 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:05.299894 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:05.316379 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f426be3-bf18-4c8a-a6bb-3a203c5591e2 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:05.321731 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b4425-f8b2-42b0-8db5-0613bce6f5a6 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:05.354323 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f9843-1dce-44e4-8fb2-a003875d2fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:05.355201 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f9843-1dce-44e4-8fb2-a003875d2fcf None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:05.355432 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f9843-1dce-44e4-8fb2-a003875d2fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:05.355711 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f9843-1dce-44e4-8fb2-a003875d2fcf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:05.356997 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063f9843-1dce-44e4-8fb2-a003875d2fcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:05.358505 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063f9843-1dce-44e4-8fb2-a003875d2fcf None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:05.365301 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 21/44] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:22:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:05.365446 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab78d5a7-e9b2-4512-abb0-22606d69cbdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:05.365446 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78d5a7-e9b2-4512-abb0-22606d69cbdf None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:05.365446 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78d5a7-e9b2-4512-abb0-22606d69cbdf None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:05.365446 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78d5a7-e9b2-4512-abb0-22606d69cbdf None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:05.365784 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab78d5a7-e9b2-4512-abb0-22606d69cbdf None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:05.365784 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab78d5a7-e9b2-4512-abb0-22606d69cbdf None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:05.367120 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f9843-1dce-44e4-8fb2-a003875d2fcf None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:05.449402 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 24/45] 10.222.0.39 () {60 vars in 1131 bytes} [Mon Jul 18 10:22:05 2022] POST /identity/v3/roles => generated 223 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:22:05.483296 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f9843-1dce-44e4-8fb2-a003875d2fcf None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:05.523265 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bd6a15-fb85-4d21-b0aa-66b4ecb9088a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:05.524296 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd6a15-fb85-4d21-b0aa-66b4ecb9088a None admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:05.524790 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd6a15-fb85-4d21-b0aa-66b4ecb9088a None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:05.525264 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd6a15-fb85-4d21-b0aa-66b4ecb9088a None admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:05.526197 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bd6a15-fb85-4d21-b0aa-66b4ecb9088a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:05.527867 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bd6a15-fb85-4d21-b0aa-66b4ecb9088a None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:05.610543 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 22/46] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Jul 18 10:22:05 2022] POST /identity/v3/projects => generated 312 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:22:07.137946 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b2c44-9930-420e-a480-f82d0b60865a None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:07.138457 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b2c44-9930-420e-a480-f82d0b60865a None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:07.138546 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b2c44-9930-420e-a480-f82d0b60865a None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:07.140019 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 25/47] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:22:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:22:07.145667 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88bfe8f-6132-4835-961a-fb222f0f2fdf None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:07.146073 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88bfe8f-6132-4835-961a-fb222f0f2fdf None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:07.146335 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88bfe8f-6132-4835-961a-fb222f0f2fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:07.163333 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-e88bfe8f-6132-4835-961a-fb222f0f2fdf None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:22:07.164531 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-e88bfe8f-6132-4835-961a-fb222f0f2fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:22:07.166508 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:07.231501 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 23/48] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:22:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 10:22:07.256849 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852b2c44-9930-420e-a480-f82d0b60865a None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:07.281851 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:07.361796 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852b2c44-9930-420e-a480-f82d0b60865a None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:07.395481 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea0e69-0279-4d47-9a7e-3f910c9c649d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:07.396271 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea0e69-0279-4d47-9a7e-3f910c9c649d None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:07.396553 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea0e69-0279-4d47-9a7e-3f910c9c649d None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:07.396830 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea0e69-0279-4d47-9a7e-3f910c9c649d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:07.406716 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bea0e69-0279-4d47-9a7e-3f910c9c649d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:22:07.414597 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-7bea0e69-0279-4d47-9a7e-3f910c9c649d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:22:07.414597 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:22:07.414597 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:22:07.414597 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:22:07.414597 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:22:07.414597 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:22:07.414597 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:22:07.414597 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:22:07.414597 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:22:07.414597 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:22:07.414597 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:22:07.414597 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:22:07.414597 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:22:07.414597 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:22:07.414597 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:22:07.414597 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:22:07.415609 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:22:07.415609 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:22:07.415609 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:22:07.415609 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:22:07.415609 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:22:07.415609 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:22:07.415609 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:22:07.415609 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:22:07.415609 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:22:07.415609 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:22:07.415609 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:22:07.415609 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:22:07.415609 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:22:07.415609 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:22:07.415609 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:22:07.415609 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:22:07.416515 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:22:07.416515 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:22:07.416515 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:22:07.416515 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:22:07.416515 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:22:07.416515 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:22:07.416515 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:22:07.416515 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:22:07.416515 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:22:07.416515 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:22:07.416515 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:22:07.416515 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:22:07.416515 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 26/49] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 10:22:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:22:07.421666 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88bfe8f-6132-4835-961a-fb222f0f2fdf None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:07.520758 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88bfe8f-6132-4835-961a-fb222f0f2fdf None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:07.553761 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445f7c08-bc26-40f8-ac5b-84fb8612f711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:07.554748 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445f7c08-bc26-40f8-ac5b-84fb8612f711 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:07.555144 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445f7c08-bc26-40f8-ac5b-84fb8612f711 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:07.555427 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445f7c08-bc26-40f8-ac5b-84fb8612f711 None admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:07.556186 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445f7c08-bc26-40f8-ac5b-84fb8612f711 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:07.556496 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445f7c08-bc26-40f8-ac5b-84fb8612f711 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:07.557930 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445f7c08-bc26-40f8-ac5b-84fb8612f711 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:07.563259 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:07.567575 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 24/50] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 10:22:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:07.572943 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea0e69-0279-4d47-9a7e-3f910c9c649d None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:07.654741 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:07.655291 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45172b32-b83d-4de1-8d9b-f487f94b5c6c None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:07.655595 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45172b32-b83d-4de1-8d9b-f487f94b5c6c None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:07.655882 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45172b32-b83d-4de1-8d9b-f487f94b5c6c None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:07.657291 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 25/51] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:22:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:22:07.662965 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6197abd-0253-417f-bb2d-b1fa31705a39 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:07.663321 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6197abd-0253-417f-bb2d-b1fa31705a39 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:07.667294 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6197abd-0253-417f-bb2d-b1fa31705a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:07.680655 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea0e69-0279-4d47-9a7e-3f910c9c649d None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:07.680826 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-b6197abd-0253-417f-bb2d-b1fa31705a39 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:22:07.682007 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-b6197abd-0253-417f-bb2d-b1fa31705a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:22:07.723380 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd8139d-5cdc-462c-b5ea-912e270da967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:07.724387 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8139d-5cdc-462c-b5ea-912e270da967 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:07.724673 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8139d-5cdc-462c-b5ea-912e270da967 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:07.724951 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8139d-5cdc-462c-b5ea-912e270da967 None admin] PATH_INFO: `/v3/users/0a2289135265475ab7faec00c36046b3` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:07.726177 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd8139d-5cdc-462c-b5ea-912e270da967 None admin] RBAC: Authorizing `identity:get_user(user_id=0a2289135265475ab7faec00c36046b3)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:07.727634 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd8139d-5cdc-462c-b5ea-912e270da967 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:07.729363 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 27/52] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 10:22:07 2022] GET /identity/v3/users/0a2289135265475ab7faec00c36046b3 => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:07.735310 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd8139d-5cdc-462c-b5ea-912e270da967 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:07.758221 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 26/53] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:22:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 10:22:07.782671 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6197abd-0253-417f-bb2d-b1fa31705a39 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:07.898106 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6197abd-0253-417f-bb2d-b1fa31705a39 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:07.945832 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:07.945832 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f8819-fb56-4b93-92be-234a4de04137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:07.945832 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f8819-fb56-4b93-92be-234a4de04137 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:07.945832 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f8819-fb56-4b93-92be-234a4de04137 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:07.946302 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f8819-fb56-4b93-92be-234a4de04137 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:07.946302 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91f8819-fb56-4b93-92be-234a4de04137 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:07.946302 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91f8819-fb56-4b93-92be-234a4de04137 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:07.947829 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 27/54] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:22:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:22:07.949555 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd8139d-5cdc-462c-b5ea-912e270da967 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:07.954336 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f8819-fb56-4b93-92be-234a4de04137 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:07.991568 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6922e1fe-8696-4051-9779-cc944f3203a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:07.992634 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922e1fe-8696-4051-9779-cc944f3203a4 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:07.992918 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922e1fe-8696-4051-9779-cc944f3203a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:07.993231 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922e1fe-8696-4051-9779-cc944f3203a4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:07.994598 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6922e1fe-8696-4051-9779-cc944f3203a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:07.996702 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6922e1fe-8696-4051-9779-cc944f3203a4 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:08.004569 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 28/55] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:22:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:22:08.005679 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6922e1fe-8696-4051-9779-cc944f3203a4 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:08.019065 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:08.071464 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f8819-fb56-4b93-92be-234a4de04137 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:08.110340 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b68454b-ab56-469d-8681-92166c55d587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:08.111048 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68454b-ab56-469d-8681-92166c55d587 None admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:08.111339 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68454b-ab56-469d-8681-92166c55d587 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:08.111622 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68454b-ab56-469d-8681-92166c55d587 None admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:08.113279 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b68454b-ab56-469d-8681-92166c55d587 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:08.120106 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b68454b-ab56-469d-8681-92166c55d587 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:08.122470 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6922e1fe-8696-4051-9779-cc944f3203a4 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:08.158005 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cbf731-c19c-4d5c-9358-522944a38cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:08.158671 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cbf731-c19c-4d5c-9358-522944a38cc8 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:08.158977 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cbf731-c19c-4d5c-9358-522944a38cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:08.159427 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cbf731-c19c-4d5c-9358-522944a38cc8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:08.160276 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cbf731-c19c-4d5c-9358-522944a38cc8 None admin] RBAC: Adding query filter params (role.id=e7b6a55ecf6c491487955aaefbf9c388, scope.domain.id=default, user.id=0a2289135265475ab7faec00c36046b3) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:08.160633 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cbf731-c19c-4d5c-9358-522944a38cc8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:08.162151 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cbf731-c19c-4d5c-9358-522944a38cc8 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:08.170984 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 29/56] 10.222.0.39 () {56 vars in 1322 bytes} [Mon Jul 18 10:22:08 2022] GET /identity/v3/role_assignments?user.id=0a2289135265475ab7faec00c36046b3&scope.domain.id=default&role.id=e7b6a55ecf6c491487955aaefbf9c388 => generated 530 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:22:08.212543 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 28/57] 10.222.0.39 () {60 vars in 1140 bytes} [Mon Jul 18 10:22:07 2022] POST /identity/v3/projects => generated 298 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:22:10.268824 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8f4f2-2ec4-4c34-809b-c91fa9813484 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:10.269361 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8f4f2-2ec4-4c34-809b-c91fa9813484 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:10.269473 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8f4f2-2ec4-4c34-809b-c91fa9813484 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:10.270807 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 30/58] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:22:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:22:10.275829 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c87388-f22d-48fb-a0fe-b3ae3a1da885 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:10.276184 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c87388-f22d-48fb-a0fe-b3ae3a1da885 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:10.276399 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c87388-f22d-48fb-a0fe-b3ae3a1da885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:10.293251 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-a9c87388-f22d-48fb-a0fe-b3ae3a1da885 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:22:10.294442 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-a9c87388-f22d-48fb-a0fe-b3ae3a1da885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:22:10.339076 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:10.359202 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 29/59] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:22:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:22:10.385772 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d8f4f2-2ec4-4c34-809b-c91fa9813484 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:10.459680 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:10.484592 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d8f4f2-2ec4-4c34-809b-c91fa9813484 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:10.517563 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dba328-9764-4d81-a4ba-2dcb24dc32ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:10.518355 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dba328-9764-4d81-a4ba-2dcb24dc32ea None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:10.518635 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dba328-9764-4d81-a4ba-2dcb24dc32ea None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:10.518911 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dba328-9764-4d81-a4ba-2dcb24dc32ea None admin] PATH_INFO: `/v3/domains/default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:10.520076 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dba328-9764-4d81-a4ba-2dcb24dc32ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:10.521530 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dba328-9764-4d81-a4ba-2dcb24dc32ea None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:10.523118 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 31/60] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:22:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:10.528747 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c87388-f22d-48fb-a0fe-b3ae3a1da885 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:10.626184 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c87388-f22d-48fb-a0fe-b3ae3a1da885 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:10.658802 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5305a86c-8b67-460e-92c0-01f961618693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:10.660018 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5305a86c-8b67-460e-92c0-01f961618693 None admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:10.660307 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5305a86c-8b67-460e-92c0-01f961618693 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:10.660590 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5305a86c-8b67-460e-92c0-01f961618693 None admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:10.661340 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5305a86c-8b67-460e-92c0-01f961618693 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:10.662799 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5305a86c-8b67-460e-92c0-01f961618693 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:10.779619 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 30/61] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Jul 18 10:22:10 2022] POST /identity/v3/users => generated 275 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:22:13.830544 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ff5fd-e4c5-4c05-8d3d-b2021c93b2b5 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:13.831776 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ff5fd-e4c5-4c05-8d3d-b2021c93b2b5 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:13.831776 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185ff5fd-e4c5-4c05-8d3d-b2021c93b2b5 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:13.832594 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 32/62] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:22:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:22:13.837851 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7737b2-b155-420c-9bc8-d10608d3e777 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:13.838590 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7737b2-b155-420c-9bc8-d10608d3e777 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:13.839108 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7737b2-b155-420c-9bc8-d10608d3e777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:13.866178 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-9f7737b2-b155-420c-9bc8-d10608d3e777 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:22:13.867904 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-9f7737b2-b155-420c-9bc8-d10608d3e777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:22:13.912425 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:13.967650 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 31/63] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:22:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:22:14.008944 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ff5fd-e4c5-4c05-8d3d-b2021c93b2b5 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:14.082118 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e82657-81c9-4071-8ad7-22df30ed3b80 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:14.082629 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e82657-81c9-4071-8ad7-22df30ed3b80 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:14.083048 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e82657-81c9-4071-8ad7-22df30ed3b80 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:14.084562 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 32/64] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:22:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:22:14.102732 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc33ad-c0ec-48bc-8add-c1e5a4255fdb None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:14.103631 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc33ad-c0ec-48bc-8add-c1e5a4255fdb None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:14.103631 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc33ad-c0ec-48bc-8add-c1e5a4255fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:14.135509 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185ff5fd-e4c5-4c05-8d3d-b2021c93b2b5 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:14.147589 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-c8dc33ad-c0ec-48bc-8add-c1e5a4255fdb None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:22:14.148827 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-c8dc33ad-c0ec-48bc-8add-c1e5a4255fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:22:14.197711 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05153b1a-6415-4875-b05b-c259e659cbc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:14.198531 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05153b1a-6415-4875-b05b-c259e659cbc6 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:14.198824 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05153b1a-6415-4875-b05b-c259e659cbc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:14.199110 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05153b1a-6415-4875-b05b-c259e659cbc6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:14.218787 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05153b1a-6415-4875-b05b-c259e659cbc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:22:14.226756 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-05153b1a-6415-4875-b05b-c259e659cbc6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:22:14.226756 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:22:14.226756 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:22:14.226756 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:22:14.226756 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:22:14.226756 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:22:14.226756 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:22:14.226756 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:22:14.226756 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:22:14.226756 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:22:14.226756 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:22:14.226756 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:22:14.226756 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:22:14.226756 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:22:14.226756 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:22:14.226756 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:22:14.227593 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:22:14.227593 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:22:14.227593 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:22:14.227593 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:22:14.227593 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:22:14.227593 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:22:14.227593 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:22:14.227593 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:22:14.227593 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:22:14.227593 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:22:14.227593 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:22:14.227593 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:22:14.227593 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:22:14.227593 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:22:14.227593 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:22:14.227593 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:22:14.228334 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:22:14.228334 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:22:14.228334 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:22:14.228334 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:22:14.228334 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:22:14.228334 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:22:14.228334 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:22:14.228334 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:22:14.228334 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:22:14.228334 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:22:14.228334 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:22:14.228334 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:22:14.228334 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 33/65] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 10:22:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:22:14.243746 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05153b1a-6415-4875-b05b-c259e659cbc6 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:14.248597 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:14.291866 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 33/66] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:22:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 10:22:14.293387 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c092c-d622-4cbc-ae46-bb28560d9843 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:14.293848 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c092c-d622-4cbc-ae46-bb28560d9843 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:14.294280 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c092c-d622-4cbc-ae46-bb28560d9843 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:14.295705 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 34/67] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:22:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:22:14.309614 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d67c6-a884-4f4a-8095-efccd8bd8f80 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:14.310105 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d67c6-a884-4f4a-8095-efccd8bd8f80 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:14.310559 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d67c6-a884-4f4a-8095-efccd8bd8f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:14.328684 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-112d67c6-a884-4f4a-8095-efccd8bd8f80 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:22:14.330155 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-112d67c6-a884-4f4a-8095-efccd8bd8f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:22:14.388126 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05153b1a-6415-4875-b05b-c259e659cbc6 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:14.402137 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 35/68] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:22:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 10:22:14.409223 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112d67c6-a884-4f4a-8095-efccd8bd8f80 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:14.445138 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9407b61-486d-4c92-89ad-44373fe1789a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:14.445823 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9407b61-486d-4c92-89ad-44373fe1789a None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:14.446105 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9407b61-486d-4c92-89ad-44373fe1789a None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:14.446379 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9407b61-486d-4c92-89ad-44373fe1789a None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:14.447137 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9407b61-486d-4c92-89ad-44373fe1789a None admin] RBAC: Adding query filter params (name=member) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:14.447446 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9407b61-486d-4c92-89ad-44373fe1789a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:14.448854 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9407b61-486d-4c92-89ad-44373fe1789a None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:14.451774 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:14.458258 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 34/69] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jul 18 10:22:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:14.459087 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9407b61-486d-4c92-89ad-44373fe1789a None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:14.526184 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:14.539383 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112d67c6-a884-4f4a-8095-efccd8bd8f80 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:14.571870 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9407b61-486d-4c92-89ad-44373fe1789a None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:14.576485 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c213559-e794-4239-acfd-3642f3ea42e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:14.577322 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c213559-e794-4239-acfd-3642f3ea42e5 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:14.577614 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c213559-e794-4239-acfd-3642f3ea42e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:14.577896 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c213559-e794-4239-acfd-3642f3ea42e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:14.588919 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c213559-e794-4239-acfd-3642f3ea42e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:22:14.596911 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-6c213559-e794-4239-acfd-3642f3ea42e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:22:14.596911 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:22:14.596911 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:22:14.596911 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:22:14.596911 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:22:14.596911 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:22:14.596911 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:22:14.596911 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:22:14.596911 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:22:14.596911 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:22:14.596911 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:22:14.596911 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:22:14.596911 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:22:14.596911 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:22:14.596911 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:22:14.596911 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:22:14.597795 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:22:14.597795 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:22:14.597795 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:22:14.597795 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:22:14.597795 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:22:14.597795 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:22:14.597795 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:22:14.597795 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:22:14.597795 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:22:14.597795 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:22:14.597795 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:22:14.597795 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:22:14.597795 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:22:14.597795 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:22:14.597795 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:22:14.597795 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:22:14.598533 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:22:14.598533 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:22:14.598533 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:22:14.598533 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:22:14.598533 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:22:14.598533 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:22:14.598533 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:22:14.598533 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:22:14.598533 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:22:14.598533 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:22:14.598533 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:22:14.598533 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:22:14.598533 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 36/70] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 10:22:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:22:14.599494 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a243f74-9e81-4562-accf-b309b7eecc63 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:14.599792 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a243f74-9e81-4562-accf-b309b7eecc63 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:14.600076 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a243f74-9e81-4562-accf-b309b7eecc63 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:14.601522 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 37/71] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:22:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:22:14.602165 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a243f74-9e81-4562-accf-b309b7eecc63 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:14.609740 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6225081-c995-439a-a1aa-25f4de0fdc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:14.610554 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6225081-c995-439a-a1aa-25f4de0fdc93 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:14.610836 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6225081-c995-439a-a1aa-25f4de0fdc93 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:14.611111 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6225081-c995-439a-a1aa-25f4de0fdc93 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:14.622111 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6225081-c995-439a-a1aa-25f4de0fdc93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:22:14.631110 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-a6225081-c995-439a-a1aa-25f4de0fdc93 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 10:22:14.631110 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:22:14.631110 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:22:14.631110 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:22:14.631110 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:22:14.631110 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:22:14.631110 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:22:14.631110 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:22:14.631110 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:22:14.631110 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:22:14.631110 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:22:14.631110 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:22:14.631110 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:22:14.631110 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:22:14.631110 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:22:14.631110 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:22:14.631937 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:22:14.631937 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:22:14.631937 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:22:14.631937 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:22:14.631937 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:22:14.631937 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:22:14.631937 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:22:14.631937 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:22:14.631937 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:22:14.631937 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:22:14.631937 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:22:14.631937 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:22:14.631937 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:22:14.631937 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:22:14.631937 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:22:14.631937 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:22:14.632689 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:22:14.632689 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:22:14.632689 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:22:14.632689 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:22:14.632689 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:22:14.632689 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:22:14.632689 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:22:14.632689 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:22:14.632689 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:22:14.632689 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:22:14.632689 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 10:22:14.632689 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:22:14.632689 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 35/72] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Jul 18 10:22:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:22:14.633668 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac3106-d326-4cbd-aa02-e8b0e4a930c3 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:14.633853 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac3106-d326-4cbd-aa02-e8b0e4a930c3 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:14.634131 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac3106-d326-4cbd-aa02-e8b0e4a930c3 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:14.635311 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 36/73] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:22:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:22:14.636724 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac3106-d326-4cbd-aa02-e8b0e4a930c3 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:14.693918 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:14.709537 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a243f74-9e81-4562-accf-b309b7eecc63 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:14.741326 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac3106-d326-4cbd-aa02-e8b0e4a930c3 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:14.744167 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd370196-d9c4-4a5f-bd9d-2aad54d14f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:14.745062 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd370196-d9c4-4a5f-bd9d-2aad54d14f87 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:14.745348 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd370196-d9c4-4a5f-bd9d-2aad54d14f87 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:14.745617 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd370196-d9c4-4a5f-bd9d-2aad54d14f87 None admin] PATH_INFO: `/v3/users/7a03ae73926e423685124aabba9f801a` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:14.759173 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd370196-d9c4-4a5f-bd9d-2aad54d14f87 None admin] RBAC: Authorizing `identity:get_user(user_id=7a03ae73926e423685124aabba9f801a)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:14.760622 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd370196-d9c4-4a5f-bd9d-2aad54d14f87 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:14.762318 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 38/74] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 10:22:14 2022] GET /identity/v3/users/7a03ae73926e423685124aabba9f801a => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:14.764879 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:14.766615 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f76d96-6682-4acd-ba62-8a21b9251d7c None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:14.767064 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f76d96-6682-4acd-ba62-8a21b9251d7c None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:14.767352 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f76d96-6682-4acd-ba62-8a21b9251d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:14.776074 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7347b954-76c0-4e38-886f-3b1a1a4fbd41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:14.779332 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347b954-76c0-4e38-886f-3b1a1a4fbd41 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:14.779332 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347b954-76c0-4e38-886f-3b1a1a4fbd41 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:14.779332 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347b954-76c0-4e38-886f-3b1a1a4fbd41 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:14.779332 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7347b954-76c0-4e38-886f-3b1a1a4fbd41 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:14.779332 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7347b954-76c0-4e38-886f-3b1a1a4fbd41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:14.779836 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7347b954-76c0-4e38-886f-3b1a1a4fbd41 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:14.784301 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-56f76d96-6682-4acd-ba62-8a21b9251d7c None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:22:14.785655 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-56f76d96-6682-4acd-ba62-8a21b9251d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:22:14.788886 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 37/75] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 10:22:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:14.789719 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7347b954-76c0-4e38-886f-3b1a1a4fbd41 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:14.855940 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 39/76] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:22:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:22:14.857274 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9e34e-02d2-4c71-a2f3-2a90ebadb02c None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:14.857567 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9e34e-02d2-4c71-a2f3-2a90ebadb02c None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:14.857848 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb9e34e-02d2-4c71-a2f3-2a90ebadb02c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:14.877088 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-ebb9e34e-02d2-4c71-a2f3-2a90ebadb02c None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:22:14.879830 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-ebb9e34e-02d2-4c71-a2f3-2a90ebadb02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:22:14.897846 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7347b954-76c0-4e38-886f-3b1a1a4fbd41 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:14.930946 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af5fcb9-35b9-42e7-a0ff-8f0c6c5ffd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:14.931826 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5fcb9-35b9-42e7-a0ff-8f0c6c5ffd5a None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:14.932115 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5fcb9-35b9-42e7-a0ff-8f0c6c5ffd5a None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:14.932399 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5fcb9-35b9-42e7-a0ff-8f0c6c5ffd5a None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:14.933276 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af5fcb9-35b9-42e7-a0ff-8f0c6c5ffd5a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:14.933588 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af5fcb9-35b9-42e7-a0ff-8f0c6c5ffd5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:14.934987 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af5fcb9-35b9-42e7-a0ff-8f0c6c5ffd5a None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:14.943474 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 38/77] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 10:22:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:14.944320 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af5fcb9-35b9-42e7-a0ff-8f0c6c5ffd5a None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:14.949224 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 40/78] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:22:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:22:14.950070 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb9e34e-02d2-4c71-a2f3-2a90ebadb02c None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:14.958346 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:14.996986 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:15.048969 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af5fcb9-35b9-42e7-a0ff-8f0c6c5ffd5a None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:15.053140 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb9e34e-02d2-4c71-a2f3-2a90ebadb02c None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:15.083492 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9421bc6b-e71a-476b-8ba4-d550e05231ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:15.084149 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9421bc6b-e71a-476b-8ba4-d550e05231ad None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:15.084429 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9421bc6b-e71a-476b-8ba4-d550e05231ad None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:15.084704 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9421bc6b-e71a-476b-8ba4-d550e05231ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:15.091695 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f0192-e932-4ab8-a0da-4af15112dbef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:15.092586 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f0192-e932-4ab8-a0da-4af15112dbef None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:15.092879 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f0192-e932-4ab8-a0da-4af15112dbef None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:15.093191 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f0192-e932-4ab8-a0da-4af15112dbef None admin] PATH_INFO: `/v3/users/0a2289135265475ab7faec00c36046b3` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:15.094400 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f0192-e932-4ab8-a0da-4af15112dbef None admin] RBAC: Authorizing `identity:get_user(user_id=0a2289135265475ab7faec00c36046b3)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:15.095871 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f0192-e932-4ab8-a0da-4af15112dbef None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:15.098411 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 41/79] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 10:22:14 2022] GET /identity/v3/users/0a2289135265475ab7faec00c36046b3 => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:15.099784 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f0192-e932-4ab8-a0da-4af15112dbef None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:15.156735 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9421bc6b-e71a-476b-8ba4-d550e05231ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:15.158265 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9421bc6b-e71a-476b-8ba4-d550e05231ad None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:15.172721 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:15.201885 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f0192-e932-4ab8-a0da-4af15112dbef None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:15.206578 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:15.235167 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10756c9-a740-4702-83e7-874629509fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:15.236040 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10756c9-a740-4702-83e7-874629509fc0 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:15.236327 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10756c9-a740-4702-83e7-874629509fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:15.236600 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10756c9-a740-4702-83e7-874629509fc0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:15.247505 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10756c9-a740-4702-83e7-874629509fc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:22:15.255866 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-c10756c9-a740-4702-83e7-874629509fc0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:22:15.255866 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:22:15.255866 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:22:15.255866 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:22:15.255866 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:22:15.255866 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:22:15.255866 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:22:15.255866 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:22:15.255866 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:22:15.255866 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:22:15.255866 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:22:15.255866 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:22:15.255866 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:22:15.255866 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:22:15.255866 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:22:15.255866 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:22:15.256732 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:22:15.256732 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:22:15.256732 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:22:15.256732 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:22:15.256732 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:22:15.256732 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:22:15.256732 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:22:15.256732 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:22:15.256732 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:22:15.256732 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:22:15.256732 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:22:15.256732 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:22:15.256732 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:22:15.256732 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:22:15.256732 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:22:15.256732 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:22:15.257528 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:22:15.257528 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:22:15.257528 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:22:15.257528 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:22:15.257528 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:22:15.257528 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:22:15.257528 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:22:15.257528 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:22:15.257528 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:22:15.257528 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:22:15.257528 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:22:15.257528 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:22:15.257528 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 42/80] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 10:22:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:22:15.258149 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10756c9-a740-4702-83e7-874629509fc0 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:15.263882 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 39/81] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 10:22:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:22:15.263882 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9421bc6b-e71a-476b-8ba4-d550e05231ad None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:15.358845 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9421bc6b-e71a-476b-8ba4-d550e05231ad None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:15.361209 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10756c9-a740-4702-83e7-874629509fc0 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:15.390512 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:15.391051 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7686d83-fe83-4b3b-a0ad-89050d400349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:15.391841 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7686d83-fe83-4b3b-a0ad-89050d400349 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:15.392124 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7686d83-fe83-4b3b-a0ad-89050d400349 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:15.392403 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7686d83-fe83-4b3b-a0ad-89050d400349 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:15.394068 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7686d83-fe83-4b3b-a0ad-89050d400349 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:15.395506 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7686d83-fe83-4b3b-a0ad-89050d400349 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:15.395986 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c631c95d-5cfa-4a73-be0d-68f318ed3acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:15.396864 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c631c95d-5cfa-4a73-be0d-68f318ed3acd None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:15.397127 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 40/82] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:22:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:15.397213 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c631c95d-5cfa-4a73-be0d-68f318ed3acd None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:15.397604 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c631c95d-5cfa-4a73-be0d-68f318ed3acd None admin] PATH_INFO: `/v3/users/7a03ae73926e423685124aabba9f801a` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:15.398834 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c631c95d-5cfa-4a73-be0d-68f318ed3acd None admin] RBAC: Authorizing `identity:get_user(user_id=7a03ae73926e423685124aabba9f801a)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:15.400291 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c631c95d-5cfa-4a73-be0d-68f318ed3acd None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:15.402941 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 43/83] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 10:22:15 2022] GET /identity/v3/users/7a03ae73926e423685124aabba9f801a => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:15.403267 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7686d83-fe83-4b3b-a0ad-89050d400349 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:15.403358 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c631c95d-5cfa-4a73-be0d-68f318ed3acd None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:15.423708 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:15.508090 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7686d83-fe83-4b3b-a0ad-89050d400349 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:15.508573 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c631c95d-5cfa-4a73-be0d-68f318ed3acd None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:15.541685 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3c9885-5e39-4746-81b3-a070c3d755a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:15.541856 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da67417-7493-4544-a5ab-df22a1973239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:15.542339 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c9885-5e39-4746-81b3-a070c3d755a7 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:15.542507 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da67417-7493-4544-a5ab-df22a1973239 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:15.542626 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c9885-5e39-4746-81b3-a070c3d755a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:15.542799 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da67417-7493-4544-a5ab-df22a1973239 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:15.542906 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c9885-5e39-4746-81b3-a070c3d755a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:15.543080 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da67417-7493-4544-a5ab-df22a1973239 None admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:15.543843 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da67417-7493-4544-a5ab-df22a1973239 None admin] RBAC: Adding query filter params (name=member) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:15.544156 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da67417-7493-4544-a5ab-df22a1973239 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:15.545590 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da67417-7493-4544-a5ab-df22a1973239 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:15.553888 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 44/84] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jul 18 10:22:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:15.554680 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da67417-7493-4544-a5ab-df22a1973239 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:15.610511 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3c9885-5e39-4746-81b3-a070c3d755a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:15.612527 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3c9885-5e39-4746-81b3-a070c3d755a7 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:15.616542 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:15.628992 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:15.654306 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da67417-7493-4544-a5ab-df22a1973239 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:15.689062 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba333f-082c-4b42-81ab-269a97a18e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:15.689973 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba333f-082c-4b42-81ab-269a97a18e1a None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:15.690265 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba333f-082c-4b42-81ab-269a97a18e1a None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:15.690655 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba333f-082c-4b42-81ab-269a97a18e1a None admin] PATH_INFO: `/v3/projects/e3ce0a1d0d104f4ba20f8d0b63301a51` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:15.691857 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ba333f-082c-4b42-81ab-269a97a18e1a None admin] RBAC: Authorizing `identity:get_project(project_id=e3ce0a1d0d104f4ba20f8d0b63301a51)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:15.693341 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ba333f-082c-4b42-81ab-269a97a18e1a None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:15.695054 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 45/85] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 10:22:15 2022] GET /identity/v3/projects/e3ce0a1d0d104f4ba20f8d0b63301a51 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:15.695796 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba333f-082c-4b42-81ab-269a97a18e1a None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:15.710784 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 41/86] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 10:22:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:22:15.711624 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3c9885-5e39-4746-81b3-a070c3d755a7 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:15.798755 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba333f-082c-4b42-81ab-269a97a18e1a None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:15.810403 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3c9885-5e39-4746-81b3-a070c3d755a7 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:15.826497 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:15.827456 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:15.832489 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b349b25-0dbe-4161-b2b8-9765d13fa5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:15.833199 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b349b25-0dbe-4161-b2b8-9765d13fa5ee None admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:15.833491 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b349b25-0dbe-4161-b2b8-9765d13fa5ee None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:15.833768 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b349b25-0dbe-4161-b2b8-9765d13fa5ee None admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:15.834530 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b349b25-0dbe-4161-b2b8-9765d13fa5ee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:15.836009 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b349b25-0dbe-4161-b2b8-9765d13fa5ee None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:15.845396 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0976ef7-4aca-48e6-bbaf-6c887047bddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:15.846062 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0976ef7-4aca-48e6-bbaf-6c887047bddf None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:15.846351 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0976ef7-4aca-48e6-bbaf-6c887047bddf None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:15.846625 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0976ef7-4aca-48e6-bbaf-6c887047bddf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:15.913152 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0976ef7-4aca-48e6-bbaf-6c887047bddf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:15.914822 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0976ef7-4aca-48e6-bbaf-6c887047bddf None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:15.916669 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 46/87] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Jul 18 10:22:15 2022] POST /identity/v3/users => generated 289 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:22:15.917461 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b349b25-0dbe-4161-b2b8-9765d13fa5ee None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:16.039223 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 42/88] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 10:22:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:22:16.039223 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0976ef7-4aca-48e6-bbaf-6c887047bddf None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:16.058912 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:16.062505 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b349b25-0dbe-4161-b2b8-9765d13fa5ee None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:16.114336 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919d15db-ee0f-4d14-b6c3-56d533651015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:16.114336 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d15db-ee0f-4d14-b6c3-56d533651015 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:16.114336 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d15db-ee0f-4d14-b6c3-56d533651015 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:16.114336 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d15db-ee0f-4d14-b6c3-56d533651015 None admin] PATH_INFO: `/v3/users/7a03ae73926e423685124aabba9f801a` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:16.114652 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919d15db-ee0f-4d14-b6c3-56d533651015 None admin] RBAC: Authorizing `identity:get_user(user_id=7a03ae73926e423685124aabba9f801a)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:16.116087 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919d15db-ee0f-4d14-b6c3-56d533651015 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:16.118216 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 47/89] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 10:22:15 2022] GET /identity/v3/users/7a03ae73926e423685124aabba9f801a => generated 275 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:16.123227 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919d15db-ee0f-4d14-b6c3-56d533651015 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:16.167091 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0976ef7-4aca-48e6-bbaf-6c887047bddf None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:16.194950 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:16.216247 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec3a80a-f871-476c-9269-e7e180d5734e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:16.217013 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec3a80a-f871-476c-9269-e7e180d5734e None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:16.217431 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec3a80a-f871-476c-9269-e7e180d5734e None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:16.217781 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec3a80a-f871-476c-9269-e7e180d5734e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:16.218793 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec3a80a-f871-476c-9269-e7e180d5734e None admin] RBAC: Adding query filter params (role.id=907cee10dffd48b2bec00719e425d3bd, scope.project.id=e3ce0a1d0d104f4ba20f8d0b63301a51, user.id=7a03ae73926e423685124aabba9f801a) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:16.219066 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec3a80a-f871-476c-9269-e7e180d5734e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:16.220529 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec3a80a-f871-476c-9269-e7e180d5734e None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:16.227907 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 43/90] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 10:22:16 2022] GET /identity/v3/role_assignments?user.id=7a03ae73926e423685124aabba9f801a&scope.project.id=e3ce0a1d0d104f4ba20f8d0b63301a51&role.id=907cee10dffd48b2bec00719e425d3bd => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:16.228765 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec3a80a-f871-476c-9269-e7e180d5734e None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:16.262125 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919d15db-ee0f-4d14-b6c3-56d533651015 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:16.309449 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f18f2-deaa-44d7-afb7-e2941c2b8ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:16.310258 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f18f2-deaa-44d7-afb7-e2941c2b8ae5 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:16.310547 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f18f2-deaa-44d7-afb7-e2941c2b8ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:16.310833 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f18f2-deaa-44d7-afb7-e2941c2b8ae5 None admin] PATH_INFO: `/v3/projects/e3ce0a1d0d104f4ba20f8d0b63301a51` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:16.312154 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050f18f2-deaa-44d7-afb7-e2941c2b8ae5 None admin] RBAC: Authorizing `identity:get_project(project_id=e3ce0a1d0d104f4ba20f8d0b63301a51)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:16.313659 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050f18f2-deaa-44d7-afb7-e2941c2b8ae5 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:16.316497 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 48/91] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 10:22:16 2022] GET /identity/v3/projects/e3ce0a1d0d104f4ba20f8d0b63301a51 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:16.321881 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f18f2-deaa-44d7-afb7-e2941c2b8ae5 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:16.345263 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:16.375037 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec3a80a-f871-476c-9269-e7e180d5734e None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:16.428629 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffe445b-0834-432b-bc4b-1775e4b4f9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:16.429894 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe445b-0834-432b-bc4b-1775e4b4f9f0 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:16.430499 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe445b-0834-432b-bc4b-1775e4b4f9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:16.430998 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe445b-0834-432b-bc4b-1775e4b4f9f0 None admin] PATH_INFO: `/v3/projects/e3ce0a1d0d104f4ba20f8d0b63301a51` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:16.432510 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffe445b-0834-432b-bc4b-1775e4b4f9f0 None admin] RBAC: Authorizing `identity:get_project(project_id=e3ce0a1d0d104f4ba20f8d0b63301a51)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:16.434317 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffe445b-0834-432b-bc4b-1775e4b4f9f0 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:16.436123 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 44/92] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 10:22:16 2022] GET /identity/v3/projects/e3ce0a1d0d104f4ba20f8d0b63301a51 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:16.436967 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffe445b-0834-432b-bc4b-1775e4b4f9f0 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:16.447778 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f18f2-deaa-44d7-afb7-e2941c2b8ae5 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:16.475306 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:16.506798 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fa24eb-78e0-4b6c-8a3b-94ead10552eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:16.507528 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa24eb-78e0-4b6c-8a3b-94ead10552eb None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:16.507824 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa24eb-78e0-4b6c-8a3b-94ead10552eb None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:16.508107 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa24eb-78e0-4b6c-8a3b-94ead10552eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:16.587536 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fa24eb-78e0-4b6c-8a3b-94ead10552eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:16.588990 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fa24eb-78e0-4b6c-8a3b-94ead10552eb None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:16.622470 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffe445b-0834-432b-bc4b-1775e4b4f9f0 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:16.659973 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd946c4-9e90-4f10-84f9-beaf27217c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:16.661033 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd946c4-9e90-4f10-84f9-beaf27217c7a None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:16.661547 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd946c4-9e90-4f10-84f9-beaf27217c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:16.662074 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd946c4-9e90-4f10-84f9-beaf27217c7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:16.663108 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd946c4-9e90-4f10-84f9-beaf27217c7a None admin] RBAC: Adding query filter params (role.id=e7b6a55ecf6c491487955aaefbf9c388, scope.project.id=e3ce0a1d0d104f4ba20f8d0b63301a51, user.id=0a2289135265475ab7faec00c36046b3) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:16.663640 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd946c4-9e90-4f10-84f9-beaf27217c7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:16.665304 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd946c4-9e90-4f10-84f9-beaf27217c7a None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:16.671639 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 45/93] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 10:22:16 2022] GET /identity/v3/role_assignments?user.id=0a2289135265475ab7faec00c36046b3&scope.project.id=e3ce0a1d0d104f4ba20f8d0b63301a51&role.id=e7b6a55ecf6c491487955aaefbf9c388 => generated 259 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:16.672744 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd946c4-9e90-4f10-84f9-beaf27217c7a None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:16.689617 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:16.762550 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 49/94] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 10:22:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:22:16.768696 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fa24eb-78e0-4b6c-8a3b-94ead10552eb None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:16.788943 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd946c4-9e90-4f10-84f9-beaf27217c7a None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:16.826403 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:16.826705 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a155b9e4-4446-49f0-b31d-d0200223514b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:16.827289 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155b9e4-4446-49f0-b31d-d0200223514b None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:16.827577 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155b9e4-4446-49f0-b31d-d0200223514b None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:16.827861 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155b9e4-4446-49f0-b31d-d0200223514b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:16.833071 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a155b9e4-4446-49f0-b31d-d0200223514b None admin] RBAC: Adding query filter params (role.id=45f8992b0f6941c7a64290b437d6bd5e, scope.project.id=e3ce0a1d0d104f4ba20f8d0b63301a51, user.id=7a03ae73926e423685124aabba9f801a) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:16.833071 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a155b9e4-4446-49f0-b31d-d0200223514b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:16.836136 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a155b9e4-4446-49f0-b31d-d0200223514b None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:16.852407 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 46/95] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 10:22:16 2022] GET /identity/v3/role_assignments?user.id=7a03ae73926e423685124aabba9f801a&scope.project.id=e3ce0a1d0d104f4ba20f8d0b63301a51&role.id=45f8992b0f6941c7a64290b437d6bd5e => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:16.952961 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fa24eb-78e0-4b6c-8a3b-94ead10552eb None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:17.003304 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f539dd36-216e-4ea4-a893-ed9224ae8a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:17.004379 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539dd36-216e-4ea4-a893-ed9224ae8a68 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:17.004668 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539dd36-216e-4ea4-a893-ed9224ae8a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:17.004950 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539dd36-216e-4ea4-a893-ed9224ae8a68 None admin] PATH_INFO: `/v3/projects/efc4b686c16b4313a09d322ff4eba6d0` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:17.006358 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f539dd36-216e-4ea4-a893-ed9224ae8a68 None admin] RBAC: Authorizing `identity:get_project(project_id=efc4b686c16b4313a09d322ff4eba6d0)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:17.007985 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f539dd36-216e-4ea4-a893-ed9224ae8a68 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:17.009821 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 50/96] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 10:22:16 2022] GET /identity/v3/projects/efc4b686c16b4313a09d322ff4eba6d0 => generated 312 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:17.016005 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a155b9e4-4446-49f0-b31d-d0200223514b None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:17.105132 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:17.128602 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a155b9e4-4446-49f0-b31d-d0200223514b None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:17.169609 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4febb3a1-1fb8-45b6-95bc-e256ff19a158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:17.170338 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4febb3a1-1fb8-45b6-95bc-e256ff19a158 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:17.170629 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4febb3a1-1fb8-45b6-95bc-e256ff19a158 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:17.170909 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4febb3a1-1fb8-45b6-95bc-e256ff19a158 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:17.171757 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4febb3a1-1fb8-45b6-95bc-e256ff19a158 None admin] RBAC: Adding query filter params (role.id=907cee10dffd48b2bec00719e425d3bd, scope.project.id=efc4b686c16b4313a09d322ff4eba6d0, user.id=7a03ae73926e423685124aabba9f801a) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:17.172076 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4febb3a1-1fb8-45b6-95bc-e256ff19a158 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:17.173576 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4febb3a1-1fb8-45b6-95bc-e256ff19a158 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:17.180144 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 47/97] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 10:22:17 2022] GET /identity/v3/role_assignments?user.id=7a03ae73926e423685124aabba9f801a&scope.project.id=efc4b686c16b4313a09d322ff4eba6d0&role.id=907cee10dffd48b2bec00719e425d3bd => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:19.063734 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f2c91f-49b9-4a18-8b9a-19dbf390878b None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:19.064237 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f2c91f-49b9-4a18-8b9a-19dbf390878b None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:19.064308 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f2c91f-49b9-4a18-8b9a-19dbf390878b None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:19.066456 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 51/98] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:22:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:22:19.071961 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288550c-4f8f-49a9-b92f-92fe5d845128 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:19.072480 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288550c-4f8f-49a9-b92f-92fe5d845128 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:19.072567 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288550c-4f8f-49a9-b92f-92fe5d845128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:19.098361 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-0288550c-4f8f-49a9-b92f-92fe5d845128 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:22:19.101556 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-0288550c-4f8f-49a9-b92f-92fe5d845128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:22:19.152254 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d20efd-32b4-4cf2-9516-e28d270fb0eb None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:19.152553 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d20efd-32b4-4cf2-9516-e28d270fb0eb None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:19.152817 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d20efd-32b4-4cf2-9516-e28d270fb0eb None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:19.154213 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 52/99] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:22:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:22:19.159976 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b9090-4c58-47e7-aacb-c677881820a4 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:19.160291 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b9090-4c58-47e7-aacb-c677881820a4 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:19.160579 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b9090-4c58-47e7-aacb-c677881820a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:19.189134 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-3f9b9090-4c58-47e7-aacb-c677881820a4 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:22:19.191765 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-3f9b9090-4c58-47e7-aacb-c677881820a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:22:19.203426 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 48/100] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:22:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:22:19.205035 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb32fd5-918c-476d-9616-d7030d2b726e None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:19.205575 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb32fd5-918c-476d-9616-d7030d2b726e None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:19.206045 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb32fd5-918c-476d-9616-d7030d2b726e None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:19.207745 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 49/101] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:22:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:22:19.213170 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2da003-989f-4d0c-95d7-bff8837f4aa3 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:19.213699 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2da003-989f-4d0c-95d7-bff8837f4aa3 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:19.214303 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2da003-989f-4d0c-95d7-bff8837f4aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:19.245530 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-0c2da003-989f-4d0c-95d7-bff8837f4aa3 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:22:19.246722 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-0c2da003-989f-4d0c-95d7-bff8837f4aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:22:19.281511 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 53/102] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:22:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 10:22:19.283190 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b9090-4c58-47e7-aacb-c677881820a4 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:19.324963 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:19.384898 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:19.393868 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 50/103] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:22:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 10:22:19.394137 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2da003-989f-4d0c-95d7-bff8837f4aa3 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:19.456266 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b9090-4c58-47e7-aacb-c677881820a4 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:19.530005 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a010968-2a04-4168-979e-1b6439a33d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:19.530813 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a010968-2a04-4168-979e-1b6439a33d39 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:19.531096 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a010968-2a04-4168-979e-1b6439a33d39 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:19.531373 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a010968-2a04-4168-979e-1b6439a33d39 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:19.549460 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a010968-2a04-4168-979e-1b6439a33d39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:22:19.557069 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-0a010968-2a04-4168-979e-1b6439a33d39 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:22:19.557069 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:22:19.557069 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:22:19.557069 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:22:19.557069 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:22:19.557069 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:22:19.557069 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:22:19.557069 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:22:19.557069 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:22:19.557069 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:22:19.557069 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:22:19.557069 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:22:19.557069 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:22:19.557069 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:22:19.557069 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:22:19.557069 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:22:19.558016 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:22:19.558016 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:22:19.558016 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:22:19.558016 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:22:19.558016 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:22:19.558016 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:22:19.558016 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:22:19.558016 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:22:19.558016 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:22:19.558016 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:22:19.558016 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:22:19.558016 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:22:19.558016 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:22:19.558016 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:22:19.558016 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:22:19.558016 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:22:19.559240 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:22:19.559240 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:22:19.559240 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:22:19.559240 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:22:19.559240 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:22:19.559240 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:22:19.559240 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:22:19.559240 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:22:19.559240 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:22:19.559240 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:22:19.559240 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:22:19.559240 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:22:19.559240 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 54/104] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 10:22:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:22:19.559240 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a010968-2a04-4168-979e-1b6439a33d39 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:19.563580 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2da003-989f-4d0c-95d7-bff8837f4aa3 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:19.656354 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:19.657846 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a49d3-ce80-4f48-b1ba-7144a9ae26fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:19.659239 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a49d3-ce80-4f48-b1ba-7144a9ae26fc None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:19.659239 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a49d3-ce80-4f48-b1ba-7144a9ae26fc None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:19.659490 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a49d3-ce80-4f48-b1ba-7144a9ae26fc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:19.677212 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a010968-2a04-4168-979e-1b6439a33d39 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:19.682731 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a49d3-ce80-4f48-b1ba-7144a9ae26fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:22:19.691675 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-2a6a49d3-ce80-4f48-b1ba-7144a9ae26fc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 10:22:19.691675 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:22:19.691675 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:22:19.691675 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:22:19.691675 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:22:19.691675 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:22:19.691675 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:22:19.691675 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:22:19.691675 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:22:19.691675 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:22:19.691675 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:22:19.691675 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:22:19.691675 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:22:19.691675 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:22:19.691675 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:22:19.691675 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:22:19.692582 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:22:19.692582 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:22:19.692582 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:22:19.692582 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:22:19.692582 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:22:19.692582 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:22:19.692582 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:22:19.692582 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:22:19.692582 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:22:19.692582 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:22:19.692582 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:22:19.692582 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:22:19.692582 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:22:19.692582 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:22:19.692582 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:22:19.692582 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:22:19.693556 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:22:19.693556 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:22:19.693556 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:22:19.693556 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:22:19.693556 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:22:19.693556 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:22:19.693556 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:22:19.693556 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:22:19.693556 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:22:19.693556 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:22:19.693556 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 10:22:19.693556 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:22:19.693556 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 51/105] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 10:22:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:22:19.694574 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a49d3-ce80-4f48-b1ba-7144a9ae26fc None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:19.762249 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:19.770463 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f469e15-da8d-412d-b598-937798d13f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:19.771306 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f469e15-da8d-412d-b598-937798d13f3f None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:19.771612 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f469e15-da8d-412d-b598-937798d13f3f None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:19.771903 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f469e15-da8d-412d-b598-937798d13f3f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:19.777835 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f469e15-da8d-412d-b598-937798d13f3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:19.779406 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f469e15-da8d-412d-b598-937798d13f3f None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:19.781285 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 55/106] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:22:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:19.781970 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f469e15-da8d-412d-b598-937798d13f3f None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:19.836824 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a49d3-ce80-4f48-b1ba-7144a9ae26fc None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:19.885676 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91470f3b-e12c-4866-9069-81a9bd4527d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:19.886398 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91470f3b-e12c-4866-9069-81a9bd4527d3 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:19.886682 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91470f3b-e12c-4866-9069-81a9bd4527d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:19.886966 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91470f3b-e12c-4866-9069-81a9bd4527d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:19.887734 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91470f3b-e12c-4866-9069-81a9bd4527d3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:19.888193 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91470f3b-e12c-4866-9069-81a9bd4527d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:19.889913 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91470f3b-e12c-4866-9069-81a9bd4527d3 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:19.900002 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 52/107] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jul 18 10:22:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:19.901111 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91470f3b-e12c-4866-9069-81a9bd4527d3 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:19.959397 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f469e15-da8d-412d-b598-937798d13f3f None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:19.996399 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88231872-c760-433b-8674-af91d5aced29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:19.997111 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88231872-c760-433b-8674-af91d5aced29 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:19.997403 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88231872-c760-433b-8674-af91d5aced29 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:19.997683 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88231872-c760-433b-8674-af91d5aced29 None admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:19.998439 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88231872-c760-433b-8674-af91d5aced29 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:19.998747 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88231872-c760-433b-8674-af91d5aced29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:20.000135 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88231872-c760-433b-8674-af91d5aced29 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:20.008663 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91470f3b-e12c-4866-9069-81a9bd4527d3 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:20.009691 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 56/108] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jul 18 10:22:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:20.014317 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f2ffe-493f-47be-bdf0-f17657e26e43 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:20.014317 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f2ffe-493f-47be-bdf0-f17657e26e43 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:20.014317 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f2ffe-493f-47be-bdf0-f17657e26e43 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:20.014317 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 57/109] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:22:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:22:20.014317 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26f2ffe-493f-47be-bdf0-f17657e26e43 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:20.027368 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:20.041858 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:20.053538 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8794d890-c450-482d-b5fd-a95163759ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:20.054211 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794d890-c450-482d-b5fd-a95163759ee7 None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:20.056153 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794d890-c450-482d-b5fd-a95163759ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:20.056153 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8794d890-c450-482d-b5fd-a95163759ee7 None admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:20.056153 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8794d890-c450-482d-b5fd-a95163759ee7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:20.056873 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8794d890-c450-482d-b5fd-a95163759ee7 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:20.121082 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26f2ffe-493f-47be-bdf0-f17657e26e43 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:20.123703 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 53/110] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Jul 18 10:22:19 2022] POST /identity/v3/projects => generated 302 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:22:20.125051 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f124ca-e84f-49f2-a592-f98ed3c58eb7 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:20.125360 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f124ca-e84f-49f2-a592-f98ed3c58eb7 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:20.125642 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f124ca-e84f-49f2-a592-f98ed3c58eb7 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:20.126912 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 54/111] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:22:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:22:20.132449 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f124ca-e84f-49f2-a592-f98ed3c58eb7 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:20.171300 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27ce028-8c67-46c4-9c84-927f3f354545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:20.172223 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ce028-8c67-46c4-9c84-927f3f354545 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:20.172543 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ce028-8c67-46c4-9c84-927f3f354545 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:20.172798 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ce028-8c67-46c4-9c84-927f3f354545 None admin] PATH_INFO: `/v3/users/7a03ae73926e423685124aabba9f801a` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:20.174184 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27ce028-8c67-46c4-9c84-927f3f354545 None admin] RBAC: Authorizing `identity:get_user(user_id=7a03ae73926e423685124aabba9f801a)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:20.175894 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27ce028-8c67-46c4-9c84-927f3f354545 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:20.177721 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 58/112] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 10:22:20 2022] GET /identity/v3/users/7a03ae73926e423685124aabba9f801a => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:20.178954 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878dbcc7-c676-42b4-885b-9d9ef6bc9982 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:20.179248 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878dbcc7-c676-42b4-885b-9d9ef6bc9982 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:20.179531 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878dbcc7-c676-42b4-885b-9d9ef6bc9982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:20.197477 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-878dbcc7-c676-42b4-885b-9d9ef6bc9982 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:22:20.198734 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-878dbcc7-c676-42b4-885b-9d9ef6bc9982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:22:20.253440 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f124ca-e84f-49f2-a592-f98ed3c58eb7 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:20.273631 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 59/113] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:22:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:22:20.275173 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e523d-e1e4-4e0b-a0b2-ae4109b3dd85 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:20.275466 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e523d-e1e4-4e0b-a0b2-ae4109b3dd85 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:20.275752 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e523d-e1e4-4e0b-a0b2-ae4109b3dd85 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:20.277005 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 60/114] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:22:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:22:20.281004 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944b39b-15b6-4ffb-a668-3189ea73d402 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:20.281004 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944b39b-15b6-4ffb-a668-3189ea73d402 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:20.281004 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944b39b-15b6-4ffb-a668-3189ea73d402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:20.300906 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-a944b39b-15b6-4ffb-a668-3189ea73d402 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:22:20.302197 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-a944b39b-15b6-4ffb-a668-3189ea73d402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:22:20.304436 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:20.306829 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1b9bdb-f3d1-45c5-93bb-8f0b3fe53c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:20.307707 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b9bdb-f3d1-45c5-93bb-8f0b3fe53c5c None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:20.307991 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b9bdb-f3d1-45c5-93bb-8f0b3fe53c5c None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:20.308263 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b9bdb-f3d1-45c5-93bb-8f0b3fe53c5c None admin] PATH_INFO: `/v3/users/37122b3e7c2c4067bdad5ee4fd1de795` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:20.327257 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1b9bdb-f3d1-45c5-93bb-8f0b3fe53c5c None admin] RBAC: Authorizing `identity:get_user(user_id=37122b3e7c2c4067bdad5ee4fd1de795)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:20.329169 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1b9bdb-f3d1-45c5-93bb-8f0b3fe53c5c None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:20.331975 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 55/115] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 10:22:20 2022] GET /identity/v3/users/37122b3e7c2c4067bdad5ee4fd1de795 => generated 289 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:20.333239 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1b9bdb-f3d1-45c5-93bb-8f0b3fe53c5c None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:20.368957 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:20.386234 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 61/116] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:22:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:22:20.394322 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ee6ff-d058-473f-ab84-cbfb837ff7c1 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:20.395114 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ee6ff-d058-473f-ab84-cbfb837ff7c1 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:20.396276 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ee6ff-d058-473f-ab84-cbfb837ff7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:20.418877 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-1d9ee6ff-d058-473f-ab84-cbfb837ff7c1 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:22:20.420253 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-1d9ee6ff-d058-473f-ab84-cbfb837ff7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:22:20.442070 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1b9bdb-f3d1-45c5-93bb-8f0b3fe53c5c None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:20.478313 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730bc381-8b76-48cd-93c6-2cc4dc47ec29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:20.479186 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730bc381-8b76-48cd-93c6-2cc4dc47ec29 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:20.479474 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730bc381-8b76-48cd-93c6-2cc4dc47ec29 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:20.479754 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730bc381-8b76-48cd-93c6-2cc4dc47ec29 None admin] PATH_INFO: `/v3/projects/e3ce0a1d0d104f4ba20f8d0b63301a51` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:20.480962 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730bc381-8b76-48cd-93c6-2cc4dc47ec29 None admin] RBAC: Authorizing `identity:get_project(project_id=e3ce0a1d0d104f4ba20f8d0b63301a51)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:20.482438 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730bc381-8b76-48cd-93c6-2cc4dc47ec29 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:20.484168 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 56/117] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 10:22:20 2022] GET /identity/v3/projects/e3ce0a1d0d104f4ba20f8d0b63301a51 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:20.484932 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730bc381-8b76-48cd-93c6-2cc4dc47ec29 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:20.517142 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 62/118] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:22:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:22:20.517142 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9ee6ff-d058-473f-ab84-cbfb837ff7c1 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:20.579488 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:20.598564 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:20.601343 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730bc381-8b76-48cd-93c6-2cc4dc47ec29 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:20.617771 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9ee6ff-d058-473f-ab84-cbfb837ff7c1 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:20.637191 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e8233-59b8-47f0-ae73-d946666e365c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:20.638445 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e8233-59b8-47f0-ae73-d946666e365c None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:20.639880 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e8233-59b8-47f0-ae73-d946666e365c None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:20.639880 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e8233-59b8-47f0-ae73-d946666e365c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:20.650497 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35e8233-59b8-47f0-ae73-d946666e365c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:22:20.654843 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c8b5c0-9d63-4ace-9451-729465c3f67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:20.655503 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8b5c0-9d63-4ace-9451-729465c3f67d None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:20.655788 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8b5c0-9d63-4ace-9451-729465c3f67d None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:20.656065 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8b5c0-9d63-4ace-9451-729465c3f67d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:20.658247 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-c35e8233-59b8-47f0-ae73-d946666e365c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:22:20.658247 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:22:20.658247 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:22:20.658247 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:22:20.658247 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:22:20.658247 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:22:20.658247 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:22:20.658247 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:22:20.658247 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:22:20.658247 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:22:20.658247 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:22:20.658247 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:22:20.658247 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:22:20.658247 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:22:20.658247 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:22:20.658247 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:22:20.659965 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:22:20.659965 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:22:20.659965 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:22:20.659965 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:22:20.659965 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:22:20.659965 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:22:20.659965 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:22:20.659965 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:22:20.659965 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:22:20.659965 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:22:20.659965 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:22:20.659965 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:22:20.659965 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:22:20.659965 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:22:20.659965 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:22:20.659965 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:22:20.661543 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:22:20.661543 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:22:20.661543 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:22:20.661543 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:22:20.661543 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:22:20.661543 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:22:20.661543 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:22:20.661543 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:22:20.661543 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:22:20.661543 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:22:20.661543 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:22:20.661543 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:22:20.661543 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 57/119] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 10:22:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:22:20.661543 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e8233-59b8-47f0-ae73-d946666e365c None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:20.734927 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c8b5c0-9d63-4ace-9451-729465c3f67d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:20.736418 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c8b5c0-9d63-4ace-9451-729465c3f67d None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:20.771635 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e8233-59b8-47f0-ae73-d946666e365c None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:20.806440 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:20.806613 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690c9b40-0fad-4798-9810-5524c9647835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:20.807489 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c9b40-0fad-4798-9810-5524c9647835 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:20.807814 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c9b40-0fad-4798-9810-5524c9647835 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:20.808098 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c9b40-0fad-4798-9810-5524c9647835 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:20.819652 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690c9b40-0fad-4798-9810-5524c9647835 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:22:20.827358 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-690c9b40-0fad-4798-9810-5524c9647835 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:22:20.827358 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:22:20.827358 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:22:20.827358 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:22:20.827358 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:22:20.827358 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:22:20.827358 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:22:20.827358 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:22:20.827358 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:22:20.827358 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:22:20.827358 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:22:20.827358 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:22:20.827358 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:22:20.827358 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:22:20.827358 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:22:20.827358 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:22:20.828290 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:22:20.828290 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:22:20.828290 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:22:20.828290 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:22:20.828290 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:22:20.828290 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:22:20.828290 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:22:20.828290 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:22:20.828290 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:22:20.828290 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:22:20.828290 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:22:20.828290 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:22:20.828290 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:22:20.828290 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:22:20.828290 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:22:20.828290 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:22:20.829074 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:22:20.829074 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:22:20.829074 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:22:20.829074 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:22:20.829074 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:22:20.829074 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:22:20.829074 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:22:20.829074 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:22:20.829074 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:22:20.829074 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:22:20.829074 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:22:20.829074 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:22:20.829074 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 58/120] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 10:22:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:22:20.834084 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690c9b40-0fad-4798-9810-5524c9647835 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:20.850977 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 63/121] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 10:22:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:22:20.850977 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c8b5c0-9d63-4ace-9451-729465c3f67d None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:20.857011 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:20.938458 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690c9b40-0fad-4798-9810-5524c9647835 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:20.958375 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c8b5c0-9d63-4ace-9451-729465c3f67d None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:20.974318 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa04f7f-8233-4771-9494-8dfdd0f293f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:20.975234 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa04f7f-8233-4771-9494-8dfdd0f293f4 None admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:20.975527 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa04f7f-8233-4771-9494-8dfdd0f293f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:20.975782 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa04f7f-8233-4771-9494-8dfdd0f293f4 None admin] PATH_INFO: `/v3/projects/e3ce0a1d0d104f4ba20f8d0b63301a51/users/7a03ae73926e423685124aabba9f801a/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:20.977811 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa04f7f-8233-4771-9494-8dfdd0f293f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=e3ce0a1d0d104f4ba20f8d0b63301a51, user_id=7a03ae73926e423685124aabba9f801a, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:20.979414 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa04f7f-8233-4771-9494-8dfdd0f293f4 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:20.996001 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed76e076-6e0f-4fdf-a910-2115add815a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:20.996806 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76e076-6e0f-4fdf-a910-2115add815a9 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:20.997117 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76e076-6e0f-4fdf-a910-2115add815a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:20.997395 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed76e076-6e0f-4fdf-a910-2115add815a9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:21.007246 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed76e076-6e0f-4fdf-a910-2115add815a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:22:21.015253 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-ed76e076-6e0f-4fdf-a910-2115add815a9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 10:22:21.015253 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:22:21.015253 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:22:21.015253 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:22:21.015253 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:22:21.015253 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:22:21.015253 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:22:21.015253 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:22:21.015253 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:22:21.015253 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:22:21.015253 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:22:21.015253 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:22:21.015253 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:22:21.015253 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:22:21.015253 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:22:21.015253 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:22:21.016100 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:22:21.016100 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:22:21.016100 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:22:21.016100 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:22:21.016100 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:22:21.016100 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:22:21.016100 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:22:21.016100 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:22:21.016100 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:22:21.016100 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:22:21.016100 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:22:21.016100 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:22:21.016100 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:22:21.016100 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:22:21.016100 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:22:21.016100 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:22:21.016864 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:22:21.016864 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:22:21.016864 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:22:21.016864 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:22:21.016864 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:22:21.016864 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:22:21.016864 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:22:21.016864 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:22:21.016864 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:22:21.016864 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:22:21.016864 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 10:22:21.016864 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:22:21.016864 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 64/122] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Jul 18 10:22:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:22:21.017507 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed76e076-6e0f-4fdf-a910-2115add815a9 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:21.048690 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:21.073653 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 59/123] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jul 18 10:22:20 2022] PUT /identity/v3/projects/e3ce0a1d0d104f4ba20f8d0b63301a51/users/7a03ae73926e423685124aabba9f801a/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:22:21.074340 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa04f7f-8233-4771-9494-8dfdd0f293f4 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:21.162256 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed76e076-6e0f-4fdf-a910-2115add815a9 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:21.188406 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:21.204314 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f823901a-384c-45f2-ae3a-d6099039eb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:21.205729 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823901a-384c-45f2-ae3a-d6099039eb90 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:21.206085 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823901a-384c-45f2-ae3a-d6099039eb90 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:21.206437 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823901a-384c-45f2-ae3a-d6099039eb90 None admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:21.207284 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f823901a-384c-45f2-ae3a-d6099039eb90 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:21.207666 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f823901a-384c-45f2-ae3a-d6099039eb90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:21.209279 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f823901a-384c-45f2-ae3a-d6099039eb90 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:21.214301 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa04f7f-8233-4771-9494-8dfdd0f293f4 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:21.219159 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 65/124] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 10:22:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:21.220217 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f823901a-384c-45f2-ae3a-d6099039eb90 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:21.264608 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379cdfae-57df-4474-a3ad-cee614849b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:21.265353 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379cdfae-57df-4474-a3ad-cee614849b39 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:21.265666 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379cdfae-57df-4474-a3ad-cee614849b39 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:21.265923 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379cdfae-57df-4474-a3ad-cee614849b39 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:21.266692 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379cdfae-57df-4474-a3ad-cee614849b39 None admin] RBAC: Adding query filter params (name=member) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:21.267000 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379cdfae-57df-4474-a3ad-cee614849b39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:21.269936 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379cdfae-57df-4474-a3ad-cee614849b39 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:21.284384 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 60/125] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jul 18 10:22:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:21.285409 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379cdfae-57df-4474-a3ad-cee614849b39 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:21.342904 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:21.357386 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f823901a-384c-45f2-ae3a-d6099039eb90 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:21.404487 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379cdfae-57df-4474-a3ad-cee614849b39 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:21.405935 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1435077-e9c7-42e6-99a5-f84b54df8b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:21.408020 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1435077-e9c7-42e6-99a5-f84b54df8b9b None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:21.408495 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1435077-e9c7-42e6-99a5-f84b54df8b9b None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:21.409136 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1435077-e9c7-42e6-99a5-f84b54df8b9b None admin] PATH_INFO: `/v3/projects/e3ce0a1d0d104f4ba20f8d0b63301a51` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:21.410165 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1435077-e9c7-42e6-99a5-f84b54df8b9b None admin] RBAC: Authorizing `identity:get_project(project_id=e3ce0a1d0d104f4ba20f8d0b63301a51)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:21.411683 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1435077-e9c7-42e6-99a5-f84b54df8b9b None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:21.417197 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 66/126] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 10:22:21 2022] GET /identity/v3/projects/e3ce0a1d0d104f4ba20f8d0b63301a51 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:21.418216 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1435077-e9c7-42e6-99a5-f84b54df8b9b None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:21.459001 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4026dc69-7706-40ba-8ef3-affbed31b4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:21.459953 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026dc69-7706-40ba-8ef3-affbed31b4e1 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:21.460380 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026dc69-7706-40ba-8ef3-affbed31b4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:21.460800 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026dc69-7706-40ba-8ef3-affbed31b4e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:21.461718 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4026dc69-7706-40ba-8ef3-affbed31b4e1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:21.462168 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4026dc69-7706-40ba-8ef3-affbed31b4e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:21.463755 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4026dc69-7706-40ba-8ef3-affbed31b4e1 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:21.473637 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 61/127] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 10:22:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:21.474692 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4026dc69-7706-40ba-8ef3-affbed31b4e1 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:21.479629 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:21.563161 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1435077-e9c7-42e6-99a5-f84b54df8b9b None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:21.593481 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4026dc69-7706-40ba-8ef3-affbed31b4e1 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:21.606225 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c57910-f295-4d3e-9bcd-fba00947d2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:21.607527 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c57910-f295-4d3e-9bcd-fba00947d2ba None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:21.608012 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c57910-f295-4d3e-9bcd-fba00947d2ba None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:21.608488 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c57910-f295-4d3e-9bcd-fba00947d2ba None admin] PATH_INFO: `/v3/users/0a2289135265475ab7faec00c36046b3` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:21.609947 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c57910-f295-4d3e-9bcd-fba00947d2ba None admin] RBAC: Authorizing `identity:get_user(user_id=0a2289135265475ab7faec00c36046b3)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:21.612792 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c57910-f295-4d3e-9bcd-fba00947d2ba None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:21.614708 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 67/128] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 10:22:21 2022] GET /identity/v3/users/0a2289135265475ab7faec00c36046b3 => generated 247 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:21.615665 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c57910-f295-4d3e-9bcd-fba00947d2ba None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:21.636499 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e15cb4-897f-44a5-ac23-7b78ff5d9df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:21.637414 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e15cb4-897f-44a5-ac23-7b78ff5d9df0 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:21.637698 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e15cb4-897f-44a5-ac23-7b78ff5d9df0 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:21.637973 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e15cb4-897f-44a5-ac23-7b78ff5d9df0 None admin] PATH_INFO: `/v3/users/7a03ae73926e423685124aabba9f801a` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:21.639167 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e15cb4-897f-44a5-ac23-7b78ff5d9df0 None admin] RBAC: Authorizing `identity:get_user(user_id=7a03ae73926e423685124aabba9f801a)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:21.641450 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e15cb4-897f-44a5-ac23-7b78ff5d9df0 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:21.643671 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 62/129] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 10:22:21 2022] GET /identity/v3/users/7a03ae73926e423685124aabba9f801a => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:21.644880 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e15cb4-897f-44a5-ac23-7b78ff5d9df0 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:21.647247 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:21.730645 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c57910-f295-4d3e-9bcd-fba00947d2ba None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:21.745508 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:21.762262 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e15cb4-897f-44a5-ac23-7b78ff5d9df0 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:21.769601 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e563f-f71c-4be7-a739-4142d64aa8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:21.770373 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e563f-f71c-4be7-a739-4142d64aa8f1 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:21.770775 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e563f-f71c-4be7-a739-4142d64aa8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:21.771125 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e563f-f71c-4be7-a739-4142d64aa8f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:21.772088 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27e563f-f71c-4be7-a739-4142d64aa8f1 None admin] RBAC: Adding query filter params (role.id=c2ae722a355f4d73b11124bcf553fe8c, scope.project.id=e3ce0a1d0d104f4ba20f8d0b63301a51, user.id=37122b3e7c2c4067bdad5ee4fd1de795) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:21.772476 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27e563f-f71c-4be7-a739-4142d64aa8f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:21.774064 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27e563f-f71c-4be7-a739-4142d64aa8f1 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:21.785106 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 68/130] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 10:22:21 2022] GET /identity/v3/role_assignments?user.id=37122b3e7c2c4067bdad5ee4fd1de795&scope.project.id=e3ce0a1d0d104f4ba20f8d0b63301a51&role.id=c2ae722a355f4d73b11124bcf553fe8c => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:21.785106 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e563f-f71c-4be7-a739-4142d64aa8f1 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:21.829197 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a4ffe1-7d20-42ca-914b-802817becee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:21.830756 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4ffe1-7d20-42ca-914b-802817becee5 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:21.831591 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4ffe1-7d20-42ca-914b-802817becee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:21.832618 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4ffe1-7d20-42ca-914b-802817becee5 None admin] PATH_INFO: `/v3/users/7a03ae73926e423685124aabba9f801a` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:21.835466 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a4ffe1-7d20-42ca-914b-802817becee5 None admin] RBAC: Authorizing `identity:get_user(user_id=7a03ae73926e423685124aabba9f801a)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:21.842508 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a4ffe1-7d20-42ca-914b-802817becee5 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:21.844757 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 63/131] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 10:22:21 2022] GET /identity/v3/users/7a03ae73926e423685124aabba9f801a => generated 275 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:21.848140 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a4ffe1-7d20-42ca-914b-802817becee5 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:21.994285 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:22.006560 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a4ffe1-7d20-42ca-914b-802817becee5 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:22.010273 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e563f-f71c-4be7-a739-4142d64aa8f1 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:22.055488 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aded7a3-2276-4ff2-90e2-7294e2ee2e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:22.056613 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aded7a3-2276-4ff2-90e2-7294e2ee2e47 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:22.057065 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aded7a3-2276-4ff2-90e2-7294e2ee2e47 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:22.057988 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aded7a3-2276-4ff2-90e2-7294e2ee2e47 None admin] PATH_INFO: `/v3/projects/efc4b686c16b4313a09d322ff4eba6d0` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:22.059272 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c30892-a3bb-41c9-913a-79a40f511860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:22.060082 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aded7a3-2276-4ff2-90e2-7294e2ee2e47 None admin] RBAC: Authorizing `identity:get_project(project_id=efc4b686c16b4313a09d322ff4eba6d0)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:22.061111 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c30892-a3bb-41c9-913a-79a40f511860 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:22.062695 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aded7a3-2276-4ff2-90e2-7294e2ee2e47 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:22.063127 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c30892-a3bb-41c9-913a-79a40f511860 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:22.063652 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c30892-a3bb-41c9-913a-79a40f511860 None admin] PATH_INFO: `/v3/projects/e3ce0a1d0d104f4ba20f8d0b63301a51` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:22.066803 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c30892-a3bb-41c9-913a-79a40f511860 None admin] RBAC: Authorizing `identity:get_project(project_id=e3ce0a1d0d104f4ba20f8d0b63301a51)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:22.068460 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c30892-a3bb-41c9-913a-79a40f511860 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:22.069757 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 64/132] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 10:22:21 2022] GET /identity/v3/projects/efc4b686c16b4313a09d322ff4eba6d0 => generated 312 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:22.071590 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 69/133] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 10:22:21 2022] GET /identity/v3/projects/e3ce0a1d0d104f4ba20f8d0b63301a51 => generated 298 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:22.072513 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aded7a3-2276-4ff2-90e2-7294e2ee2e47 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:22.081323 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c30892-a3bb-41c9-913a-79a40f511860 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:22.090069 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:22.257202 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aded7a3-2276-4ff2-90e2-7294e2ee2e47 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:22.288453 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c30892-a3bb-41c9-913a-79a40f511860 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:22.311485 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a112f5a3-dbea-4d2e-bd37-b6348b538d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:22.312476 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112f5a3-dbea-4d2e-bd37-b6348b538d2c None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:22.312766 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112f5a3-dbea-4d2e-bd37-b6348b538d2c None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:22.313069 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112f5a3-dbea-4d2e-bd37-b6348b538d2c None admin] PATH_INFO: `/v3/projects/e3ce0a1d0d104f4ba20f8d0b63301a51` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:22.314314 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a112f5a3-dbea-4d2e-bd37-b6348b538d2c None admin] RBAC: Authorizing `identity:get_project(project_id=e3ce0a1d0d104f4ba20f8d0b63301a51)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:22.316547 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a112f5a3-dbea-4d2e-bd37-b6348b538d2c None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:22.323222 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 65/134] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 10:22:22 2022] GET /identity/v3/projects/e3ce0a1d0d104f4ba20f8d0b63301a51 => generated 298 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:22.324138 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a112f5a3-dbea-4d2e-bd37-b6348b538d2c None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:22.333027 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ae533-ad08-42c9-bcef-74f73e21fbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:22.334134 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ae533-ad08-42c9-bcef-74f73e21fbac None admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:22.335343 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ae533-ad08-42c9-bcef-74f73e21fbac None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:22.335747 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ae533-ad08-42c9-bcef-74f73e21fbac None admin] PATH_INFO: `/v3/projects/efc4b686c16b4313a09d322ff4eba6d0/users/7a03ae73926e423685124aabba9f801a/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:22.339082 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098ae533-ad08-42c9-bcef-74f73e21fbac None admin] RBAC: Authorizing `identity:create_grant(project_id=efc4b686c16b4313a09d322ff4eba6d0, user_id=7a03ae73926e423685124aabba9f801a, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:22.341070 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098ae533-ad08-42c9-bcef-74f73e21fbac None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:22.411310 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:22.434501 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a112f5a3-dbea-4d2e-bd37-b6348b538d2c None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:22.440335 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 70/135] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jul 18 10:22:22 2022] PUT /identity/v3/projects/efc4b686c16b4313a09d322ff4eba6d0/users/7a03ae73926e423685124aabba9f801a/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:22:22.440335 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad089395-8149-48fb-a0a5-e3dc973a5162 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:22.440335 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad089395-8149-48fb-a0a5-e3dc973a5162 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:22.440335 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad089395-8149-48fb-a0a5-e3dc973a5162 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:22.450938 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 71/136] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:22:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:22:22.451929 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad089395-8149-48fb-a0a5-e3dc973a5162 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:22.493718 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:22.514929 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0bef94-3ce5-4220-abc0-51901a0236b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:22.517275 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0bef94-3ce5-4220-abc0-51901a0236b4 None admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:22.518985 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0bef94-3ce5-4220-abc0-51901a0236b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:22.519441 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0bef94-3ce5-4220-abc0-51901a0236b4 None admin] PATH_INFO: `/v3/projects/e3ce0a1d0d104f4ba20f8d0b63301a51/users/0a2289135265475ab7faec00c36046b3/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:22.522595 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0bef94-3ce5-4220-abc0-51901a0236b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=e3ce0a1d0d104f4ba20f8d0b63301a51, user_id=0a2289135265475ab7faec00c36046b3, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:22.525108 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0bef94-3ce5-4220-abc0-51901a0236b4 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:22.603745 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 66/137] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jul 18 10:22:22 2022] PUT /identity/v3/projects/e3ce0a1d0d104f4ba20f8d0b63301a51/users/0a2289135265475ab7faec00c36046b3/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:22:22.605092 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055939c-771f-4f0c-a79b-bcb6ffd68214 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:22.605398 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055939c-771f-4f0c-a79b-bcb6ffd68214 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:22.605683 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055939c-771f-4f0c-a79b-bcb6ffd68214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:22.629210 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad089395-8149-48fb-a0a5-e3dc973a5162 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:22.641094 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-6055939c-771f-4f0c-a79b-bcb6ffd68214 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:22:22.641094 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-6055939c-771f-4f0c-a79b-bcb6ffd68214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:22:22.685503 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd9ad41-0d7a-45f9-9b63-11adfce406df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:22.686818 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9ad41-0d7a-45f9-9b63-11adfce406df None admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:22.687339 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9ad41-0d7a-45f9-9b63-11adfce406df None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:22.687817 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9ad41-0d7a-45f9-9b63-11adfce406df None admin] PATH_INFO: `/v3/projects/e3ce0a1d0d104f4ba20f8d0b63301a51/users/7a03ae73926e423685124aabba9f801a/roles/45f8992b0f6941c7a64290b437d6bd5e` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:22.692505 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd9ad41-0d7a-45f9-9b63-11adfce406df None admin] RBAC: Authorizing `identity:create_grant(project_id=e3ce0a1d0d104f4ba20f8d0b63301a51, user_id=7a03ae73926e423685124aabba9f801a, role_id=45f8992b0f6941c7a64290b437d6bd5e)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:22.694451 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd9ad41-0d7a-45f9-9b63-11adfce406df None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:22.744378 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 67/138] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:22:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:22:22.770754 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6055939c-771f-4f0c-a79b-bcb6ffd68214 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:22.787196 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 72/139] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jul 18 10:22:22 2022] PUT /identity/v3/projects/e3ce0a1d0d104f4ba20f8d0b63301a51/users/7a03ae73926e423685124aabba9f801a/roles/45f8992b0f6941c7a64290b437d6bd5e => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:22:22.860382 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:22.907060 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6055939c-771f-4f0c-a79b-bcb6ffd68214 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:22.953304 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60e002-8670-4dca-88a4-0608dd3aead1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:22.954520 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60e002-8670-4dca-88a4-0608dd3aead1 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:22.955046 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60e002-8670-4dca-88a4-0608dd3aead1 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:22.955549 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60e002-8670-4dca-88a4-0608dd3aead1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:22.957099 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c60e002-8670-4dca-88a4-0608dd3aead1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:22.958775 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c60e002-8670-4dca-88a4-0608dd3aead1 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:22.961005 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 68/140] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:22:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:22.966795 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd9ad41-0d7a-45f9-9b63-11adfce406df None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:23.086690 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:23.116826 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd9ad41-0d7a-45f9-9b63-11adfce406df None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:23.162868 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02585c35-3732-423e-8d1f-bd33e96c4e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:23.163561 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02585c35-3732-423e-8d1f-bd33e96c4e30 None admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:23.163855 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02585c35-3732-423e-8d1f-bd33e96c4e30 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:23.164134 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02585c35-3732-423e-8d1f-bd33e96c4e30 None admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:23.164863 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02585c35-3732-423e-8d1f-bd33e96c4e30 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:23.166370 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02585c35-3732-423e-8d1f-bd33e96c4e30 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:23.251473 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 73/141] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Jul 18 10:22:22 2022] POST /identity/v3/users => generated 283 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:22:23.640996 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff0674-6874-4615-9ba3-0b16616946ab None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:23.642030 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff0674-6874-4615-9ba3-0b16616946ab None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:23.643057 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ff0674-6874-4615-9ba3-0b16616946ab None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:23.644656 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 69/142] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:22:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:22:23.650385 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea8a4e-f0c6-46fd-881b-473356531f27 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:23.650843 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea8a4e-f0c6-46fd-881b-473356531f27 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:23.651035 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea8a4e-f0c6-46fd-881b-473356531f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:23.678159 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-7cea8a4e-f0c6-46fd-881b-473356531f27 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:22:23.679395 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-7cea8a4e-f0c6-46fd-881b-473356531f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:22:23.766234 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 74/143] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:22:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:22:23.796299 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ff0674-6874-4615-9ba3-0b16616946ab None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:23.947458 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ff0674-6874-4615-9ba3-0b16616946ab None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:23.990768 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e3bb0-a38e-4a22-bde1-40c6337a2c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:23.991890 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e3bb0-a38e-4a22-bde1-40c6337a2c1b None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:23.992174 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e3bb0-a38e-4a22-bde1-40c6337a2c1b None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:23.992449 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e3bb0-a38e-4a22-bde1-40c6337a2c1b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:23.997265 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:24.013655 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20e3bb0-a38e-4a22-bde1-40c6337a2c1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:22:24.027121 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-b20e3bb0-a38e-4a22-bde1-40c6337a2c1b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:22:24.027121 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:22:24.027121 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:22:24.027121 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:22:24.027121 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:22:24.027121 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:22:24.027121 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:22:24.027121 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:22:24.027121 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:22:24.027121 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:22:24.027121 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:22:24.027121 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:22:24.027121 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:22:24.027121 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:22:24.027121 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:22:24.027121 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:22:24.028035 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:22:24.028035 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:22:24.028035 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:22:24.028035 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:22:24.028035 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:22:24.028035 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:22:24.028035 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:22:24.028035 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:22:24.028035 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:22:24.028035 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:22:24.028035 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:22:24.028035 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:22:24.028035 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:22:24.028035 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:22:24.028035 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:22:24.028035 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:22:24.028819 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:22:24.028819 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:22:24.028819 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:22:24.028819 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:22:24.028819 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:22:24.028819 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:22:24.028819 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:22:24.028819 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:22:24.028819 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:22:24.028819 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:22:24.028819 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:22:24.028819 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:22:24.029438 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 70/144] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 10:22:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:22:24.038158 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea8a4e-f0c6-46fd-881b-473356531f27 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:24.138123 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:24.187928 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea8a4e-f0c6-46fd-881b-473356531f27 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:24.224598 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0990796-1466-4aee-b050-b6f06244ec40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:24.225214 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0990796-1466-4aee-b050-b6f06244ec40 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:24.225503 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0990796-1466-4aee-b050-b6f06244ec40 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:24.225787 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0990796-1466-4aee-b050-b6f06244ec40 None admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:24.226558 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0990796-1466-4aee-b050-b6f06244ec40 None admin] RBAC: Adding query filter params (name=member) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:24.226869 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0990796-1466-4aee-b050-b6f06244ec40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:24.228271 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0990796-1466-4aee-b050-b6f06244ec40 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:24.237647 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 75/145] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jul 18 10:22:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:24.243709 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e3bb0-a38e-4a22-bde1-40c6337a2c1b None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:24.366072 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e3bb0-a38e-4a22-bde1-40c6337a2c1b None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:24.415706 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814f670e-c89a-4447-af02-4a701e67a338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:24.416614 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f670e-c89a-4447-af02-4a701e67a338 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:24.416900 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f670e-c89a-4447-af02-4a701e67a338 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:24.417219 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f670e-c89a-4447-af02-4a701e67a338 None admin] PATH_INFO: `/v3/users/7a03ae73926e423685124aabba9f801a` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:24.418563 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814f670e-c89a-4447-af02-4a701e67a338 None admin] RBAC: Authorizing `identity:get_user(user_id=7a03ae73926e423685124aabba9f801a)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:24.420032 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814f670e-c89a-4447-af02-4a701e67a338 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:24.421721 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 71/146] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 10:22:24 2022] GET /identity/v3/users/7a03ae73926e423685124aabba9f801a => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:24.427888 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0990796-1466-4aee-b050-b6f06244ec40 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:24.452749 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef37a7d-9ffa-44e9-ae77-7b986dcd255e None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:24.453035 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef37a7d-9ffa-44e9-ae77-7b986dcd255e None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:24.453348 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef37a7d-9ffa-44e9-ae77-7b986dcd255e None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:24.454725 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 72/147] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:22:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:22:24.460738 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db545c9-2a9d-4936-ad9f-4f88616a2c1f None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:24.461031 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db545c9-2a9d-4936-ad9f-4f88616a2c1f None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:24.461336 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db545c9-2a9d-4936-ad9f-4f88616a2c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:24.484149 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-9db545c9-2a9d-4936-ad9f-4f88616a2c1f None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:22:24.485393 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-9db545c9-2a9d-4936-ad9f-4f88616a2c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:22:24.613439 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:24.618982 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0990796-1466-4aee-b050-b6f06244ec40 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:24.630773 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 73/148] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:22:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 10:22:24.650438 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:24.660316 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67074dad-0f4b-438f-9940-dac8c6602d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:24.661405 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67074dad-0f4b-438f-9940-dac8c6602d5c None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:24.661892 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67074dad-0f4b-438f-9940-dac8c6602d5c None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:24.662357 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67074dad-0f4b-438f-9940-dac8c6602d5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:24.678210 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db545c9-2a9d-4936-ad9f-4f88616a2c1f None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:24.790605 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67074dad-0f4b-438f-9940-dac8c6602d5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:24.792369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67074dad-0f4b-438f-9940-dac8c6602d5c None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:24.855398 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db545c9-2a9d-4936-ad9f-4f88616a2c1f None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:24.927264 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a23653-b2e8-4bd7-aca6-e6c1cdae0db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:24.928434 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a23653-b2e8-4bd7-aca6-e6c1cdae0db9 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:24.928898 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a23653-b2e8-4bd7-aca6-e6c1cdae0db9 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:24.929378 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a23653-b2e8-4bd7-aca6-e6c1cdae0db9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:24.947154 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a23653-b2e8-4bd7-aca6-e6c1cdae0db9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:22:24.958037 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-a8a23653-b2e8-4bd7-aca6-e6c1cdae0db9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 10:22:24.958037 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:22:24.958037 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:22:24.958037 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:22:24.958037 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:22:24.958037 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:22:24.958037 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:22:24.958037 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:22:24.958037 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:22:24.958037 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:22:24.958037 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:22:24.958037 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:22:24.958037 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:22:24.958037 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:22:24.958037 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:22:24.958037 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:22:24.958922 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:22:24.958922 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:22:24.958922 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:22:24.958922 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:22:24.958922 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:22:24.958922 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:22:24.958922 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:22:24.958922 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:22:24.958922 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:22:24.958922 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:22:24.958922 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:22:24.958922 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:22:24.958922 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:22:24.958922 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:22:24.958922 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:22:24.958922 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:22:24.959679 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:22:24.959679 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:22:24.959679 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:22:24.959679 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:22:24.959679 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:22:24.959679 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:22:24.959679 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:22:24.959679 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:22:24.959679 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:22:24.959679 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:22:24.959679 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 10:22:24.959679 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:22:24.960265 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 74/149] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 10:22:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:22:24.966511 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a23653-b2e8-4bd7-aca6-e6c1cdae0db9 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:24.993025 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 76/150] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 10:22:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 18 10:22:25.000492 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67074dad-0f4b-438f-9940-dac8c6602d5c None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:25.045785 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:25.061418 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:25.176610 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a23653-b2e8-4bd7-aca6-e6c1cdae0db9 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:25.211248 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67074dad-0f4b-438f-9940-dac8c6602d5c None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:25.251012 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f315deb8-80e4-4ea5-bdf4-a9515eb56c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:25.252539 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315deb8-80e4-4ea5-bdf4-a9515eb56c61 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:25.253600 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315deb8-80e4-4ea5-bdf4-a9515eb56c61 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:25.253883 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315deb8-80e4-4ea5-bdf4-a9515eb56c61 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:25.254811 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f315deb8-80e4-4ea5-bdf4-a9515eb56c61 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:25.255124 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f315deb8-80e4-4ea5-bdf4-a9515eb56c61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:25.256526 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f315deb8-80e4-4ea5-bdf4-a9515eb56c61 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:25.272860 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 75/151] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jul 18 10:22:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:22:25.279328 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b851419e-1eae-433e-aecc-e082e79eda0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:25.279614 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f315deb8-80e4-4ea5-bdf4-a9515eb56c61 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:25.280224 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851419e-1eae-433e-aecc-e082e79eda0d None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:25.280516 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851419e-1eae-433e-aecc-e082e79eda0d None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:25.280794 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851419e-1eae-433e-aecc-e082e79eda0d None admin] PATH_INFO: `/v3/projects/e3ce0a1d0d104f4ba20f8d0b63301a51` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:25.282861 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b851419e-1eae-433e-aecc-e082e79eda0d None admin] RBAC: Authorizing `identity:get_project(project_id=e3ce0a1d0d104f4ba20f8d0b63301a51)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:25.285075 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b851419e-1eae-433e-aecc-e082e79eda0d None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:25.286851 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 77/152] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 10:22:24 2022] GET /identity/v3/projects/e3ce0a1d0d104f4ba20f8d0b63301a51 => generated 298 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:22:25.293742 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b851419e-1eae-433e-aecc-e082e79eda0d None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:25.471439 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f315deb8-80e4-4ea5-bdf4-a9515eb56c61 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:25.505430 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:25.529996 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd2eca-06c3-46cc-9a69-614061617fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:25.540145 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:25.540288 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd2eca-06c3-46cc-9a69-614061617fed None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:25.540288 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd2eca-06c3-46cc-9a69-614061617fed None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:25.540288 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd2eca-06c3-46cc-9a69-614061617fed None admin] PATH_INFO: `/v3/users/37122b3e7c2c4067bdad5ee4fd1de795` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:25.540288 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bd2eca-06c3-46cc-9a69-614061617fed None admin] RBAC: Authorizing `identity:get_user(user_id=37122b3e7c2c4067bdad5ee4fd1de795)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:25.540288 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bd2eca-06c3-46cc-9a69-614061617fed None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:25.540935 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b851419e-1eae-433e-aecc-e082e79eda0d None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:25.541989 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 76/153] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 10:22:25 2022] GET /identity/v3/users/37122b3e7c2c4067bdad5ee4fd1de795 => generated 289 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:22:25.548321 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd2eca-06c3-46cc-9a69-614061617fed None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:25.620698 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17713c24-f62f-42a2-b93e-9b28d1d404e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:25.621407 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17713c24-f62f-42a2-b93e-9b28d1d404e7 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:25.621694 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17713c24-f62f-42a2-b93e-9b28d1d404e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:25.621973 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17713c24-f62f-42a2-b93e-9b28d1d404e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:25.622824 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17713c24-f62f-42a2-b93e-9b28d1d404e7 None admin] RBAC: Adding query filter params (role.id=907cee10dffd48b2bec00719e425d3bd, scope.project.id=e3ce0a1d0d104f4ba20f8d0b63301a51, user.id=7a03ae73926e423685124aabba9f801a) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:25.623143 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17713c24-f62f-42a2-b93e-9b28d1d404e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:25.624614 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17713c24-f62f-42a2-b93e-9b28d1d404e7 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:25.633927 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 78/154] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 10:22:25 2022] GET /identity/v3/role_assignments?user.id=7a03ae73926e423685124aabba9f801a&scope.project.id=e3ce0a1d0d104f4ba20f8d0b63301a51&role.id=907cee10dffd48b2bec00719e425d3bd => generated 608 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:22:25.722141 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd2eca-06c3-46cc-9a69-614061617fed None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:25.764690 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1156c2cd-62d8-4dc2-b621-9647da06e3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:25.765596 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156c2cd-62d8-4dc2-b621-9647da06e3c7 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:25.765888 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156c2cd-62d8-4dc2-b621-9647da06e3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:25.766165 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156c2cd-62d8-4dc2-b621-9647da06e3c7 None admin] PATH_INFO: `/v3/projects/e3ce0a1d0d104f4ba20f8d0b63301a51` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:25.767906 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1156c2cd-62d8-4dc2-b621-9647da06e3c7 None admin] RBAC: Authorizing `identity:get_project(project_id=e3ce0a1d0d104f4ba20f8d0b63301a51)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:25.769493 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1156c2cd-62d8-4dc2-b621-9647da06e3c7 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:25.771223 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 77/155] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 10:22:25 2022] GET /identity/v3/projects/e3ce0a1d0d104f4ba20f8d0b63301a51 => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:25.777598 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17713c24-f62f-42a2-b93e-9b28d1d404e7 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:25.936869 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17713c24-f62f-42a2-b93e-9b28d1d404e7 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:25.994467 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea5b4c6-1d9b-457c-9429-bc45e6dcec56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:25.995484 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5b4c6-1d9b-457c-9429-bc45e6dcec56 None admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:25.995770 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5b4c6-1d9b-457c-9429-bc45e6dcec56 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:25.996048 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5b4c6-1d9b-457c-9429-bc45e6dcec56 None admin] PATH_INFO: `/v3/projects/e3ce0a1d0d104f4ba20f8d0b63301a51/users/37122b3e7c2c4067bdad5ee4fd1de795/roles/c2ae722a355f4d73b11124bcf553fe8c` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:25.998205 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea5b4c6-1d9b-457c-9429-bc45e6dcec56 None admin] RBAC: Authorizing `identity:create_grant(project_id=e3ce0a1d0d104f4ba20f8d0b63301a51, user_id=37122b3e7c2c4067bdad5ee4fd1de795, role_id=c2ae722a355f4d73b11124bcf553fe8c)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:25.999734 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea5b4c6-1d9b-457c-9429-bc45e6dcec56 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:26.084023 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 79/156] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jul 18 10:22:25 2022] PUT /identity/v3/projects/e3ce0a1d0d104f4ba20f8d0b63301a51/users/37122b3e7c2c4067bdad5ee4fd1de795/roles/c2ae722a355f4d73b11124bcf553fe8c => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:22:26.302138 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00dc729-e7df-420a-a6ca-251d8ce0e3d1 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:26.302428 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00dc729-e7df-420a-a6ca-251d8ce0e3d1 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:26.302614 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00dc729-e7df-420a-a6ca-251d8ce0e3d1 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:26.304017 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 78/157] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:22:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:22:26.310182 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47b580-daa6-4f50-9437-9971cd80a15e None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:26.310505 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47b580-daa6-4f50-9437-9971cd80a15e None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:26.310831 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47b580-daa6-4f50-9437-9971cd80a15e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:26.335413 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-3c47b580-daa6-4f50-9437-9971cd80a15e None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:22:26.336725 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-3c47b580-daa6-4f50-9437-9971cd80a15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:22:26.355832 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:26.379589 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6607f-1576-4f80-9417-5b8e77e3d7f5 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:26.379871 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6607f-1576-4f80-9417-5b8e77e3d7f5 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:26.380205 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6607f-1576-4f80-9417-5b8e77e3d7f5 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:26.381837 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 79/158] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:22:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:22:26.398148 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e0fcee-4a10-42da-b8b8-3e9faaf68763 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:26.398475 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e0fcee-4a10-42da-b8b8-3e9faaf68763 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:26.398700 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e0fcee-4a10-42da-b8b8-3e9faaf68763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:26.434536 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-b3e0fcee-4a10-42da-b8b8-3e9faaf68763 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:22:26.435745 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-b3e0fcee-4a10-42da-b8b8-3e9faaf68763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:22:26.440978 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 80/159] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:22:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:22:26.488722 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47b580-daa6-4f50-9437-9971cd80a15e None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:26.533821 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:26.580541 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 80/160] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:22:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 10:22:26.581971 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee573b-6c24-40dc-b895-76511c6bf6b7 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:26.582259 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee573b-6c24-40dc-b895-76511c6bf6b7 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:26.582536 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee573b-6c24-40dc-b895-76511c6bf6b7 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:26.583816 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 81/161] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:22:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:22:26.590799 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93c079-a85b-4859-9121-0b6da2135df1 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:26.591088 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93c079-a85b-4859-9121-0b6da2135df1 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:26.591376 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93c079-a85b-4859-9121-0b6da2135df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:26.618031 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-5f93c079-a85b-4859-9121-0b6da2135df1 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:22:26.619225 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-5f93c079-a85b-4859-9121-0b6da2135df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:22:26.693028 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47b580-daa6-4f50-9437-9971cd80a15e None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:26.741021 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 82/162] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:22:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:22:26.742299 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f93c079-a85b-4859-9121-0b6da2135df1 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:26.765866 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81985e4-2c02-4625-aaed-eec5c3bd812b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:26.766697 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81985e4-2c02-4625-aaed-eec5c3bd812b None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:26.766983 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81985e4-2c02-4625-aaed-eec5c3bd812b None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:26.767256 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81985e4-2c02-4625-aaed-eec5c3bd812b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:26.790357 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81985e4-2c02-4625-aaed-eec5c3bd812b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:22:26.798514 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-b81985e4-2c02-4625-aaed-eec5c3bd812b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:22:26.798514 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:22:26.798514 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:22:26.798514 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:22:26.798514 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:22:26.798514 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:22:26.798514 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:22:26.798514 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:22:26.798514 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:22:26.798514 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:22:26.798514 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:22:26.798514 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:22:26.798514 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:22:26.798514 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:22:26.798514 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:22:26.798514 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:22:26.799687 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:22:26.799687 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:22:26.799687 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:22:26.799687 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:22:26.799687 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:22:26.799687 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:22:26.799687 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:22:26.799687 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:22:26.799687 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:22:26.799687 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:22:26.799687 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:22:26.799687 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:22:26.799687 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:22:26.799687 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:22:26.799687 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:22:26.799687 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:22:26.800936 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:22:26.800936 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:22:26.800936 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:22:26.800936 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:22:26.800936 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:22:26.800936 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:22:26.800936 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:22:26.800936 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:22:26.800936 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:22:26.800936 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:22:26.800936 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:22:26.800936 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:22:26.800936 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 81/163] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 10:22:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:22:26.800936 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81985e4-2c02-4625-aaed-eec5c3bd812b None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:26.827543 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:27.007902 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81985e4-2c02-4625-aaed-eec5c3bd812b None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:27.016774 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f93c079-a85b-4859-9121-0b6da2135df1 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:27.045085 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:27.100312 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f834cc-0be8-49d5-b58a-6a556d74703c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:27.101325 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530e46f7-b6fb-4d2b-9828-ad10a2a5bcce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:27.102377 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f834cc-0be8-49d5-b58a-6a556d74703c None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:27.104035 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e46f7-b6fb-4d2b-9828-ad10a2a5bcce None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:27.104522 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f834cc-0be8-49d5-b58a-6a556d74703c None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:27.105070 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e46f7-b6fb-4d2b-9828-ad10a2a5bcce None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:27.105561 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f834cc-0be8-49d5-b58a-6a556d74703c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:27.106040 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e46f7-b6fb-4d2b-9828-ad10a2a5bcce None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:27.139709 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530e46f7-b6fb-4d2b-9828-ad10a2a5bcce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:22:27.148964 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-530e46f7-b6fb-4d2b-9828-ad10a2a5bcce None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 10:22:27.148964 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:22:27.148964 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:22:27.148964 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:22:27.148964 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:22:27.148964 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:22:27.148964 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:22:27.148964 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:22:27.148964 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:22:27.148964 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:22:27.148964 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:22:27.148964 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:22:27.148964 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:22:27.148964 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:22:27.148964 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:22:27.148964 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:22:27.149845 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:22:27.149845 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:22:27.149845 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:22:27.149845 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:22:27.149845 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:22:27.149845 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:22:27.149845 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:22:27.149845 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:22:27.149845 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:22:27.149845 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:22:27.149845 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:22:27.149845 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:22:27.149845 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:22:27.149845 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:22:27.149845 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:22:27.149845 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:22:27.150613 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:22:27.150613 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:22:27.150613 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:22:27.150613 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:22:27.150613 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:22:27.150613 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:22:27.150613 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:22:27.150613 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:22:27.150613 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:22:27.150613 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:22:27.150613 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 10:22:27.150613 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:22:27.152615 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f834cc-0be8-49d5-b58a-6a556d74703c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:22:27.161006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-32f834cc-0be8-49d5-b58a-6a556d74703c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:22:27.161006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:22:27.161006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:22:27.161006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:22:27.161006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:22:27.161006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:22:27.161006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:22:27.161006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:22:27.161006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:22:27.161006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:22:27.161006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:22:27.161006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:22:27.161006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:22:27.161006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:22:27.161006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:22:27.161006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:22:27.162066 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:22:27.162066 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:22:27.162066 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:22:27.162066 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:22:27.162066 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:22:27.162066 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:22:27.162066 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:22:27.162066 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:22:27.162066 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:22:27.162066 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:22:27.162066 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:22:27.162066 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:22:27.162066 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:22:27.162066 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:22:27.162066 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:22:27.162066 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:22:27.162852 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:22:27.162852 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:22:27.162852 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:22:27.162852 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:22:27.162852 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:22:27.162852 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:22:27.162852 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:22:27.162852 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:22:27.162852 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:22:27.162852 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:22:27.162852 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:22:27.162852 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:22:27.166665 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 82/164] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 10:22:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:22:27.170280 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 83/165] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Jul 18 10:22:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 429 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:22:27.171384 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530e46f7-b6fb-4d2b-9828-ad10a2a5bcce None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:27.172399 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f834cc-0be8-49d5-b58a-6a556d74703c None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:27.331678 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:27.409396 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f834cc-0be8-49d5-b58a-6a556d74703c None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:27.435228 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530e46f7-b6fb-4d2b-9828-ad10a2a5bcce None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:27.507198 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af60395f-ad96-4996-90fb-fb3c541d5222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:27.507896 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60395f-ad96-4996-90fb-fb3c541d5222 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:27.508188 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60395f-ad96-4996-90fb-fb3c541d5222 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:27.508472 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60395f-ad96-4996-90fb-fb3c541d5222 None admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:27.509264 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af60395f-ad96-4996-90fb-fb3c541d5222 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:27.509575 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af60395f-ad96-4996-90fb-fb3c541d5222 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:27.510977 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af60395f-ad96-4996-90fb-fb3c541d5222 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:27.527150 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c9e180-3294-45ff-88d7-a48028c4d441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:27.527842 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c9e180-3294-45ff-88d7-a48028c4d441 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:27.528127 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c9e180-3294-45ff-88d7-a48028c4d441 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:27.528231 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 83/166] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 10:22:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:27.528534 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c9e180-3294-45ff-88d7-a48028c4d441 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:27.529031 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af60395f-ad96-4996-90fb-fb3c541d5222 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:27.529151 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c9e180-3294-45ff-88d7-a48028c4d441 None admin] RBAC: Adding query filter params (name=member) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:27.529461 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c9e180-3294-45ff-88d7-a48028c4d441 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:27.530858 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c9e180-3294-45ff-88d7-a48028c4d441 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:27.551796 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 84/167] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jul 18 10:22:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:27.552478 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c9e180-3294-45ff-88d7-a48028c4d441 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:27.645585 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:27.787972 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af60395f-ad96-4996-90fb-fb3c541d5222 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:27.792439 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c9e180-3294-45ff-88d7-a48028c4d441 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:27.834134 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:27.850745 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e357ad05-b7ce-4b0d-96df-caa6117fe14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:27.851470 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e357ad05-b7ce-4b0d-96df-caa6117fe14a None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:27.851760 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e357ad05-b7ce-4b0d-96df-caa6117fe14a None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:27.852041 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e357ad05-b7ce-4b0d-96df-caa6117fe14a None admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:27.852810 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e357ad05-b7ce-4b0d-96df-caa6117fe14a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:27.853148 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e357ad05-b7ce-4b0d-96df-caa6117fe14a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:27.854549 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e357ad05-b7ce-4b0d-96df-caa6117fe14a None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:27.870569 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 84/168] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 10:22:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:27.877725 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e357ad05-b7ce-4b0d-96df-caa6117fe14a None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:27.887884 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bba7b6f-cba8-4a83-938c-84211cee8428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:27.889296 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba7b6f-cba8-4a83-938c-84211cee8428 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:27.889686 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba7b6f-cba8-4a83-938c-84211cee8428 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:27.890069 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba7b6f-cba8-4a83-938c-84211cee8428 None admin] PATH_INFO: `/v3/users/7a03ae73926e423685124aabba9f801a` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:27.894084 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bba7b6f-cba8-4a83-938c-84211cee8428 None admin] RBAC: Authorizing `identity:get_user(user_id=7a03ae73926e423685124aabba9f801a)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:27.896247 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bba7b6f-cba8-4a83-938c-84211cee8428 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:27.898956 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 85/169] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 10:22:27 2022] GET /identity/v3/users/7a03ae73926e423685124aabba9f801a => generated 275 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:27.899825 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bba7b6f-cba8-4a83-938c-84211cee8428 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:28.032692 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e357ad05-b7ce-4b0d-96df-caa6117fe14a None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:28.069301 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db7505-ef30-4394-a995-e7aa957f61ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:28.070582 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db7505-ef30-4394-a995-e7aa957f61ff None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:28.071081 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db7505-ef30-4394-a995-e7aa957f61ff None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:28.071563 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db7505-ef30-4394-a995-e7aa957f61ff None admin] PATH_INFO: `/v3/users/7a03ae73926e423685124aabba9f801a` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:28.073952 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4db7505-ef30-4394-a995-e7aa957f61ff None admin] RBAC: Authorizing `identity:get_user(user_id=7a03ae73926e423685124aabba9f801a)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:28.075624 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4db7505-ef30-4394-a995-e7aa957f61ff None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:28.075849 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:28.077629 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 85/170] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 10:22:27 2022] GET /identity/v3/users/7a03ae73926e423685124aabba9f801a => generated 275 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:28.078484 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db7505-ef30-4394-a995-e7aa957f61ff None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:28.080253 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bba7b6f-cba8-4a83-938c-84211cee8428 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:28.122332 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7253cee0-b1c8-4f3f-9dc5-c39e6120b0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:28.123661 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7253cee0-b1c8-4f3f-9dc5-c39e6120b0aa None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:28.124132 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7253cee0-b1c8-4f3f-9dc5-c39e6120b0aa None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:28.124544 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7253cee0-b1c8-4f3f-9dc5-c39e6120b0aa None admin] PATH_INFO: `/v3/users/0a2289135265475ab7faec00c36046b3` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:28.126107 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7253cee0-b1c8-4f3f-9dc5-c39e6120b0aa None admin] RBAC: Authorizing `identity:get_user(user_id=0a2289135265475ab7faec00c36046b3)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:28.128298 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7253cee0-b1c8-4f3f-9dc5-c39e6120b0aa None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:28.130741 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 86/171] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 10:22:27 2022] GET /identity/v3/users/0a2289135265475ab7faec00c36046b3 => generated 247 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:28.132087 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962af2af-1d9a-41d7-b062-0d2b5b0c3a6d None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:28.132665 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962af2af-1d9a-41d7-b062-0d2b5b0c3a6d None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:28.133140 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962af2af-1d9a-41d7-b062-0d2b5b0c3a6d None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:28.134610 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 87/172] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:22:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:22:28.135824 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a3a85-38ac-4750-99b8-d48190a452a0 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:28.136277 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a3a85-38ac-4750-99b8-d48190a452a0 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:28.136706 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a3a85-38ac-4750-99b8-d48190a452a0 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:28.138386 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 88/173] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:22:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:22:28.139240 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0a3a85-38ac-4750-99b8-d48190a452a0 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:28.148064 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:28.191444 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db7505-ef30-4394-a995-e7aa957f61ff None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:28.226599 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b198cd6d-9b53-4a4e-813a-ee2e54a74591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:28.227390 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198cd6d-9b53-4a4e-813a-ee2e54a74591 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:28.227739 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198cd6d-9b53-4a4e-813a-ee2e54a74591 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:28.228094 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b198cd6d-9b53-4a4e-813a-ee2e54a74591 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:28.259889 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0a3a85-38ac-4750-99b8-d48190a452a0 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:28.301908 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f050359-6af7-4330-8516-9b692da88bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:28.302571 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b198cd6d-9b53-4a4e-813a-ee2e54a74591 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:28.303055 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f050359-6af7-4330-8516-9b692da88bfd None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:28.303585 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f050359-6af7-4330-8516-9b692da88bfd None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:28.304031 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f050359-6af7-4330-8516-9b692da88bfd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:28.304313 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b198cd6d-9b53-4a4e-813a-ee2e54a74591 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:28.344903 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:28.365199 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:28.394546 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f050359-6af7-4330-8516-9b692da88bfd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:28.396960 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f050359-6af7-4330-8516-9b692da88bfd None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:28.417710 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 86/174] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 10:22:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:22:28.419900 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b198cd6d-9b53-4a4e-813a-ee2e54a74591 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:28.512967 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 89/175] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 10:22:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:22:28.514923 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7d25f-9e21-4007-8402-c5737ba52b31 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:28.515408 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7d25f-9e21-4007-8402-c5737ba52b31 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:28.516735 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7d25f-9e21-4007-8402-c5737ba52b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:28.535906 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-eae7d25f-9e21-4007-8402-c5737ba52b31 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:22:28.537140 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-eae7d25f-9e21-4007-8402-c5737ba52b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:22:28.551060 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b198cd6d-9b53-4a4e-813a-ee2e54a74591 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:28.587136 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5584f-0437-42bb-8a30-e56d0c808a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:28.587794 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5584f-0437-42bb-8a30-e56d0c808a80 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:28.588073 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5584f-0437-42bb-8a30-e56d0c808a80 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:28.588345 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d5584f-0437-42bb-8a30-e56d0c808a80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:28.603331 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:28.608905 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 90/176] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:22:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:22:28.610060 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f4394-54c0-493d-ba30-aeae9fa6730d None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:28.610389 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f4394-54c0-493d-ba30-aeae9fa6730d None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:28.610662 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f4394-54c0-493d-ba30-aeae9fa6730d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:28.627819 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:28.630106 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-cb8f4394-54c0-493d-ba30-aeae9fa6730d None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:22:28.631593 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-cb8f4394-54c0-493d-ba30-aeae9fa6730d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:22:28.673155 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d5584f-0437-42bb-8a30-e56d0c808a80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:28.674896 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d5584f-0437-42bb-8a30-e56d0c808a80 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:28.705489 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 91/177] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:22:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:22:28.706119 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f4394-54c0-493d-ba30-aeae9fa6730d None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:28.790375 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 87/178] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 10:22:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:22:28.791554 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5584f-0437-42bb-8a30-e56d0c808a80 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:28.824812 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f4394-54c0-493d-ba30-aeae9fa6730d None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:28.855093 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:28.855457 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:28.863779 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0351f62-3b4d-4602-8100-70162f78848a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:28.864653 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0351f62-3b4d-4602-8100-70162f78848a None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:28.864938 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0351f62-3b4d-4602-8100-70162f78848a None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:28.865242 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0351f62-3b4d-4602-8100-70162f78848a None admin] PATH_INFO: `/v3/projects/e3ce0a1d0d104f4ba20f8d0b63301a51` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:28.866754 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0351f62-3b4d-4602-8100-70162f78848a None admin] RBAC: Authorizing `identity:get_project(project_id=e3ce0a1d0d104f4ba20f8d0b63301a51)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:28.868194 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0351f62-3b4d-4602-8100-70162f78848a None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:28.872669 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 92/179] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 10:22:28 2022] GET /identity/v3/projects/e3ce0a1d0d104f4ba20f8d0b63301a51 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:28.872669 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db69b3-ad12-49fb-9c11-78c777b8736c None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:28.872669 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db69b3-ad12-49fb-9c11-78c777b8736c None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:28.872669 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db69b3-ad12-49fb-9c11-78c777b8736c None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:28.877332 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 93/180] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:22:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:22:28.877332 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db69b3-ad12-49fb-9c11-78c777b8736c None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:28.902581 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d5584f-0437-42bb-8a30-e56d0c808a80 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:28.938186 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d00d8d-c761-48e6-a542-d511fb1e4d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:28.939116 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d00d8d-c761-48e6-a542-d511fb1e4d8c None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:28.939492 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d00d8d-c761-48e6-a542-d511fb1e4d8c None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:28.939825 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d00d8d-c761-48e6-a542-d511fb1e4d8c None admin] PATH_INFO: `/v3/projects/efc4b686c16b4313a09d322ff4eba6d0` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:28.940959 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d00d8d-c761-48e6-a542-d511fb1e4d8c None admin] RBAC: Authorizing `identity:get_project(project_id=efc4b686c16b4313a09d322ff4eba6d0)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:28.942436 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d00d8d-c761-48e6-a542-d511fb1e4d8c None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:28.949255 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 88/181] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 10:22:28 2022] GET /identity/v3/projects/efc4b686c16b4313a09d322ff4eba6d0 => generated 312 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:28.949255 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d00d8d-c761-48e6-a542-d511fb1e4d8c None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:28.992183 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db69b3-ad12-49fb-9c11-78c777b8736c None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:29.026786 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b680481a-9abf-4bc1-8029-8b29cb0ef89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:29.027585 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680481a-9abf-4bc1-8029-8b29cb0ef89e None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:29.027867 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680481a-9abf-4bc1-8029-8b29cb0ef89e None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:29.028141 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680481a-9abf-4bc1-8029-8b29cb0ef89e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:29.040849 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b680481a-9abf-4bc1-8029-8b29cb0ef89e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:22:29.049704 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-b680481a-9abf-4bc1-8029-8b29cb0ef89e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:22:29.049704 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:22:29.049704 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:22:29.049704 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:22:29.049704 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:22:29.049704 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:22:29.049704 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:22:29.049704 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:22:29.049704 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:22:29.049704 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:22:29.049704 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:22:29.049704 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:22:29.049704 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:22:29.049704 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:22:29.049704 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:22:29.049704 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:22:29.050607 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:22:29.050607 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:22:29.050607 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:22:29.050607 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:22:29.050607 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:22:29.050607 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:22:29.050607 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:22:29.050607 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:22:29.050607 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:22:29.050607 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:22:29.050607 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:22:29.050607 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:22:29.050607 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:22:29.050607 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:22:29.050607 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:22:29.050607 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:22:29.051390 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:22:29.051390 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:22:29.051390 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:22:29.051390 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:22:29.051390 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:22:29.051390 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:22:29.051390 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:22:29.051390 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:22:29.051390 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:22:29.051390 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:22:29.051390 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:22:29.051390 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:22:29.051390 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 94/182] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 10:22:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:22:29.052038 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b680481a-9abf-4bc1-8029-8b29cb0ef89e None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:29.061585 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d00d8d-c761-48e6-a542-d511fb1e4d8c None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:29.092650 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:29.113195 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd2ef77-9a4a-4547-9bf2-7a48b8c239d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:29.113195 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd2ef77-9a4a-4547-9bf2-7a48b8c239d4 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:29.113195 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd2ef77-9a4a-4547-9bf2-7a48b8c239d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:29.113195 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd2ef77-9a4a-4547-9bf2-7a48b8c239d4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:29.117862 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:29.120338 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd2ef77-9a4a-4547-9bf2-7a48b8c239d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:22:29.128559 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-7cd2ef77-9a4a-4547-9bf2-7a48b8c239d4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 10:22:29.128559 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:22:29.128559 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:22:29.128559 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:22:29.128559 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:22:29.128559 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:22:29.128559 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:22:29.128559 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:22:29.128559 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:22:29.128559 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:22:29.128559 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:22:29.128559 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:22:29.128559 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:22:29.128559 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:22:29.128559 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:22:29.128559 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:22:29.129511 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:22:29.129511 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:22:29.129511 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:22:29.129511 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:22:29.129511 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:22:29.129511 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:22:29.129511 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:22:29.129511 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:22:29.129511 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:22:29.129511 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:22:29.129511 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:22:29.129511 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:22:29.129511 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:22:29.129511 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:22:29.129511 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:22:29.129511 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:22:29.135270 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:22:29.135270 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:22:29.135270 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:22:29.135270 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:22:29.135270 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:22:29.135270 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:22:29.135270 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:22:29.135270 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:22:29.135270 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:22:29.135270 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:22:29.135270 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 10:22:29.135270 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:22:29.135270 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 89/183] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Jul 18 10:22:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:22:29.135270 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd2ef77-9a4a-4547-9bf2-7a48b8c239d4 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:29.171754 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b680481a-9abf-4bc1-8029-8b29cb0ef89e None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:29.207914 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1959387a-4149-4974-a4a6-aff81c51c56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:29.208700 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959387a-4149-4974-a4a6-aff81c51c56b None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:29.208979 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959387a-4149-4974-a4a6-aff81c51c56b None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:29.209282 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959387a-4149-4974-a4a6-aff81c51c56b None admin] PATH_INFO: `/v3/projects/e3ce0a1d0d104f4ba20f8d0b63301a51` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:29.210469 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1959387a-4149-4974-a4a6-aff81c51c56b None admin] RBAC: Authorizing `identity:get_project(project_id=e3ce0a1d0d104f4ba20f8d0b63301a51)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:29.211922 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1959387a-4149-4974-a4a6-aff81c51c56b None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:29.213863 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 95/184] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 10:22:29 2022] GET /identity/v3/projects/e3ce0a1d0d104f4ba20f8d0b63301a51 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:29.214794 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205779e-3aca-42d2-87f7-f4a836077735 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:29.215079 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205779e-3aca-42d2-87f7-f4a836077735 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:29.215353 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3205779e-3aca-42d2-87f7-f4a836077735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:29.232208 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-3205779e-3aca-42d2-87f7-f4a836077735 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:22:29.233430 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-3205779e-3aca-42d2-87f7-f4a836077735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:22:29.239844 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd2ef77-9a4a-4547-9bf2-7a48b8c239d4 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:29.273438 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7571dcaa-6a6a-40a9-a218-d47073e8fa8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:29.274100 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7571dcaa-6a6a-40a9-a218-d47073e8fa8b None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:29.274386 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7571dcaa-6a6a-40a9-a218-d47073e8fa8b None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:29.274660 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7571dcaa-6a6a-40a9-a218-d47073e8fa8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:29.275486 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7571dcaa-6a6a-40a9-a218-d47073e8fa8b None admin] RBAC: Adding query filter params (role.id=45f8992b0f6941c7a64290b437d6bd5e, scope.project.id=e3ce0a1d0d104f4ba20f8d0b63301a51, user.id=7a03ae73926e423685124aabba9f801a) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:29.275800 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7571dcaa-6a6a-40a9-a218-d47073e8fa8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:29.277255 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7571dcaa-6a6a-40a9-a218-d47073e8fa8b None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:29.283545 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 90/185] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 10:22:29 2022] GET /identity/v3/role_assignments?user.id=7a03ae73926e423685124aabba9f801a&scope.project.id=e3ce0a1d0d104f4ba20f8d0b63301a51&role.id=45f8992b0f6941c7a64290b437d6bd5e => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:29.284315 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7571dcaa-6a6a-40a9-a218-d47073e8fa8b None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:29.313030 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 96/186] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:22:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:22:29.313697 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3205779e-3aca-42d2-87f7-f4a836077735 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:29.355929 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:29.383484 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:29.413864 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7571dcaa-6a6a-40a9-a218-d47073e8fa8b None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:29.432400 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3205779e-3aca-42d2-87f7-f4a836077735 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:29.456962 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c688819d-6c58-42e8-b9b3-d7534db12f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:29.457668 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688819d-6c58-42e8-b9b3-d7534db12f54 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:29.458005 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688819d-6c58-42e8-b9b3-d7534db12f54 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:29.458672 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688819d-6c58-42e8-b9b3-d7534db12f54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:29.459526 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c688819d-6c58-42e8-b9b3-d7534db12f54 None admin] RBAC: Adding query filter params (role.id=907cee10dffd48b2bec00719e425d3bd, scope.project.id=efc4b686c16b4313a09d322ff4eba6d0, user.id=7a03ae73926e423685124aabba9f801a) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:29.459840 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c688819d-6c58-42e8-b9b3-d7534db12f54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:29.461633 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c688819d-6c58-42e8-b9b3-d7534db12f54 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:29.468594 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 91/187] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 10:22:29 2022] GET /identity/v3/role_assignments?user.id=7a03ae73926e423685124aabba9f801a&scope.project.id=efc4b686c16b4313a09d322ff4eba6d0&role.id=907cee10dffd48b2bec00719e425d3bd => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:29.469342 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c688819d-6c58-42e8-b9b3-d7534db12f54 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:29.482257 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5373066e-a927-41be-8b12-56d30b9654c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:29.482957 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5373066e-a927-41be-8b12-56d30b9654c7 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:29.483239 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5373066e-a927-41be-8b12-56d30b9654c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:29.483513 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5373066e-a927-41be-8b12-56d30b9654c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:29.484277 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5373066e-a927-41be-8b12-56d30b9654c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:29.484583 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5373066e-a927-41be-8b12-56d30b9654c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:29.487033 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5373066e-a927-41be-8b12-56d30b9654c7 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:29.498127 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 97/188] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 10:22:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:29.500183 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba606e-a80b-40c2-ae2d-ea6868c2db70 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:29.500718 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba606e-a80b-40c2-ae2d-ea6868c2db70 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:29.501416 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eba606e-a80b-40c2-ae2d-ea6868c2db70 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:29.504423 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 98/189] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:22:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:22:29.505778 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eba606e-a80b-40c2-ae2d-ea6868c2db70 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:29.595117 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c688819d-6c58-42e8-b9b3-d7534db12f54 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:29.613279 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:29.632066 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a18d7a5-9a00-427a-8961-6ccdb5bd9102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:29.632328 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eba606e-a80b-40c2-ae2d-ea6868c2db70 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:29.633435 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18d7a5-9a00-427a-8961-6ccdb5bd9102 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:29.633719 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18d7a5-9a00-427a-8961-6ccdb5bd9102 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:29.633988 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18d7a5-9a00-427a-8961-6ccdb5bd9102 None admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:29.634746 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a18d7a5-9a00-427a-8961-6ccdb5bd9102 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:29.635050 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a18d7a5-9a00-427a-8961-6ccdb5bd9102 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:29.637164 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a18d7a5-9a00-427a-8961-6ccdb5bd9102 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:29.648592 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 92/190] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 10:22:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:29.652156 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a18d7a5-9a00-427a-8961-6ccdb5bd9102 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:29.654492 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:29.677539 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ace89-7d92-40b0-af8f-10c6b68a1e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:29.678205 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ace89-7d92-40b0-af8f-10c6b68a1e15 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:29.678910 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ace89-7d92-40b0-af8f-10c6b68a1e15 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:29.679206 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ace89-7d92-40b0-af8f-10c6b68a1e15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:29.680215 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4ace89-7d92-40b0-af8f-10c6b68a1e15 None admin] RBAC: Adding query filter params (role.id=e7b6a55ecf6c491487955aaefbf9c388, scope.project.id=e3ce0a1d0d104f4ba20f8d0b63301a51, user.id=0a2289135265475ab7faec00c36046b3) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:29.680529 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4ace89-7d92-40b0-af8f-10c6b68a1e15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:29.682570 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4ace89-7d92-40b0-af8f-10c6b68a1e15 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:29.689233 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 99/191] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 10:22:29 2022] GET /identity/v3/role_assignments?user.id=0a2289135265475ab7faec00c36046b3&scope.project.id=e3ce0a1d0d104f4ba20f8d0b63301a51&role.id=e7b6a55ecf6c491487955aaefbf9c388 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:29.690517 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ace89-7d92-40b0-af8f-10c6b68a1e15 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:29.784700 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a18d7a5-9a00-427a-8961-6ccdb5bd9102 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:29.819195 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ace89-7d92-40b0-af8f-10c6b68a1e15 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:29.823012 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f564894c-93d7-468a-b912-82c222cc5e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:29.823831 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f564894c-93d7-468a-b912-82c222cc5e5c None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:29.824109 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f564894c-93d7-468a-b912-82c222cc5e5c None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:29.824378 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f564894c-93d7-468a-b912-82c222cc5e5c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:29.825635 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f564894c-93d7-468a-b912-82c222cc5e5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:29.827246 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f564894c-93d7-468a-b912-82c222cc5e5c None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:29.829090 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 93/192] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:22:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:29.835225 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ab412-a4a4-4e4e-9c46-075b0042d579 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:29.835514 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ab412-a4a4-4e4e-9c46-075b0042d579 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:29.835913 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ab412-a4a4-4e4e-9c46-075b0042d579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:29.855032 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-b20ab412-a4a4-4e4e-9c46-075b0042d579 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:22:29.856238 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-b20ab412-a4a4-4e4e-9c46-075b0042d579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:22:29.862470 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b901269f-2068-4861-b3d4-46fd2196c89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:29.863870 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901269f-2068-4861-b3d4-46fd2196c89e None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:29.864313 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901269f-2068-4861-b3d4-46fd2196c89e None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:29.865081 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901269f-2068-4861-b3d4-46fd2196c89e None admin] PATH_INFO: `/v3/users/ec835a1fbed242e8b6dc4836666eef08` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:29.880723 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b901269f-2068-4861-b3d4-46fd2196c89e None admin] RBAC: Authorizing `identity:get_user(user_id=ec835a1fbed242e8b6dc4836666eef08)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:29.882273 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b901269f-2068-4861-b3d4-46fd2196c89e None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:29.884161 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 100/193] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 10:22:29 2022] GET /identity/v3/users/ec835a1fbed242e8b6dc4836666eef08 => generated 283 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:29.884927 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b901269f-2068-4861-b3d4-46fd2196c89e None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:29.913093 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:29.933779 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:29.938331 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 94/194] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:22:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:22:29.944232 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ab412-a4a4-4e4e-9c46-075b0042d579 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:30.003168 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b901269f-2068-4861-b3d4-46fd2196c89e None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:30.039928 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b43425-24d3-45ba-81cc-529281c063c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:30.040723 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b43425-24d3-45ba-81cc-529281c063c2 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:30.040826 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ab412-a4a4-4e4e-9c46-075b0042d579 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:30.041006 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b43425-24d3-45ba-81cc-529281c063c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:30.041320 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b43425-24d3-45ba-81cc-529281c063c2 None admin] PATH_INFO: `/v3/users/ec835a1fbed242e8b6dc4836666eef08` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:30.042847 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b43425-24d3-45ba-81cc-529281c063c2 None admin] RBAC: Authorizing `identity:get_user(user_id=ec835a1fbed242e8b6dc4836666eef08)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:30.045012 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b43425-24d3-45ba-81cc-529281c063c2 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:30.049327 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 101/195] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 10:22:29 2022] GET /identity/v3/users/ec835a1fbed242e8b6dc4836666eef08 => generated 283 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:30.049327 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b43425-24d3-45ba-81cc-529281c063c2 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:30.079129 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22503610-519c-453d-86b7-ee1ad1ff16e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:30.080503 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22503610-519c-453d-86b7-ee1ad1ff16e2 None admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:30.080791 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22503610-519c-453d-86b7-ee1ad1ff16e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:30.081094 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22503610-519c-453d-86b7-ee1ad1ff16e2 None admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:30.081796 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22503610-519c-453d-86b7-ee1ad1ff16e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:30.083223 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22503610-519c-453d-86b7-ee1ad1ff16e2 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:30.154173 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b43425-24d3-45ba-81cc-529281c063c2 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:30.162595 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:30.173599 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 95/196] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Jul 18 10:22:29 2022] POST /identity/v3/users => generated 297 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:22:30.179226 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22503610-519c-453d-86b7-ee1ad1ff16e2 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:30.200152 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37594aa1-0586-4642-978b-ad47afc88d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:30.200822 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37594aa1-0586-4642-978b-ad47afc88d39 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:30.201131 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37594aa1-0586-4642-978b-ad47afc88d39 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:30.201490 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37594aa1-0586-4642-978b-ad47afc88d39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:30.212008 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:30.280767 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37594aa1-0586-4642-978b-ad47afc88d39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:30.282306 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37594aa1-0586-4642-978b-ad47afc88d39 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:30.291110 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22503610-519c-453d-86b7-ee1ad1ff16e2 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:30.333258 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d92ea3-6e42-4fbd-912b-21fb013172ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:30.334181 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d92ea3-6e42-4fbd-912b-21fb013172ec None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:30.334458 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d92ea3-6e42-4fbd-912b-21fb013172ec None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:30.334773 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d92ea3-6e42-4fbd-912b-21fb013172ec None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:30.345404 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d92ea3-6e42-4fbd-912b-21fb013172ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:22:30.354919 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-54d92ea3-6e42-4fbd-912b-21fb013172ec None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 10:22:30.354919 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:22:30.354919 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:22:30.354919 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:22:30.354919 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:22:30.354919 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:22:30.354919 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:22:30.354919 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:22:30.354919 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:22:30.354919 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:22:30.354919 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:22:30.354919 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:22:30.354919 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:22:30.354919 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:22:30.354919 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:22:30.354919 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:22:30.356032 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:22:30.356032 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:22:30.356032 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:22:30.356032 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:22:30.356032 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:22:30.356032 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:22:30.356032 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:22:30.356032 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:22:30.356032 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:22:30.356032 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:22:30.356032 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:22:30.356032 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:22:30.356032 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:22:30.356032 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:22:30.356032 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:22:30.356032 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:22:30.356990 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:22:30.356990 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:22:30.356990 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:22:30.356990 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:22:30.356990 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:22:30.356990 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:22:30.356990 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:22:30.356990 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:22:30.356990 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:22:30.356990 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:22:30.356990 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 10:22:30.356990 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:22:30.359041 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 96/197] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 10:22:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:22:30.360018 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d92ea3-6e42-4fbd-912b-21fb013172ec None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:30.397213 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 102/198] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 10:22:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:22:30.397923 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37594aa1-0586-4642-978b-ad47afc88d39 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:30.406687 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:30.473252 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:30.482296 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d92ea3-6e42-4fbd-912b-21fb013172ec None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:30.523973 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37594aa1-0586-4642-978b-ad47afc88d39 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:30.529379 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ab8ad-7c4e-4d41-93eb-411cb8184a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:30.530297 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ab8ad-7c4e-4d41-93eb-411cb8184a56 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:30.530807 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ab8ad-7c4e-4d41-93eb-411cb8184a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:30.531178 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ab8ad-7c4e-4d41-93eb-411cb8184a56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:30.571322 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3282046-e2c8-499a-bd2f-07b39e456fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:30.572185 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3282046-e2c8-499a-bd2f-07b39e456fc4 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:30.572887 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3282046-e2c8-499a-bd2f-07b39e456fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:30.573207 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3282046-e2c8-499a-bd2f-07b39e456fc4 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:30.574258 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3282046-e2c8-499a-bd2f-07b39e456fc4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:30.574572 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3282046-e2c8-499a-bd2f-07b39e456fc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:30.576260 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3282046-e2c8-499a-bd2f-07b39e456fc4 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:30.590558 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 103/199] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jul 18 10:22:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:30.591680 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3282046-e2c8-499a-bd2f-07b39e456fc4 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:30.618936 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40ab8ad-7c4e-4d41-93eb-411cb8184a56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:30.620709 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40ab8ad-7c4e-4d41-93eb-411cb8184a56 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:30.686278 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:30.720078 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:30.731138 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 97/200] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 10:22:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:22:30.732090 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ab8ad-7c4e-4d41-93eb-411cb8184a56 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:30.732555 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3282046-e2c8-499a-bd2f-07b39e456fc4 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:30.779207 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb80819-9476-49b2-9630-b9e845dc7fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:30.780208 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb80819-9476-49b2-9630-b9e845dc7fff None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:30.780563 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb80819-9476-49b2-9630-b9e845dc7fff None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:30.780914 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb80819-9476-49b2-9630-b9e845dc7fff None admin] PATH_INFO: `/v3/projects/cd29577200c54cde8573db439fcbf179` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:30.783305 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb80819-9476-49b2-9630-b9e845dc7fff None admin] RBAC: Authorizing `identity:get_project(project_id=cd29577200c54cde8573db439fcbf179)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:30.785367 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb80819-9476-49b2-9630-b9e845dc7fff None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:30.787900 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 104/201] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 10:22:30 2022] GET /identity/v3/projects/cd29577200c54cde8573db439fcbf179 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:30.789468 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb80819-9476-49b2-9630-b9e845dc7fff None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:30.874399 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ab8ad-7c4e-4d41-93eb-411cb8184a56 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:30.904555 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb80819-9476-49b2-9630-b9e845dc7fff None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:30.917304 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e38536-83f2-458e-8fe8-d5eae6ec470b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:30.918958 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e38536-83f2-458e-8fe8-d5eae6ec470b None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:30.919345 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e38536-83f2-458e-8fe8-d5eae6ec470b None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:30.919725 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e38536-83f2-458e-8fe8-d5eae6ec470b None admin] PATH_INFO: `/v3/users/37122b3e7c2c4067bdad5ee4fd1de795` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:30.921584 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e38536-83f2-458e-8fe8-d5eae6ec470b None admin] RBAC: Authorizing `identity:get_user(user_id=37122b3e7c2c4067bdad5ee4fd1de795)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:30.923605 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e38536-83f2-458e-8fe8-d5eae6ec470b None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:30.925988 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 98/202] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 10:22:30 2022] GET /identity/v3/users/37122b3e7c2c4067bdad5ee4fd1de795 => generated 289 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:30.927352 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e38536-83f2-458e-8fe8-d5eae6ec470b None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:30.943005 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5276b-5c90-404b-bb8d-110e698f3ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:30.944188 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5276b-5c90-404b-bb8d-110e698f3ff6 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:30.944470 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5276b-5c90-404b-bb8d-110e698f3ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:30.944862 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5276b-5c90-404b-bb8d-110e698f3ff6 None admin] PATH_INFO: `/v3/projects/cd29577200c54cde8573db439fcbf179` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:30.946734 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e5276b-5c90-404b-bb8d-110e698f3ff6 None admin] RBAC: Authorizing `identity:get_project(project_id=cd29577200c54cde8573db439fcbf179)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:30.948420 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e5276b-5c90-404b-bb8d-110e698f3ff6 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:30.950661 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 105/203] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 10:22:30 2022] GET /identity/v3/projects/cd29577200c54cde8573db439fcbf179 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:30.951486 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5276b-5c90-404b-bb8d-110e698f3ff6 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:30.961677 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:31.000827 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:31.045911 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e38536-83f2-458e-8fe8-d5eae6ec470b None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:31.068508 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5276b-5c90-404b-bb8d-110e698f3ff6 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:31.082641 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aed525-e9dc-45e1-b37c-fee2140404cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:31.083397 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aed525-e9dc-45e1-b37c-fee2140404cd None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:31.083732 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aed525-e9dc-45e1-b37c-fee2140404cd None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:31.084009 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aed525-e9dc-45e1-b37c-fee2140404cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:31.084947 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aed525-e9dc-45e1-b37c-fee2140404cd None admin] RBAC: Adding query filter params (role.id=e7b6a55ecf6c491487955aaefbf9c388, scope.project.id=cd29577200c54cde8573db439fcbf179, user.id=ec835a1fbed242e8b6dc4836666eef08) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:31.090487 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aed525-e9dc-45e1-b37c-fee2140404cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:31.092071 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aed525-e9dc-45e1-b37c-fee2140404cd None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:31.103746 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 99/204] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 10:22:30 2022] GET /identity/v3/role_assignments?user.id=ec835a1fbed242e8b6dc4836666eef08&scope.project.id=cd29577200c54cde8573db439fcbf179&role.id=e7b6a55ecf6c491487955aaefbf9c388 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:31.104471 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aed525-e9dc-45e1-b37c-fee2140404cd None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:31.107166 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4443b0a-55e9-4989-8eb3-b59a798946f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:31.108348 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4443b0a-55e9-4989-8eb3-b59a798946f5 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:31.108867 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4443b0a-55e9-4989-8eb3-b59a798946f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:31.109392 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4443b0a-55e9-4989-8eb3-b59a798946f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:31.190289 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4443b0a-55e9-4989-8eb3-b59a798946f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:31.192709 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4443b0a-55e9-4989-8eb3-b59a798946f5 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:31.196074 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:31.219155 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aed525-e9dc-45e1-b37c-fee2140404cd None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:31.247825 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:31.260184 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147bdb6-4e7b-4f39-a6b4-f1a5b9ecfaac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:31.261131 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147bdb6-4e7b-4f39-a6b4-f1a5b9ecfaac None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:31.261503 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147bdb6-4e7b-4f39-a6b4-f1a5b9ecfaac None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:31.261875 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147bdb6-4e7b-4f39-a6b4-f1a5b9ecfaac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:31.262853 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9147bdb6-4e7b-4f39-a6b4-f1a5b9ecfaac None admin] RBAC: Adding query filter params (role.id=45f8992b0f6941c7a64290b437d6bd5e, scope.project.id=cd29577200c54cde8573db439fcbf179, user.id=ec835a1fbed242e8b6dc4836666eef08) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:31.263270 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9147bdb6-4e7b-4f39-a6b4-f1a5b9ecfaac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:31.265203 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9147bdb6-4e7b-4f39-a6b4-f1a5b9ecfaac None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:31.271951 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 100/205] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 10:22:31 2022] GET /identity/v3/role_assignments?user.id=ec835a1fbed242e8b6dc4836666eef08&scope.project.id=cd29577200c54cde8573db439fcbf179&role.id=45f8992b0f6941c7a64290b437d6bd5e => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:31.312005 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 106/206] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 10:22:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:22:31.325476 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147bdb6-4e7b-4f39-a6b4-f1a5b9ecfaac None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:31.485986 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147bdb6-4e7b-4f39-a6b4-f1a5b9ecfaac None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:31.561890 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eefd3e-9969-435b-9f3d-d934b3edc561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:31.563213 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eefd3e-9969-435b-9f3d-d934b3edc561 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:31.563726 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eefd3e-9969-435b-9f3d-d934b3edc561 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:31.564744 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eefd3e-9969-435b-9f3d-d934b3edc561 None admin] PATH_INFO: `/v3/projects/e3ce0a1d0d104f4ba20f8d0b63301a51` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:31.566355 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eefd3e-9969-435b-9f3d-d934b3edc561 None admin] RBAC: Authorizing `identity:get_project(project_id=e3ce0a1d0d104f4ba20f8d0b63301a51)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:31.568130 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eefd3e-9969-435b-9f3d-d934b3edc561 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:31.574267 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 101/207] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 10:22:31 2022] GET /identity/v3/projects/e3ce0a1d0d104f4ba20f8d0b63301a51 => generated 298 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:31.580987 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4443b0a-55e9-4989-8eb3-b59a798946f5 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:31.695153 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4443b0a-55e9-4989-8eb3-b59a798946f5 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:31.718059 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:31.749535 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90eb365-e4d0-46f2-a401-3682b78ccaf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:31.749535 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90eb365-e4d0-46f2-a401-3682b78ccaf9 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:31.749535 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90eb365-e4d0-46f2-a401-3682b78ccaf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:31.749535 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90eb365-e4d0-46f2-a401-3682b78ccaf9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:31.749903 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90eb365-e4d0-46f2-a401-3682b78ccaf9 None admin] RBAC: Adding query filter params (role.id=c2ae722a355f4d73b11124bcf553fe8c, scope.project.id=e3ce0a1d0d104f4ba20f8d0b63301a51, user.id=37122b3e7c2c4067bdad5ee4fd1de795) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:31.749903 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90eb365-e4d0-46f2-a401-3682b78ccaf9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:31.749903 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90eb365-e4d0-46f2-a401-3682b78ccaf9 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:31.750103 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 107/208] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 10:22:31 2022] GET /identity/v3/role_assignments?user.id=37122b3e7c2c4067bdad5ee4fd1de795&scope.project.id=e3ce0a1d0d104f4ba20f8d0b63301a51&role.id=c2ae722a355f4d73b11124bcf553fe8c => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:32.667750 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa8d97-8ec1-4b90-850e-7c5e5274d3fb None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:32.668293 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa8d97-8ec1-4b90-850e-7c5e5274d3fb None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:32.668293 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa8d97-8ec1-4b90-850e-7c5e5274d3fb None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:32.670170 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 102/209] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:22:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:22:32.676051 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51345f-8940-4122-95d0-d9c9a2501706 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:32.676463 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51345f-8940-4122-95d0-d9c9a2501706 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:32.676792 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51345f-8940-4122-95d0-d9c9a2501706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:32.694504 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-5e51345f-8940-4122-95d0-d9c9a2501706 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:22:32.695745 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-5e51345f-8940-4122-95d0-d9c9a2501706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:22:32.733313 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b94579-8458-4e6c-af14-a7bb916d6c1e None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:32.734411 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b94579-8458-4e6c-af14-a7bb916d6c1e None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:32.734718 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b94579-8458-4e6c-af14-a7bb916d6c1e None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:32.736850 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 103/210] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:22:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:22:32.741982 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc339673-1a98-4150-b8a6-17becb65ce9c None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:32.742270 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc339673-1a98-4150-b8a6-17becb65ce9c None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:32.742550 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc339673-1a98-4150-b8a6-17becb65ce9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:32.761271 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-bc339673-1a98-4150-b8a6-17becb65ce9c None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:22:32.763562 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-bc339673-1a98-4150-b8a6-17becb65ce9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:22:32.775869 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 108/211] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:22:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:22:32.798963 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e51345f-8940-4122-95d0-d9c9a2501706 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:32.838533 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 104/212] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:22:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 10:22:32.838818 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:32.865251 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc339673-1a98-4150-b8a6-17becb65ce9c None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:32.910859 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:32.914636 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e51345f-8940-4122-95d0-d9c9a2501706 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:32.953362 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2d4c7-7f2c-4316-bed0-834b8875f838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:32.954145 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2d4c7-7f2c-4316-bed0-834b8875f838 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:32.954424 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2d4c7-7f2c-4316-bed0-834b8875f838 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:32.955301 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2d4c7-7f2c-4316-bed0-834b8875f838 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:32.966267 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba2d4c7-7f2c-4316-bed0-834b8875f838 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:22:32.975325 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-2ba2d4c7-7f2c-4316-bed0-834b8875f838 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:22:32.975325 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:22:32.975325 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:22:32.975325 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:22:32.975325 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:22:32.975325 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:22:32.975325 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:22:32.975325 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:22:32.975325 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:22:32.975325 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:22:32.975325 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:22:32.975325 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:22:32.975325 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:22:32.975325 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:22:32.975325 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:22:32.975325 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:22:32.976411 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:22:32.976411 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:22:32.976411 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:22:32.976411 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:22:32.976411 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:22:32.976411 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:22:32.976411 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:22:32.976411 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:22:32.976411 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:22:32.976411 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:22:32.976411 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:22:32.976411 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:22:32.976411 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:22:32.976411 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:22:32.976411 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:22:32.976411 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:22:32.977248 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:22:32.977248 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:22:32.977248 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:22:32.977248 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:22:32.977248 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:22:32.977248 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:22:32.977248 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:22:32.977248 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:22:32.977248 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:22:32.977248 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:22:32.977248 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:22:32.977248 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:22:32.977248 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 109/213] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 10:22:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:22:32.982410 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2d4c7-7f2c-4316-bed0-834b8875f838 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:32.991620 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc339673-1a98-4150-b8a6-17becb65ce9c None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:33.035505 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6144064-cf42-4e26-904f-15cb46e82c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:33.036969 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6144064-cf42-4e26-904f-15cb46e82c11 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:33.037421 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6144064-cf42-4e26-904f-15cb46e82c11 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:33.038127 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6144064-cf42-4e26-904f-15cb46e82c11 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:33.039677 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6144064-cf42-4e26-904f-15cb46e82c11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:33.042000 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6144064-cf42-4e26-904f-15cb46e82c11 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:33.044394 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 105/214] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:22:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:22:33.050319 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6144064-cf42-4e26-904f-15cb46e82c11 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:33.117336 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2d4c7-7f2c-4316-bed0-834b8875f838 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:33.130973 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:33.162438 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fd1597-e5ab-468b-9065-1ec5c1fe327d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:33.163472 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd1597-e5ab-468b-9065-1ec5c1fe327d None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:33.164133 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd1597-e5ab-468b-9065-1ec5c1fe327d None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:33.164619 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd1597-e5ab-468b-9065-1ec5c1fe327d None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:33.166234 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fd1597-e5ab-468b-9065-1ec5c1fe327d None admin] RBAC: Adding query filter params (name=member) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:33.166749 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fd1597-e5ab-468b-9065-1ec5c1fe327d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:33.168806 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fd1597-e5ab-468b-9065-1ec5c1fe327d None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:33.180570 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 110/215] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jul 18 10:22:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:33.186121 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fd1597-e5ab-468b-9065-1ec5c1fe327d None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:33.191166 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6144064-cf42-4e26-904f-15cb46e82c11 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:33.215901 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:33.238061 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349cacbd-da5a-43fa-be0b-02f7fd914c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:33.238744 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349cacbd-da5a-43fa-be0b-02f7fd914c36 None admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:33.239036 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349cacbd-da5a-43fa-be0b-02f7fd914c36 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:33.239353 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349cacbd-da5a-43fa-be0b-02f7fd914c36 None admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:33.240094 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349cacbd-da5a-43fa-be0b-02f7fd914c36 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:33.242313 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349cacbd-da5a-43fa-be0b-02f7fd914c36 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:33.306796 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fd1597-e5ab-468b-9065-1ec5c1fe327d None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:33.345954 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 106/216] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Jul 18 10:22:33 2022] POST /identity/v3/users => generated 297 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:22:33.352499 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617d6b76-0620-4fab-b9ad-fe3a39d2aa85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:33.353497 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d6b76-0620-4fab-b9ad-fe3a39d2aa85 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:33.353775 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d6b76-0620-4fab-b9ad-fe3a39d2aa85 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:33.354043 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d6b76-0620-4fab-b9ad-fe3a39d2aa85 None admin] PATH_INFO: `/v3/users/9d5c61ff2934469b999fff5a1a1ed206` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:33.371557 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617d6b76-0620-4fab-b9ad-fe3a39d2aa85 None admin] RBAC: Authorizing `identity:get_user(user_id=9d5c61ff2934469b999fff5a1a1ed206)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:33.373122 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617d6b76-0620-4fab-b9ad-fe3a39d2aa85 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:33.375529 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 111/217] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 10:22:33 2022] GET /identity/v3/users/9d5c61ff2934469b999fff5a1a1ed206 => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:33.382036 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349cacbd-da5a-43fa-be0b-02f7fd914c36 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:33.510106 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349cacbd-da5a-43fa-be0b-02f7fd914c36 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:33.525866 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:33.554375 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1647c3-3c90-4fe8-a826-6e208f43d9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:33.555038 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1647c3-3c90-4fe8-a826-6e208f43d9b6 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:33.555327 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1647c3-3c90-4fe8-a826-6e208f43d9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:33.555653 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1647c3-3c90-4fe8-a826-6e208f43d9b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:33.609943 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581e49e-1717-4059-9fee-acc24f5be691 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:33.610256 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581e49e-1717-4059-9fee-acc24f5be691 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:33.610505 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581e49e-1717-4059-9fee-acc24f5be691 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:33.613249 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 112/218] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:22:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:22:33.618920 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70811460-b8fd-4f6f-93f6-831616b82751 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:33.619206 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70811460-b8fd-4f6f-93f6-831616b82751 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:33.619481 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70811460-b8fd-4f6f-93f6-831616b82751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:33.631151 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1647c3-3c90-4fe8-a826-6e208f43d9b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:33.632644 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1647c3-3c90-4fe8-a826-6e208f43d9b6 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:33.645760 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-70811460-b8fd-4f6f-93f6-831616b82751 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:22:33.646967 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-70811460-b8fd-4f6f-93f6-831616b82751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:22:33.741644 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 113/219] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:22:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 10:22:33.766546 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 107/220] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 10:22:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 18 10:22:33.767569 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70811460-b8fd-4f6f-93f6-831616b82751 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:33.774459 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1647c3-3c90-4fe8-a826-6e208f43d9b6 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:33.781980 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:33.789641 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:33.891886 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1647c3-3c90-4fe8-a826-6e208f43d9b6 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:33.903138 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70811460-b8fd-4f6f-93f6-831616b82751 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:33.931204 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9227f9-7b8f-491e-95e3-dcb25ec62dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:33.932088 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9227f9-7b8f-491e-95e3-dcb25ec62dee None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:33.932368 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9227f9-7b8f-491e-95e3-dcb25ec62dee None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:33.932643 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9227f9-7b8f-491e-95e3-dcb25ec62dee None admin] PATH_INFO: `/v3/projects/cd29577200c54cde8573db439fcbf179` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:33.934160 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9227f9-7b8f-491e-95e3-dcb25ec62dee None admin] RBAC: Authorizing `identity:get_project(project_id=cd29577200c54cde8573db439fcbf179)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:33.935521 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9227f9-7b8f-491e-95e3-dcb25ec62dee None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:33.943081 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 108/221] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 10:22:33 2022] GET /identity/v3/projects/cd29577200c54cde8573db439fcbf179 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:33.943081 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49482778-73cc-4841-9e70-a90d7e3134c4 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:33.943081 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49482778-73cc-4841-9e70-a90d7e3134c4 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:33.943081 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49482778-73cc-4841-9e70-a90d7e3134c4 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:33.945796 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 109/222] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:22:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:22:33.945796 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49482778-73cc-4841-9e70-a90d7e3134c4 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:33.957765 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c049e-07d9-40fd-bc47-04ea1552b2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:33.958212 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c049e-07d9-40fd-bc47-04ea1552b2bf None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:33.958488 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c049e-07d9-40fd-bc47-04ea1552b2bf None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:33.958760 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c049e-07d9-40fd-bc47-04ea1552b2bf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:33.970350 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6c049e-07d9-40fd-bc47-04ea1552b2bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:22:33.978669 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-8a6c049e-07d9-40fd-bc47-04ea1552b2bf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:22:33.978669 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:22:33.978669 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:22:33.978669 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:22:33.978669 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:22:33.978669 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:22:33.978669 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:22:33.978669 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:22:33.978669 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:22:33.978669 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:22:33.978669 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:22:33.978669 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:22:33.978669 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:22:33.978669 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:22:33.978669 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:22:33.978669 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:22:33.979563 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:22:33.979563 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:22:33.979563 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:22:33.979563 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:22:33.979563 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:22:33.979563 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:22:33.979563 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:22:33.979563 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:22:33.979563 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:22:33.979563 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:22:33.979563 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:22:33.979563 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:22:33.979563 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:22:33.979563 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:22:33.979563 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:22:33.979563 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:22:33.980352 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:22:33.980352 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:22:33.980352 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:22:33.980352 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:22:33.980352 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:22:33.980352 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:22:33.980352 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:22:33.980352 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:22:33.980352 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:22:33.980352 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:22:33.980352 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:22:33.980352 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:22:33.980352 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 114/223] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 10:22:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:22:33.986351 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752bab74-5b66-4c31-aa15-4ad92fa0cbb7 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:33.986645 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752bab74-5b66-4c31-aa15-4ad92fa0cbb7 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:33.986924 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752bab74-5b66-4c31-aa15-4ad92fa0cbb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:34.005311 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-752bab74-5b66-4c31-aa15-4ad92fa0cbb7 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:22:34.006674 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-752bab74-5b66-4c31-aa15-4ad92fa0cbb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:22:34.051203 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:34.073033 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:34.079023 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 115/224] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:22:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:22:34.080164 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752bab74-5b66-4c31-aa15-4ad92fa0cbb7 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:34.082569 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49482778-73cc-4841-9e70-a90d7e3134c4 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:34.138037 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb0e88-fc62-4708-a569-887ccd756fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:34.138585 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb0e88-fc62-4708-a569-887ccd756fdd None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:34.138869 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb0e88-fc62-4708-a569-887ccd756fdd None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:34.139145 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb0e88-fc62-4708-a569-887ccd756fdd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:34.139979 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb0e88-fc62-4708-a569-887ccd756fdd None admin] RBAC: Adding query filter params (role.id=907cee10dffd48b2bec00719e425d3bd, scope.project.id=cd29577200c54cde8573db439fcbf179, user.id=9d5c61ff2934469b999fff5a1a1ed206) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:34.140309 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb0e88-fc62-4708-a569-887ccd756fdd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:34.141890 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb0e88-fc62-4708-a569-887ccd756fdd None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:34.153640 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 110/225] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 10:22:33 2022] GET /identity/v3/role_assignments?user.id=9d5c61ff2934469b999fff5a1a1ed206&scope.project.id=cd29577200c54cde8573db439fcbf179&role.id=907cee10dffd48b2bec00719e425d3bd => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:34.153640 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb0e88-fc62-4708-a569-887ccd756fdd None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:34.242247 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752bab74-5b66-4c31-aa15-4ad92fa0cbb7 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:34.285313 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88fa8f5-a70e-411f-8ba0-95d80a0f2b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:34.286127 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88fa8f5-a70e-411f-8ba0-95d80a0f2b95 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:34.286471 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88fa8f5-a70e-411f-8ba0-95d80a0f2b95 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:34.286806 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88fa8f5-a70e-411f-8ba0-95d80a0f2b95 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:34.287634 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88fa8f5-a70e-411f-8ba0-95d80a0f2b95 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:34.288004 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88fa8f5-a70e-411f-8ba0-95d80a0f2b95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:34.289488 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88fa8f5-a70e-411f-8ba0-95d80a0f2b95 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:34.300382 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 116/226] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 10:22:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:34.306157 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88fa8f5-a70e-411f-8ba0-95d80a0f2b95 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:34.387548 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:34.390934 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb0e88-fc62-4708-a569-887ccd756fdd None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:34.450697 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88fa8f5-a70e-411f-8ba0-95d80a0f2b95 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:34.488147 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eca642-0382-4a83-8d6e-29f9d45f024e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:34.488978 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eca642-0382-4a83-8d6e-29f9d45f024e None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:34.489302 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eca642-0382-4a83-8d6e-29f9d45f024e None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:34.489583 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eca642-0382-4a83-8d6e-29f9d45f024e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:34.498635 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181fc4c6-862a-45c5-a9bd-ac647cfa640e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:34.499786 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181fc4c6-862a-45c5-a9bd-ac647cfa640e None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:34.500275 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181fc4c6-862a-45c5-a9bd-ac647cfa640e None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:34.500449 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eca642-0382-4a83-8d6e-29f9d45f024e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:22:34.500913 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181fc4c6-862a-45c5-a9bd-ac647cfa640e None admin] PATH_INFO: `/v3/users/ec835a1fbed242e8b6dc4836666eef08` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:34.502898 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181fc4c6-862a-45c5-a9bd-ac647cfa640e None admin] RBAC: Authorizing `identity:get_user(user_id=ec835a1fbed242e8b6dc4836666eef08)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:34.504592 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181fc4c6-862a-45c5-a9bd-ac647cfa640e None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:34.511837 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-a9eca642-0382-4a83-8d6e-29f9d45f024e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 10:22:34.511837 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:22:34.511837 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:22:34.511837 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:22:34.511837 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:22:34.511837 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:22:34.511837 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:22:34.511837 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:22:34.511837 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:22:34.511837 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:22:34.511837 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:22:34.511837 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:22:34.511837 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:22:34.511837 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:22:34.511837 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:22:34.511837 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:22:34.512701 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:22:34.512701 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:22:34.512701 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:22:34.512701 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:22:34.512701 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:22:34.512701 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:22:34.512701 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:22:34.512701 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:22:34.512701 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:22:34.512701 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:22:34.512701 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:22:34.512701 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:22:34.512701 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:22:34.512701 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:22:34.512701 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:22:34.512701 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:22:34.513529 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:22:34.513529 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:22:34.513529 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:22:34.513529 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:22:34.513529 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:22:34.513529 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:22:34.513529 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:22:34.513529 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:22:34.513529 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:22:34.513529 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:22:34.513529 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 10:22:34.513529 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:22:34.513529 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 111/227] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Jul 18 10:22:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:22:34.514956 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 117/228] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 10:22:34 2022] GET /identity/v3/users/ec835a1fbed242e8b6dc4836666eef08 => generated 283 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:34.518385 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181fc4c6-862a-45c5-a9bd-ac647cfa640e None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:34.518664 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eca642-0382-4a83-8d6e-29f9d45f024e None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:34.528910 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:34.676465 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eca642-0382-4a83-8d6e-29f9d45f024e None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:34.727535 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181fc4c6-862a-45c5-a9bd-ac647cfa640e None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:34.745457 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c3286e-e6fc-41ae-af3e-914a3fbafb7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:34.746720 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3286e-e6fc-41ae-af3e-914a3fbafb7b None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:34.747222 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3286e-e6fc-41ae-af3e-914a3fbafb7b None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:34.747701 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3286e-e6fc-41ae-af3e-914a3fbafb7b None admin] PATH_INFO: `/v3/projects/cd29577200c54cde8573db439fcbf179` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:34.749300 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c3286e-e6fc-41ae-af3e-914a3fbafb7b None admin] RBAC: Authorizing `identity:get_project(project_id=cd29577200c54cde8573db439fcbf179)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:34.753168 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c3286e-e6fc-41ae-af3e-914a3fbafb7b None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:34.757306 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 112/229] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 10:22:34 2022] GET /identity/v3/projects/cd29577200c54cde8573db439fcbf179 => generated 302 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:34.766023 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c3286e-e6fc-41ae-af3e-914a3fbafb7b None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:34.781238 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:34.793640 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a870ba7-af9f-4fa0-9f7b-e65ff2f6fbf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:34.794325 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a870ba7-af9f-4fa0-9f7b-e65ff2f6fbf9 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:34.797733 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a870ba7-af9f-4fa0-9f7b-e65ff2f6fbf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:34.797733 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a870ba7-af9f-4fa0-9f7b-e65ff2f6fbf9 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:34.797733 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a870ba7-af9f-4fa0-9f7b-e65ff2f6fbf9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:34.797733 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a870ba7-af9f-4fa0-9f7b-e65ff2f6fbf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:34.797733 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a870ba7-af9f-4fa0-9f7b-e65ff2f6fbf9 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:34.820157 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 118/230] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 10:22:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:34.824791 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a870ba7-af9f-4fa0-9f7b-e65ff2f6fbf9 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:34.932032 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:34.952959 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a870ba7-af9f-4fa0-9f7b-e65ff2f6fbf9 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:34.996676 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c3286e-e6fc-41ae-af3e-914a3fbafb7b None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:35.023446 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d73fb-f428-4c9a-a3f3-dc12e88b7cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:35.025441 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d73fb-f428-4c9a-a3f3-dc12e88b7cc9 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:35.026090 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d73fb-f428-4c9a-a3f3-dc12e88b7cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:35.027598 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d73fb-f428-4c9a-a3f3-dc12e88b7cc9 None admin] PATH_INFO: `/v3/users/ec835a1fbed242e8b6dc4836666eef08` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:35.029834 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3d73fb-f428-4c9a-a3f3-dc12e88b7cc9 None admin] RBAC: Authorizing `identity:get_user(user_id=ec835a1fbed242e8b6dc4836666eef08)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:35.031689 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3d73fb-f428-4c9a-a3f3-dc12e88b7cc9 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:35.036761 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 119/231] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 10:22:34 2022] GET /identity/v3/users/ec835a1fbed242e8b6dc4836666eef08 => generated 283 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:35.043581 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d73fb-f428-4c9a-a3f3-dc12e88b7cc9 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:35.070468 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e3902-3fbe-4026-a41c-ab29dc0ac2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:35.071762 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e3902-3fbe-4026-a41c-ab29dc0ac2f1 None admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:35.072278 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e3902-3fbe-4026-a41c-ab29dc0ac2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:35.073933 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e3902-3fbe-4026-a41c-ab29dc0ac2f1 None admin] PATH_INFO: `/v3/projects/cd29577200c54cde8573db439fcbf179/users/ec835a1fbed242e8b6dc4836666eef08/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:35.078180 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5e3902-3fbe-4026-a41c-ab29dc0ac2f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=cd29577200c54cde8573db439fcbf179, user_id=ec835a1fbed242e8b6dc4836666eef08, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:35.085338 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5e3902-3fbe-4026-a41c-ab29dc0ac2f1 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:35.127798 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:35.174391 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 113/232] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jul 18 10:22:34 2022] PUT /identity/v3/projects/cd29577200c54cde8573db439fcbf179/users/ec835a1fbed242e8b6dc4836666eef08/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:22:35.178635 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d73fb-f428-4c9a-a3f3-dc12e88b7cc9 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:35.218765 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38da65ea-0b5c-4b2f-8655-6947465e908e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:35.220101 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da65ea-0b5c-4b2f-8655-6947465e908e None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:35.220765 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da65ea-0b5c-4b2f-8655-6947465e908e None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:35.221466 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da65ea-0b5c-4b2f-8655-6947465e908e None admin] PATH_INFO: `/v3/projects/cd29577200c54cde8573db439fcbf179` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:35.223002 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38da65ea-0b5c-4b2f-8655-6947465e908e None admin] RBAC: Authorizing `identity:get_project(project_id=cd29577200c54cde8573db439fcbf179)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:35.224787 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38da65ea-0b5c-4b2f-8655-6947465e908e None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:35.227137 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 120/233] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 10:22:35 2022] GET /identity/v3/projects/cd29577200c54cde8573db439fcbf179 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:35.233199 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e3902-3fbe-4026-a41c-ab29dc0ac2f1 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:35.384476 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e3902-3fbe-4026-a41c-ab29dc0ac2f1 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:35.419093 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:35.427381 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1426b189-1ff0-43c9-9ceb-b0adb528ffd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:35.430048 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426b189-1ff0-43c9-9ceb-b0adb528ffd2 None admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:35.430048 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426b189-1ff0-43c9-9ceb-b0adb528ffd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:35.430048 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1426b189-1ff0-43c9-9ceb-b0adb528ffd2 None admin] PATH_INFO: `/v3/projects/cd29577200c54cde8573db439fcbf179/users/ec835a1fbed242e8b6dc4836666eef08/roles/45f8992b0f6941c7a64290b437d6bd5e` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:35.432025 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1426b189-1ff0-43c9-9ceb-b0adb528ffd2 None admin] RBAC: Authorizing `identity:create_grant(project_id=cd29577200c54cde8573db439fcbf179, user_id=ec835a1fbed242e8b6dc4836666eef08, role_id=45f8992b0f6941c7a64290b437d6bd5e)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:35.433796 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1426b189-1ff0-43c9-9ceb-b0adb528ffd2 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:35.620334 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 114/234] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jul 18 10:22:35 2022] PUT /identity/v3/projects/cd29577200c54cde8573db439fcbf179/users/ec835a1fbed242e8b6dc4836666eef08/roles/45f8992b0f6941c7a64290b437d6bd5e => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:22:35.824695 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034b311-efe5-4625-b885-3935a88f8bcf None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:35.825706 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034b311-efe5-4625-b885-3935a88f8bcf None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:35.826194 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034b311-efe5-4625-b885-3935a88f8bcf None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:35.827898 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 121/235] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:22:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:22:35.830180 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2748b9-f922-4434-80f2-6fe8461ee8cb None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:35.830700 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2748b9-f922-4434-80f2-6fe8461ee8cb None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:35.831166 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2748b9-f922-4434-80f2-6fe8461ee8cb None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:35.832698 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 115/236] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:22:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:22:35.834519 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c389e7-68f6-4938-89d8-88bcc2e82872 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:35.834519 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c389e7-68f6-4938-89d8-88bcc2e82872 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:35.834519 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c389e7-68f6-4938-89d8-88bcc2e82872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:35.840696 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a728555-8999-4f1e-8617-34fdf9d93615 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:35.840696 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a728555-8999-4f1e-8617-34fdf9d93615 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:35.840916 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a728555-8999-4f1e-8617-34fdf9d93615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:35.852536 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-c4c389e7-68f6-4938-89d8-88bcc2e82872 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:22:35.853763 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c4c389e7-68f6-4938-89d8-88bcc2e82872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:22:35.864975 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-8a728555-8999-4f1e-8617-34fdf9d93615 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:22:35.866841 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-8a728555-8999-4f1e-8617-34fdf9d93615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:22:35.947220 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 122/237] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:22:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 10:22:35.949030 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 116/238] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:22:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 10:22:35.960239 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c389e7-68f6-4938-89d8-88bcc2e82872 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:35.979402 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a728555-8999-4f1e-8617-34fdf9d93615 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:36.061335 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:36.147036 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c389e7-68f6-4938-89d8-88bcc2e82872 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:36.200324 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a728555-8999-4f1e-8617-34fdf9d93615 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:36.225418 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:36.237075 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0da4738-e729-42e0-a154-c7100f5a22e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:36.244702 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da4738-e729-42e0-a154-c7100f5a22e9 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:36.244702 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da4738-e729-42e0-a154-c7100f5a22e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:36.244702 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da4738-e729-42e0-a154-c7100f5a22e9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:36.249767 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a53569-f30e-4a46-93b3-98fe133d46cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:36.250600 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a53569-f30e-4a46-93b3-98fe133d46cf None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:36.250869 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0da4738-e729-42e0-a154-c7100f5a22e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:22:36.250978 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a53569-f30e-4a46-93b3-98fe133d46cf None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:36.251668 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a53569-f30e-4a46-93b3-98fe133d46cf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:36.257786 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a53569-f30e-4a46-93b3-98fe133d46cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:36.259258 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a53569-f30e-4a46-93b3-98fe133d46cf None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:36.260112 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-e0da4738-e729-42e0-a154-c7100f5a22e9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 10:22:36.260112 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:22:36.260112 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:22:36.260112 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:22:36.260112 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:22:36.260112 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:22:36.260112 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:22:36.260112 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:22:36.260112 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:22:36.260112 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:22:36.260112 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:22:36.260112 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:22:36.260112 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:22:36.260112 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:22:36.260112 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:22:36.260112 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:22:36.261159 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:22:36.261159 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:22:36.261159 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:22:36.261159 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:22:36.261159 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:22:36.261159 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:22:36.261159 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:22:36.261159 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:22:36.261159 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:22:36.261159 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:22:36.261159 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:22:36.261159 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:22:36.261159 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:22:36.261159 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:22:36.261159 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:22:36.261159 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:22:36.262125 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:22:36.262125 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:22:36.262125 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:22:36.262125 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:22:36.262125 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:22:36.262125 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:22:36.262125 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:22:36.262125 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:22:36.262125 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:22:36.262125 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:22:36.262125 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 10:22:36.262125 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:22:36.262827 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 123/239] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:22:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:36.264542 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 117/240] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 10:22:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:22:36.270140 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a53569-f30e-4a46-93b3-98fe133d46cf None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:36.271312 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0da4738-e729-42e0-a154-c7100f5a22e9 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:36.377792 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0da4738-e729-42e0-a154-c7100f5a22e9 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:36.413547 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029d747-4e5a-47d6-8e54-66c0e360534a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:36.414595 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029d747-4e5a-47d6-8e54-66c0e360534a None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:36.415098 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029d747-4e5a-47d6-8e54-66c0e360534a None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:36.415566 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029d747-4e5a-47d6-8e54-66c0e360534a None admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:36.416481 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6029d747-4e5a-47d6-8e54-66c0e360534a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:36.416930 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6029d747-4e5a-47d6-8e54-66c0e360534a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:36.418482 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6029d747-4e5a-47d6-8e54-66c0e360534a None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:36.426013 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a53569-f30e-4a46-93b3-98fe133d46cf None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:36.436237 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 118/241] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jul 18 10:22:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:22:36.442502 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029d747-4e5a-47d6-8e54-66c0e360534a None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:36.473487 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:36.491437 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a5339-07fd-4939-80dc-191e51afb968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:36.492908 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a5339-07fd-4939-80dc-191e51afb968 None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:36.493721 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a5339-07fd-4939-80dc-191e51afb968 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:36.494346 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a5339-07fd-4939-80dc-191e51afb968 None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:36.496342 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17a5339-07fd-4939-80dc-191e51afb968 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:36.503565 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17a5339-07fd-4939-80dc-191e51afb968 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:36.514911 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:36.574240 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029d747-4e5a-47d6-8e54-66c0e360534a None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:36.611263 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d9c1e-1f18-417a-a43c-cf77aa3d9bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:36.612210 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d9c1e-1f18-417a-a43c-cf77aa3d9bd8 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:36.612494 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d9c1e-1f18-417a-a43c-cf77aa3d9bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:36.612772 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d9c1e-1f18-417a-a43c-cf77aa3d9bd8 None admin] PATH_INFO: `/v3/users/fe3387fce9ea47c9b0d1feb6320046e8` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:36.627565 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00d9c1e-1f18-417a-a43c-cf77aa3d9bd8 None admin] RBAC: Authorizing `identity:get_user(user_id=fe3387fce9ea47c9b0d1feb6320046e8)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:36.629035 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00d9c1e-1f18-417a-a43c-cf77aa3d9bd8 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:36.631076 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 119/242] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 10:22:36 2022] GET /identity/v3/users/fe3387fce9ea47c9b0d1feb6320046e8 => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:22:36.636234 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d9c1e-1f18-417a-a43c-cf77aa3d9bd8 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:36.651976 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 124/243] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Jul 18 10:22:36 2022] POST /identity/v3/users => generated 293 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:22:36.730186 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b77e11-e977-4714-847f-3ec695ab2d28 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:36.730526 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b77e11-e977-4714-847f-3ec695ab2d28 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:36.730722 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b77e11-e977-4714-847f-3ec695ab2d28 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:36.732322 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 125/244] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:22:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:22:36.738279 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936b5da-24ce-48b6-8e02-4331be2cc1ea None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:36.738578 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936b5da-24ce-48b6-8e02-4331be2cc1ea None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:36.738826 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936b5da-24ce-48b6-8e02-4331be2cc1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:36.758009 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-c936b5da-24ce-48b6-8e02-4331be2cc1ea None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:22:36.759250 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c936b5da-24ce-48b6-8e02-4331be2cc1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:22:36.796520 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:36.800994 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d9c1e-1f18-417a-a43c-cf77aa3d9bd8 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:36.845616 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 126/245] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:22:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:22:36.866625 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c936b5da-24ce-48b6-8e02-4331be2cc1ea None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:36.890848 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5972b40e-fb90-410b-98de-d0030e4b9a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:36.891531 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972b40e-fb90-410b-98de-d0030e4b9a38 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:36.891852 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972b40e-fb90-410b-98de-d0030e4b9a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:36.892132 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972b40e-fb90-410b-98de-d0030e4b9a38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:37.001480 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5972b40e-fb90-410b-98de-d0030e4b9a38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:37.003175 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5972b40e-fb90-410b-98de-d0030e4b9a38 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:37.011855 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c936b5da-24ce-48b6-8e02-4331be2cc1ea None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:37.041411 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:37.062311 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b2b789-1949-4fa4-85b8-91c41ddec339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:37.063137 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b2b789-1949-4fa4-85b8-91c41ddec339 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:37.063417 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b2b789-1949-4fa4-85b8-91c41ddec339 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:37.063768 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b2b789-1949-4fa4-85b8-91c41ddec339 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:37.077862 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b2b789-1949-4fa4-85b8-91c41ddec339 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:22:37.088593 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-93b2b789-1949-4fa4-85b8-91c41ddec339 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:22:37.088593 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:22:37.088593 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:22:37.088593 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:22:37.088593 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:22:37.088593 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:22:37.088593 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:22:37.088593 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:22:37.088593 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:22:37.088593 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:22:37.088593 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:22:37.088593 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:22:37.088593 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:22:37.088593 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:22:37.088593 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:22:37.088593 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:22:37.089514 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:22:37.089514 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:22:37.089514 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:22:37.089514 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:22:37.089514 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:22:37.089514 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:22:37.089514 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:22:37.089514 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:22:37.089514 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:22:37.089514 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:22:37.089514 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:22:37.089514 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:22:37.089514 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:22:37.089514 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:22:37.089514 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:22:37.089514 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:22:37.090297 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:22:37.090297 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:22:37.090297 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:22:37.090297 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:22:37.090297 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:22:37.090297 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:22:37.090297 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:22:37.090297 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:22:37.090297 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:22:37.090297 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:22:37.090297 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:22:37.090297 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:22:37.093844 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 127/246] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 10:22:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:22:37.104194 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b2b789-1949-4fa4-85b8-91c41ddec339 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:37.169090 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:37.175760 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 120/247] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 10:22:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 18 10:22:37.181273 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5972b40e-fb90-410b-98de-d0030e4b9a38 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:37.224554 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b2b789-1949-4fa4-85b8-91c41ddec339 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:37.276815 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d455de-2564-484a-ae31-080f6a29eeac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:37.276815 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d455de-2564-484a-ae31-080f6a29eeac None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:37.277244 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d455de-2564-484a-ae31-080f6a29eeac None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:37.277427 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d455de-2564-484a-ae31-080f6a29eeac None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:37.278186 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d455de-2564-484a-ae31-080f6a29eeac None admin] RBAC: Adding query filter params (name=member) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:37.279401 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d455de-2564-484a-ae31-080f6a29eeac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:37.280811 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d455de-2564-484a-ae31-080f6a29eeac None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:37.298773 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 128/248] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jul 18 10:22:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:37.298773 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d455de-2564-484a-ae31-080f6a29eeac None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:37.321655 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5972b40e-fb90-410b-98de-d0030e4b9a38 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:37.342307 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:37.363924 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e0e2f-2014-4e58-a3d8-df48ef577513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:37.365205 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e0e2f-2014-4e58-a3d8-df48ef577513 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:37.367218 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e0e2f-2014-4e58-a3d8-df48ef577513 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:37.367764 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6e0e2f-2014-4e58-a3d8-df48ef577513 None admin] PATH_INFO: `/v3/projects/cd29577200c54cde8573db439fcbf179` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:37.369277 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6e0e2f-2014-4e58-a3d8-df48ef577513 None admin] RBAC: Authorizing `identity:get_project(project_id=cd29577200c54cde8573db439fcbf179)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:37.370917 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6e0e2f-2014-4e58-a3d8-df48ef577513 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:37.372877 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 121/249] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 10:22:37 2022] GET /identity/v3/projects/cd29577200c54cde8573db439fcbf179 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:22:37.380933 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e0e2f-2014-4e58-a3d8-df48ef577513 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:37.426243 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d455de-2564-484a-ae31-080f6a29eeac None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:37.468446 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c796ee-60c4-4e1b-806f-afe75ce09af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:37.469345 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c796ee-60c4-4e1b-806f-afe75ce09af1 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:37.469624 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c796ee-60c4-4e1b-806f-afe75ce09af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:37.470675 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c796ee-60c4-4e1b-806f-afe75ce09af1 None admin] PATH_INFO: `/v3/users/9d5c61ff2934469b999fff5a1a1ed206` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:37.471905 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c796ee-60c4-4e1b-806f-afe75ce09af1 None admin] RBAC: Authorizing `identity:get_user(user_id=9d5c61ff2934469b999fff5a1a1ed206)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:37.473538 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c796ee-60c4-4e1b-806f-afe75ce09af1 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:37.475486 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 129/250] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 10:22:37 2022] GET /identity/v3/users/9d5c61ff2934469b999fff5a1a1ed206 => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:37.481375 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c796ee-60c4-4e1b-806f-afe75ce09af1 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:37.498671 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:37.559977 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6e0e2f-2014-4e58-a3d8-df48ef577513 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:37.598964 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:37.606465 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c796ee-60c4-4e1b-806f-afe75ce09af1 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:37.636218 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e500b-7508-4b63-b165-b815ee810ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:37.636888 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e500b-7508-4b63-b165-b815ee810ab3 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:37.637196 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e500b-7508-4b63-b165-b815ee810ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:37.637473 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e500b-7508-4b63-b165-b815ee810ab3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:37.638310 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e500b-7508-4b63-b165-b815ee810ab3 None admin] RBAC: Adding query filter params (role.id=c2ae722a355f4d73b11124bcf553fe8c, scope.project.id=cd29577200c54cde8573db439fcbf179, user.id=fe3387fce9ea47c9b0d1feb6320046e8) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:37.638619 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e500b-7508-4b63-b165-b815ee810ab3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:37.640057 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e500b-7508-4b63-b165-b815ee810ab3 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:37.657125 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 122/251] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 10:22:37 2022] GET /identity/v3/role_assignments?user.id=fe3387fce9ea47c9b0d1feb6320046e8&scope.project.id=cd29577200c54cde8573db439fcbf179&role.id=c2ae722a355f4d73b11124bcf553fe8c => generated 259 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:37.673989 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980cb05c-3211-4d46-8619-daa44197358e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:37.674866 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980cb05c-3211-4d46-8619-daa44197358e None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:37.675145 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980cb05c-3211-4d46-8619-daa44197358e None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:37.675415 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980cb05c-3211-4d46-8619-daa44197358e None admin] PATH_INFO: `/v3/projects/cd29577200c54cde8573db439fcbf179` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:37.676621 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980cb05c-3211-4d46-8619-daa44197358e None admin] RBAC: Authorizing `identity:get_project(project_id=cd29577200c54cde8573db439fcbf179)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:37.682169 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980cb05c-3211-4d46-8619-daa44197358e None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:37.684251 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 130/252] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 10:22:37 2022] GET /identity/v3/projects/cd29577200c54cde8573db439fcbf179 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:37.690900 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e500b-7508-4b63-b165-b815ee810ab3 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:37.831564 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e500b-7508-4b63-b165-b815ee810ab3 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:37.846446 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132cb45-ab0a-4218-8473-efbc20bc71fe None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:37.846955 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132cb45-ab0a-4218-8473-efbc20bc71fe None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:37.847028 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132cb45-ab0a-4218-8473-efbc20bc71fe None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:37.848703 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 131/253] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:22:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:22:37.854736 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0d1e7-d9b3-42df-9121-2f229cea0ee3 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:37.855013 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0d1e7-d9b3-42df-9121-2f229cea0ee3 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:37.855286 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0d1e7-d9b3-42df-9121-2f229cea0ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:37.885249 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:37.890540 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-efb0d1e7-d9b3-42df-9121-2f229cea0ee3 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:22:37.891857 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-efb0d1e7-d9b3-42df-9121-2f229cea0ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:22:37.896563 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c077fc85-93cd-4706-a859-0d12f9557c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:37.897502 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077fc85-93cd-4706-a859-0d12f9557c91 None admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:37.897785 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077fc85-93cd-4706-a859-0d12f9557c91 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:37.898058 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077fc85-93cd-4706-a859-0d12f9557c91 None admin] PATH_INFO: `/v3/projects/cd29577200c54cde8573db439fcbf179/users/9d5c61ff2934469b999fff5a1a1ed206/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:37.900135 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c077fc85-93cd-4706-a859-0d12f9557c91 None admin] RBAC: Authorizing `identity:create_grant(project_id=cd29577200c54cde8573db439fcbf179, user_id=9d5c61ff2934469b999fff5a1a1ed206, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:37.901613 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c077fc85-93cd-4706-a859-0d12f9557c91 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:37.974064 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 123/254] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jul 18 10:22:37 2022] PUT /identity/v3/projects/cd29577200c54cde8573db439fcbf179/users/9d5c61ff2934469b999fff5a1a1ed206/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:22:37.999097 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 132/255] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:22:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:22:38.023615 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c077fc85-93cd-4706-a859-0d12f9557c91 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:38.202396 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c077fc85-93cd-4706-a859-0d12f9557c91 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:38.215135 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd9dc1-7823-4ebe-91dc-86c7fb271170 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:38.215135 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd9dc1-7823-4ebe-91dc-86c7fb271170 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:38.215135 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd9dc1-7823-4ebe-91dc-86c7fb271170 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:38.215135 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 133/256] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:22:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:22:38.217018 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ecb20f-49a0-42a6-b5b3-0d34be652116 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:38.217726 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ecb20f-49a0-42a6-b5b3-0d34be652116 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:38.218399 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ecb20f-49a0-42a6-b5b3-0d34be652116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:38.249722 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-a6ecb20f-49a0-42a6-b5b3-0d34be652116 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:22:38.251521 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-a6ecb20f-49a0-42a6-b5b3-0d34be652116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:22:38.274287 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed320f3-1162-46c2-b07e-80b6928da5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:38.275101 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed320f3-1162-46c2-b07e-80b6928da5e9 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:38.275384 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed320f3-1162-46c2-b07e-80b6928da5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:38.275659 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed320f3-1162-46c2-b07e-80b6928da5e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:38.304566 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed320f3-1162-46c2-b07e-80b6928da5e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:22:38.312725 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-1ed320f3-1162-46c2-b07e-80b6928da5e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:22:38.312725 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:22:38.312725 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:22:38.312725 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:22:38.312725 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:22:38.312725 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:22:38.312725 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:22:38.312725 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:22:38.312725 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:22:38.312725 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:22:38.312725 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:22:38.312725 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:22:38.312725 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:22:38.312725 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:22:38.312725 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:22:38.312725 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:22:38.313675 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:22:38.313675 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:22:38.313675 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:22:38.313675 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:22:38.313675 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:22:38.313675 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:22:38.313675 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:22:38.313675 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:22:38.313675 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:22:38.313675 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:22:38.313675 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:22:38.313675 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:22:38.313675 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:22:38.313675 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:22:38.313675 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:22:38.313675 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:22:38.315143 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:22:38.315143 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:22:38.315143 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:22:38.315143 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:22:38.315143 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:22:38.315143 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:22:38.315143 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:22:38.315143 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:22:38.315143 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:22:38.315143 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:22:38.315143 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:22:38.315143 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:22:38.318832 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 124/257] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 10:22:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:22:38.325291 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed320f3-1162-46c2-b07e-80b6928da5e9 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:38.400048 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 134/258] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:22:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:22:38.403215 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:38.431167 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ecb20f-49a0-42a6-b5b3-0d34be652116 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:38.475065 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:38.479756 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed320f3-1162-46c2-b07e-80b6928da5e9 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:38.540173 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a7394f-e6cc-4b16-9e4a-34f9ba79a5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:38.540861 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7394f-e6cc-4b16-9e4a-34f9ba79a5b7 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:38.541191 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7394f-e6cc-4b16-9e4a-34f9ba79a5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:38.541474 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7394f-e6cc-4b16-9e4a-34f9ba79a5b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:38.542243 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a7394f-e6cc-4b16-9e4a-34f9ba79a5b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:38.542618 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a7394f-e6cc-4b16-9e4a-34f9ba79a5b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:38.544078 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a7394f-e6cc-4b16-9e4a-34f9ba79a5b7 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:38.559602 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 125/259] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 10:22:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:22:38.565980 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a7394f-e6cc-4b16-9e4a-34f9ba79a5b7 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:38.619212 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ecb20f-49a0-42a6-b5b3-0d34be652116 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:38.704087 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a7394f-e6cc-4b16-9e4a-34f9ba79a5b7 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:38.726452 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca6286a-62b7-4b8b-9b2e-3116852002be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:38.727341 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6286a-62b7-4b8b-9b2e-3116852002be None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:38.727566 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6286a-62b7-4b8b-9b2e-3116852002be None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:38.727845 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6286a-62b7-4b8b-9b2e-3116852002be None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:38.729436 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:38.742253 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332541d7-d67a-41a3-9ccd-558141527d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:38.743671 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332541d7-d67a-41a3-9ccd-558141527d5b None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:38.744112 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332541d7-d67a-41a3-9ccd-558141527d5b None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:38.744540 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332541d7-d67a-41a3-9ccd-558141527d5b None admin] PATH_INFO: `/v3/users/ec835a1fbed242e8b6dc4836666eef08` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:38.745923 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332541d7-d67a-41a3-9ccd-558141527d5b None admin] RBAC: Authorizing `identity:get_user(user_id=ec835a1fbed242e8b6dc4836666eef08)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:38.753225 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332541d7-d67a-41a3-9ccd-558141527d5b None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:38.753225 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 126/260] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 10:22:38 2022] GET /identity/v3/users/ec835a1fbed242e8b6dc4836666eef08 => generated 283 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:22:38.755891 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332541d7-d67a-41a3-9ccd-558141527d5b None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:38.765683 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca6286a-62b7-4b8b-9b2e-3116852002be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:22:38.774703 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-dca6286a-62b7-4b8b-9b2e-3116852002be None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 10:22:38.774703 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:22:38.774703 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:22:38.774703 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:22:38.774703 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:22:38.774703 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:22:38.774703 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:22:38.774703 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:22:38.774703 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:22:38.774703 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:22:38.774703 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:22:38.774703 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:22:38.774703 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:22:38.774703 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:22:38.774703 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:22:38.774703 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:22:38.775608 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:22:38.775608 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:22:38.775608 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:22:38.775608 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:22:38.775608 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:22:38.775608 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:22:38.775608 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:22:38.775608 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:22:38.775608 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:22:38.775608 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:22:38.775608 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:22:38.775608 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:22:38.775608 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:22:38.775608 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:22:38.775608 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:22:38.775608 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:22:38.776383 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:22:38.776383 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:22:38.776383 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:22:38.776383 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:22:38.776383 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:22:38.776383 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:22:38.776383 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:22:38.776383 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:22:38.776383 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:22:38.776383 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:22:38.776383 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 10:22:38.776383 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:22:38.781195 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 135/261] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Jul 18 10:22:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:22:38.790021 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca6286a-62b7-4b8b-9b2e-3116852002be None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:38.872285 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332541d7-d67a-41a3-9ccd-558141527d5b None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:38.907420 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc921f-745e-4454-9f53-f2bc26161e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:38.908939 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc921f-745e-4454-9f53-f2bc26161e80 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:38.909483 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc921f-745e-4454-9f53-f2bc26161e80 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:38.910146 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc921f-745e-4454-9f53-f2bc26161e80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:38.960089 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:38.965467 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:38.986821 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dc921f-745e-4454-9f53-f2bc26161e80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:38.988410 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca6286a-62b7-4b8b-9b2e-3116852002be None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:38.988875 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dc921f-745e-4454-9f53-f2bc26161e80 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:39.101478 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 127/262] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 10:22:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 18 10:22:39.110324 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc921f-745e-4454-9f53-f2bc26161e80 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:39.116356 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb5f190-bf08-4f54-bffa-01bc6f861da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:39.117067 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5f190-bf08-4f54-bffa-01bc6f861da0 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:39.117365 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5f190-bf08-4f54-bffa-01bc6f861da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:39.117629 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5f190-bf08-4f54-bffa-01bc6f861da0 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:39.118392 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb5f190-bf08-4f54-bffa-01bc6f861da0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:39.118703 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb5f190-bf08-4f54-bffa-01bc6f861da0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:39.125077 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb5f190-bf08-4f54-bffa-01bc6f861da0 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:39.163383 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 136/263] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 10:22:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:39.169980 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb5f190-bf08-4f54-bffa-01bc6f861da0 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:39.277416 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:39.290213 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc921f-745e-4454-9f53-f2bc26161e80 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:39.368179 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36eec12-8a55-4371-90aa-b50175d2e164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:39.369070 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36eec12-8a55-4371-90aa-b50175d2e164 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:39.369353 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36eec12-8a55-4371-90aa-b50175d2e164 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:39.369627 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36eec12-8a55-4371-90aa-b50175d2e164 None admin] PATH_INFO: `/v3/projects/cd29577200c54cde8573db439fcbf179` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:39.371004 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36eec12-8a55-4371-90aa-b50175d2e164 None admin] RBAC: Authorizing `identity:get_project(project_id=cd29577200c54cde8573db439fcbf179)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:39.372447 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36eec12-8a55-4371-90aa-b50175d2e164 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:39.374406 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 128/264] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 10:22:39 2022] GET /identity/v3/projects/cd29577200c54cde8573db439fcbf179 => generated 302 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:22:39.381591 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36eec12-8a55-4371-90aa-b50175d2e164 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:39.386335 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb5f190-bf08-4f54-bffa-01bc6f861da0 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:39.466305 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d2950-b435-46b3-b480-a0dcbf068bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:39.467257 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d2950-b435-46b3-b480-a0dcbf068bcb None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:39.467542 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d2950-b435-46b3-b480-a0dcbf068bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:39.467820 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d2950-b435-46b3-b480-a0dcbf068bcb None admin] PATH_INFO: `/v3/users/ec835a1fbed242e8b6dc4836666eef08` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:39.473794 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14d2950-b435-46b3-b480-a0dcbf068bcb None admin] RBAC: Authorizing `identity:get_user(user_id=ec835a1fbed242e8b6dc4836666eef08)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:39.475264 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14d2950-b435-46b3-b480-a0dcbf068bcb None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:39.477287 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 137/265] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 10:22:39 2022] GET /identity/v3/users/ec835a1fbed242e8b6dc4836666eef08 => generated 283 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:39.482211 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d2950-b435-46b3-b480-a0dcbf068bcb None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:39.509851 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36eec12-8a55-4371-90aa-b50175d2e164 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:39.535719 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:39.550143 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254dd492-b740-4cc6-ba9b-44322084b968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:39.550938 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254dd492-b740-4cc6-ba9b-44322084b968 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:39.551229 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254dd492-b740-4cc6-ba9b-44322084b968 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:39.551503 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254dd492-b740-4cc6-ba9b-44322084b968 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:39.552338 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254dd492-b740-4cc6-ba9b-44322084b968 None admin] RBAC: Adding query filter params (role.id=e7b6a55ecf6c491487955aaefbf9c388, scope.project.id=cd29577200c54cde8573db439fcbf179, user.id=ec835a1fbed242e8b6dc4836666eef08) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:39.552645 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254dd492-b740-4cc6-ba9b-44322084b968 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:39.554125 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254dd492-b740-4cc6-ba9b-44322084b968 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:39.560513 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 129/266] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 10:22:39 2022] GET /identity/v3/role_assignments?user.id=ec835a1fbed242e8b6dc4836666eef08&scope.project.id=cd29577200c54cde8573db439fcbf179&role.id=e7b6a55ecf6c491487955aaefbf9c388 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:39.647608 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d2950-b435-46b3-b480-a0dcbf068bcb None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:39.692554 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db9c69e-7594-4c0e-892f-50745c945f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:39.693249 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db9c69e-7594-4c0e-892f-50745c945f3c None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:39.693532 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db9c69e-7594-4c0e-892f-50745c945f3c None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:39.693805 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db9c69e-7594-4c0e-892f-50745c945f3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:39.788782 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db9c69e-7594-4c0e-892f-50745c945f3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:39.790235 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db9c69e-7594-4c0e-892f-50745c945f3c None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:39.821647 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:39.912441 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 138/267] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 10:22:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:22:39.917857 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254dd492-b740-4cc6-ba9b-44322084b968 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:39.941783 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:40.044106 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254dd492-b740-4cc6-ba9b-44322084b968 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:40.098190 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40882a6-1fe8-4da3-ab24-982408cd24aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:40.099519 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40882a6-1fe8-4da3-ab24-982408cd24aa None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:40.099785 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40882a6-1fe8-4da3-ab24-982408cd24aa None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:40.100055 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40882a6-1fe8-4da3-ab24-982408cd24aa None admin] PATH_INFO: `/v3/projects/cd29577200c54cde8573db439fcbf179` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:40.105788 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40882a6-1fe8-4da3-ab24-982408cd24aa None admin] RBAC: Authorizing `identity:get_project(project_id=cd29577200c54cde8573db439fcbf179)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:40.107269 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40882a6-1fe8-4da3-ab24-982408cd24aa None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:40.109317 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 130/268] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 10:22:39 2022] GET /identity/v3/projects/cd29577200c54cde8573db439fcbf179 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:40.114889 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db9c69e-7594-4c0e-892f-50745c945f3c None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:40.240984 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db9c69e-7594-4c0e-892f-50745c945f3c None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:40.261377 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:40.284259 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a305539-8a38-4f4d-bb27-fdd2fd4d7a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:40.284932 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a305539-8a38-4f4d-bb27-fdd2fd4d7a2d None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:40.285239 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a305539-8a38-4f4d-bb27-fdd2fd4d7a2d None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:40.285517 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a305539-8a38-4f4d-bb27-fdd2fd4d7a2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:40.286351 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a305539-8a38-4f4d-bb27-fdd2fd4d7a2d None admin] RBAC: Adding query filter params (role.id=45f8992b0f6941c7a64290b437d6bd5e, scope.project.id=cd29577200c54cde8573db439fcbf179, user.id=ec835a1fbed242e8b6dc4836666eef08) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:40.286709 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a305539-8a38-4f4d-bb27-fdd2fd4d7a2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:40.288147 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a305539-8a38-4f4d-bb27-fdd2fd4d7a2d None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:40.302009 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 139/269] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 10:22:40 2022] GET /identity/v3/role_assignments?user.id=ec835a1fbed242e8b6dc4836666eef08&scope.project.id=cd29577200c54cde8573db439fcbf179&role.id=45f8992b0f6941c7a64290b437d6bd5e => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:40.354360 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a1cc6-5f6d-42d7-86ff-a8d13838dc20 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:40.354685 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a1cc6-5f6d-42d7-86ff-a8d13838dc20 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:40.354911 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a1cc6-5f6d-42d7-86ff-a8d13838dc20 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:40.356315 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 131/270] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:22:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:22:40.364422 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c37f0-9fe1-461d-8e1e-4712e0395e64 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:40.364731 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c37f0-9fe1-461d-8e1e-4712e0395e64 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:40.364972 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c37f0-9fe1-461d-8e1e-4712e0395e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:40.384859 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-060c37f0-9fe1-461d-8e1e-4712e0395e64 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:22:40.386114 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-060c37f0-9fe1-461d-8e1e-4712e0395e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:22:40.463032 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 140/271] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:22:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:22:40.488050 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f004e1-e695-4c2a-98ac-42aa4b64a1de None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:40.488356 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f004e1-e695-4c2a-98ac-42aa4b64a1de None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:40.488611 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f004e1-e695-4c2a-98ac-42aa4b64a1de None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:40.490135 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c37f0-9fe1-461d-8e1e-4712e0395e64 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:40.490297 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 132/272] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:22:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:22:40.498283 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340658c4-8d7b-4559-9ad4-1e0c35bc563c None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:40.498651 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340658c4-8d7b-4559-9ad4-1e0c35bc563c None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:40.498998 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340658c4-8d7b-4559-9ad4-1e0c35bc563c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:40.531187 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-340658c4-8d7b-4559-9ad4-1e0c35bc563c None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:22:40.535926 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-340658c4-8d7b-4559-9ad4-1e0c35bc563c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:22:40.649553 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c37f0-9fe1-461d-8e1e-4712e0395e64 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:40.655318 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 133/273] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:22:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 10:22:40.680530 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:40.682698 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340658c4-8d7b-4559-9ad4-1e0c35bc563c None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:40.687582 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667bc892-fb66-4d23-907b-6cb1b0ec25d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:40.688948 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bc892-fb66-4d23-907b-6cb1b0ec25d1 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:40.698446 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bc892-fb66-4d23-907b-6cb1b0ec25d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:40.698446 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bc892-fb66-4d23-907b-6cb1b0ec25d1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:40.698446 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667bc892-fb66-4d23-907b-6cb1b0ec25d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:40.698446 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667bc892-fb66-4d23-907b-6cb1b0ec25d1 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:40.698446 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 141/274] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:22:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:40.706974 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:40.708845 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667bc892-fb66-4d23-907b-6cb1b0ec25d1 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:40.823462 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340658c4-8d7b-4559-9ad4-1e0c35bc563c None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:40.832605 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667bc892-fb66-4d23-907b-6cb1b0ec25d1 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:40.858131 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36228b0a-a378-4312-84d0-5d622c743d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:40.858928 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36228b0a-a378-4312-84d0-5d622c743d60 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:40.859206 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36228b0a-a378-4312-84d0-5d622c743d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:40.859480 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36228b0a-a378-4312-84d0-5d622c743d60 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:40.868744 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd52af22-ee67-4c00-b1d0-93cf8682559c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:40.869442 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd52af22-ee67-4c00-b1d0-93cf8682559c None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:40.869720 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd52af22-ee67-4c00-b1d0-93cf8682559c None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:40.869991 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd52af22-ee67-4c00-b1d0-93cf8682559c None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:40.870136 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36228b0a-a378-4312-84d0-5d622c743d60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:22:40.870688 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd52af22-ee67-4c00-b1d0-93cf8682559c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:40.872116 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd52af22-ee67-4c00-b1d0-93cf8682559c None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:40.878697 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-36228b0a-a378-4312-84d0-5d622c743d60 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:22:40.878697 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:22:40.878697 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:22:40.878697 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:22:40.878697 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:22:40.878697 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:22:40.878697 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:22:40.878697 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:22:40.878697 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:22:40.878697 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:22:40.878697 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:22:40.878697 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:22:40.878697 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:22:40.878697 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:22:40.878697 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:22:40.878697 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:22:40.879711 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:22:40.879711 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:22:40.879711 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:22:40.879711 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:22:40.879711 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:22:40.879711 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:22:40.879711 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:22:40.879711 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:22:40.879711 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:22:40.879711 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:22:40.879711 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:22:40.879711 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:22:40.879711 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:22:40.879711 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:22:40.879711 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:22:40.879711 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:22:40.880494 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:22:40.880494 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:22:40.880494 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:22:40.880494 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:22:40.880494 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:22:40.880494 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:22:40.880494 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:22:40.880494 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:22:40.880494 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:22:40.880494 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:22:40.880494 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:22:40.880494 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:22:40.880494 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 134/275] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 10:22:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:22:40.882880 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974bad15-000e-4114-9c2a-da911badc719 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:40.883203 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974bad15-000e-4114-9c2a-da911badc719 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:40.883594 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974bad15-000e-4114-9c2a-da911badc719 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:40.885065 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 135/276] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:22:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:22:40.886222 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec850242-aa32-40be-9354-0c0d01fef747 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:40.886519 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec850242-aa32-40be-9354-0c0d01fef747 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:40.886790 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec850242-aa32-40be-9354-0c0d01fef747 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:40.887984 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 136/277] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:22:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:22:40.889295 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec850242-aa32-40be-9354-0c0d01fef747 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:40.927582 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 142/278] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Jul 18 10:22:40 2022] POST /identity/v3/users => generated 293 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:22:40.928769 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2260ea3-c570-4631-bd98-9c2e26b54fc3 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:40.929080 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2260ea3-c570-4631-bd98-9c2e26b54fc3 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:40.929365 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2260ea3-c570-4631-bd98-9c2e26b54fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:40.948547 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-a2260ea3-c570-4631-bd98-9c2e26b54fc3 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:22:40.949899 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-a2260ea3-c570-4631-bd98-9c2e26b54fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:22:40.975654 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:40.986833 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:41.012692 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec850242-aa32-40be-9354-0c0d01fef747 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:41.037068 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 143/279] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:22:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:22:41.037068 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb8fbd-03d0-4a60-9b9b-909d4176608d None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:41.037068 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb8fbd-03d0-4a60-9b9b-909d4176608d None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:41.037068 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb8fbd-03d0-4a60-9b9b-909d4176608d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:41.048915 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-21bb8fbd-03d0-4a60-9b9b-909d4176608d None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:22:41.050277 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-21bb8fbd-03d0-4a60-9b9b-909d4176608d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:22:41.066743 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acea8291-98a9-4d24-81b4-3a2a48f42378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:41.067441 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea8291-98a9-4d24-81b4-3a2a48f42378 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:41.067732 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea8291-98a9-4d24-81b4-3a2a48f42378 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:41.068016 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea8291-98a9-4d24-81b4-3a2a48f42378 None admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:41.068782 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acea8291-98a9-4d24-81b4-3a2a48f42378 None admin] RBAC: Adding query filter params (name=member) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:41.069175 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acea8291-98a9-4d24-81b4-3a2a48f42378 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:41.070829 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acea8291-98a9-4d24-81b4-3a2a48f42378 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:41.080263 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 137/280] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jul 18 10:22:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:41.080903 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acea8291-98a9-4d24-81b4-3a2a48f42378 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:41.144318 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 144/281] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:22:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:22:41.145213 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bb8fbd-03d0-4a60-9b9b-909d4176608d None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:41.213893 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acea8291-98a9-4d24-81b4-3a2a48f42378 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:41.263558 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e41afa-2a54-4c85-bd5f-33da92d18c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:41.264534 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e41afa-2a54-4c85-bd5f-33da92d18c39 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:41.264936 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e41afa-2a54-4c85-bd5f-33da92d18c39 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:41.265270 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e41afa-2a54-4c85-bd5f-33da92d18c39 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:41.266398 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:41.269202 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:41.270905 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bb8fbd-03d0-4a60-9b9b-909d4176608d None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:41.284881 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e41afa-2a54-4c85-bd5f-33da92d18c39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:22:41.292668 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-22e41afa-2a54-4c85-bd5f-33da92d18c39 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 10:22:41.292668 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:22:41.292668 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:22:41.292668 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:22:41.292668 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:22:41.292668 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:22:41.292668 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:22:41.292668 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:22:41.292668 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:22:41.292668 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:22:41.292668 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:22:41.292668 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:22:41.292668 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:22:41.292668 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:22:41.292668 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:22:41.292668 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:22:41.293669 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:22:41.293669 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:22:41.293669 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:22:41.293669 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:22:41.293669 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:22:41.293669 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:22:41.293669 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:22:41.293669 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:22:41.293669 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:22:41.293669 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:22:41.293669 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:22:41.293669 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:22:41.293669 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:22:41.293669 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:22:41.293669 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:22:41.293669 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:22:41.294443 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:22:41.294443 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:22:41.294443 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:22:41.294443 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:22:41.294443 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:22:41.294443 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:22:41.294443 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:22:41.294443 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:22:41.294443 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:22:41.294443 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:22:41.294443 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 10:22:41.294443 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:22:41.294443 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 138/282] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 10:22:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:22:41.295078 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e41afa-2a54-4c85-bd5f-33da92d18c39 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:41.308367 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f684fab-a451-4a4a-b502-eb1ceee7bd9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:41.309343 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f684fab-a451-4a4a-b502-eb1ceee7bd9e None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:41.309674 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f684fab-a451-4a4a-b502-eb1ceee7bd9e None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:41.310072 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f684fab-a451-4a4a-b502-eb1ceee7bd9e None admin] PATH_INFO: `/v3/users/b2e474b280934bdab00f7051d5f4c608` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:41.325390 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f684fab-a451-4a4a-b502-eb1ceee7bd9e None admin] RBAC: Authorizing `identity:get_user(user_id=b2e474b280934bdab00f7051d5f4c608)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:41.326970 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f684fab-a451-4a4a-b502-eb1ceee7bd9e None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:41.328711 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 145/283] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 10:22:41 2022] GET /identity/v3/users/b2e474b280934bdab00f7051d5f4c608 => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:41.330159 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f684fab-a451-4a4a-b502-eb1ceee7bd9e None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:41.429016 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e41afa-2a54-4c85-bd5f-33da92d18c39 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:41.453722 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f684fab-a451-4a4a-b502-eb1ceee7bd9e None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:41.482186 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ebe99-4099-4156-b37a-e6b70652e5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:41.483670 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ebe99-4099-4156-b37a-e6b70652e5b8 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:41.483957 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ebe99-4099-4156-b37a-e6b70652e5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:41.484233 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ebe99-4099-4156-b37a-e6b70652e5b8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:41.494679 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6341d8c6-b297-4959-b777-2d3221eaf324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:41.495438 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6341d8c6-b297-4959-b777-2d3221eaf324 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:41.495788 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6341d8c6-b297-4959-b777-2d3221eaf324 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:41.496133 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6341d8c6-b297-4959-b777-2d3221eaf324 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:41.496941 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6341d8c6-b297-4959-b777-2d3221eaf324 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:41.497368 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6341d8c6-b297-4959-b777-2d3221eaf324 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:41.497990 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16ebe99-4099-4156-b37a-e6b70652e5b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:22:41.498866 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6341d8c6-b297-4959-b777-2d3221eaf324 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:41.508264 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-f16ebe99-4099-4156-b37a-e6b70652e5b8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:22:41.508264 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:22:41.508264 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:22:41.508264 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:22:41.508264 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:22:41.508264 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:22:41.508264 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:22:41.508264 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:22:41.508264 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:22:41.508264 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:22:41.508264 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:22:41.508264 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:22:41.508264 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:22:41.508264 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:22:41.508264 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:22:41.508264 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:22:41.509200 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:22:41.509200 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:22:41.509200 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:22:41.509200 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:22:41.509200 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:22:41.509200 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:22:41.509200 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:22:41.509200 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:22:41.509200 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:22:41.509200 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:22:41.509200 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:22:41.509200 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:22:41.509200 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:22:41.509200 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:22:41.509200 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:22:41.509200 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:22:41.510199 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:22:41.510199 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:22:41.510199 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:22:41.510199 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:22:41.510199 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:22:41.510199 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:22:41.510199 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:22:41.510199 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:22:41.510199 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:22:41.510199 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:22:41.510199 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:22:41.510199 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:22:41.511479 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 146/284] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jul 18 10:22:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:41.511601 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 139/285] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 10:22:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:22:41.511727 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6341d8c6-b297-4959-b777-2d3221eaf324 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:41.516055 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ebe99-4099-4156-b37a-e6b70652e5b8 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:41.531615 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:41.599169 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:41.634755 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6341d8c6-b297-4959-b777-2d3221eaf324 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:41.650477 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ebe99-4099-4156-b37a-e6b70652e5b8 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:41.679185 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57734ab-389c-41b7-a321-664be02eaddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:41.680086 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57734ab-389c-41b7-a321-664be02eaddd None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:41.680547 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57734ab-389c-41b7-a321-664be02eaddd None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:41.680974 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57734ab-389c-41b7-a321-664be02eaddd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:41.681977 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57734ab-389c-41b7-a321-664be02eaddd None admin] RBAC: Adding query filter params (role.id=907cee10dffd48b2bec00719e425d3bd, user.id=b2e474b280934bdab00f7051d5f4c608, scope.system=all) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:41.682439 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57734ab-389c-41b7-a321-664be02eaddd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:41.684025 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57734ab-389c-41b7-a321-664be02eaddd None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:41.689915 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 147/286] 10.222.0.39 () {56 vars in 1308 bytes} [Mon Jul 18 10:22:41 2022] GET /identity/v3/role_assignments?user.id=b2e474b280934bdab00f7051d5f4c608&scope.system=all&role.id=907cee10dffd48b2bec00719e425d3bd => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:41.697246 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0248a4-5bdd-45c3-8b10-8a21378cf5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:41.697246 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0248a4-5bdd-45c3-8b10-8a21378cf5cb None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:41.697246 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0248a4-5bdd-45c3-8b10-8a21378cf5cb None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:41.697246 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0248a4-5bdd-45c3-8b10-8a21378cf5cb None admin] PATH_INFO: `/v3/users/fe3387fce9ea47c9b0d1feb6320046e8` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:41.697545 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0248a4-5bdd-45c3-8b10-8a21378cf5cb None admin] RBAC: Authorizing `identity:get_user(user_id=fe3387fce9ea47c9b0d1feb6320046e8)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:41.697545 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0248a4-5bdd-45c3-8b10-8a21378cf5cb None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:41.697545 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 140/287] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 10:22:41 2022] GET /identity/v3/users/fe3387fce9ea47c9b0d1feb6320046e8 => generated 297 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:41.698418 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0248a4-5bdd-45c3-8b10-8a21378cf5cb None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:41.702803 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57734ab-389c-41b7-a321-664be02eaddd None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:41.828164 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0248a4-5bdd-45c3-8b10-8a21378cf5cb None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:41.856957 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:41.873759 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa2bbf-3e12-44db-b967-d35213577805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:41.874980 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa2bbf-3e12-44db-b967-d35213577805 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:41.875410 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa2bbf-3e12-44db-b967-d35213577805 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:41.875856 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa2bbf-3e12-44db-b967-d35213577805 None admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:41.877790 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aa2bbf-3e12-44db-b967-d35213577805 None admin] RBAC: Adding query filter params (name=member) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:41.878248 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aa2bbf-3e12-44db-b967-d35213577805 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:41.880844 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aa2bbf-3e12-44db-b967-d35213577805 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:41.893193 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 141/288] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jul 18 10:22:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:41.903226 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa2bbf-3e12-44db-b967-d35213577805 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:41.906074 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:41.948236 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57734ab-389c-41b7-a321-664be02eaddd None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:42.029343 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e6c71e-ac2e-4231-81c8-afdaccfdf61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:42.030575 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e6c71e-ac2e-4231-81c8-afdaccfdf61e None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:42.031049 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e6c71e-ac2e-4231-81c8-afdaccfdf61e None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:42.031538 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e6c71e-ac2e-4231-81c8-afdaccfdf61e None admin] PATH_INFO: `/v3/projects/cd29577200c54cde8573db439fcbf179` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:42.034343 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e6c71e-ac2e-4231-81c8-afdaccfdf61e None admin] RBAC: Authorizing `identity:get_project(project_id=cd29577200c54cde8573db439fcbf179)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:42.037344 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e6c71e-ac2e-4231-81c8-afdaccfdf61e None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:42.040738 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 148/289] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 10:22:41 2022] GET /identity/v3/projects/cd29577200c54cde8573db439fcbf179 => generated 302 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:42.046939 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e6c71e-ac2e-4231-81c8-afdaccfdf61e None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:42.087508 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa2bbf-3e12-44db-b967-d35213577805 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:42.129852 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf02c6-418b-418c-af0b-6e31e53e97d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:42.131261 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf02c6-418b-418c-af0b-6e31e53e97d3 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:42.131749 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf02c6-418b-418c-af0b-6e31e53e97d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:42.132234 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf02c6-418b-418c-af0b-6e31e53e97d3 None admin] PATH_INFO: `/v3/users/9d5c61ff2934469b999fff5a1a1ed206` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:42.133660 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cf02c6-418b-418c-af0b-6e31e53e97d3 None admin] RBAC: Authorizing `identity:get_user(user_id=9d5c61ff2934469b999fff5a1a1ed206)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:42.135637 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cf02c6-418b-418c-af0b-6e31e53e97d3 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:42.137897 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 142/290] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 10:22:41 2022] GET /identity/v3/users/9d5c61ff2934469b999fff5a1a1ed206 => generated 297 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:22:42.144020 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf02c6-418b-418c-af0b-6e31e53e97d3 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:42.225408 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:42.288206 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf02c6-418b-418c-af0b-6e31e53e97d3 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:42.297475 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e6c71e-ac2e-4231-81c8-afdaccfdf61e None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:42.335176 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e5f30-4185-4501-8abd-6d01ed470b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:42.335847 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e5f30-4185-4501-8abd-6d01ed470b03 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:42.336128 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e5f30-4185-4501-8abd-6d01ed470b03 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:42.336402 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e5f30-4185-4501-8abd-6d01ed470b03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:42.382756 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e8460-3548-4054-9a6b-e54be535f5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:42.383571 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e8460-3548-4054-9a6b-e54be535f5ae None admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:42.383851 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e8460-3548-4054-9a6b-e54be535f5ae None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:42.384124 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e8460-3548-4054-9a6b-e54be535f5ae None admin] PATH_INFO: `/v3/projects/cd29577200c54cde8573db439fcbf179/users/fe3387fce9ea47c9b0d1feb6320046e8/roles/c2ae722a355f4d73b11124bcf553fe8c` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:42.388231 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e8460-3548-4054-9a6b-e54be535f5ae None admin] RBAC: Authorizing `identity:create_grant(project_id=cd29577200c54cde8573db439fcbf179, user_id=fe3387fce9ea47c9b0d1feb6320046e8, role_id=c2ae722a355f4d73b11124bcf553fe8c)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:42.389694 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e8460-3548-4054-9a6b-e54be535f5ae None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:42.437093 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011e5f30-4185-4501-8abd-6d01ed470b03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:42.439328 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011e5f30-4185-4501-8abd-6d01ed470b03 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:42.484307 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 149/291] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jul 18 10:22:42 2022] PUT /identity/v3/projects/cd29577200c54cde8573db439fcbf179/users/fe3387fce9ea47c9b0d1feb6320046e8/roles/c2ae722a355f4d73b11124bcf553fe8c => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:22:42.494876 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:42.549578 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 143/292] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 10:22:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:22:42.555724 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e8460-3548-4054-9a6b-e54be535f5ae None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:42.570501 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:42.674035 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e8460-3548-4054-9a6b-e54be535f5ae None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:42.717477 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9962f9c-ab2c-4a63-82ea-6794ab00d246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:42.718348 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9962f9c-ab2c-4a63-82ea-6794ab00d246 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:42.718632 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9962f9c-ab2c-4a63-82ea-6794ab00d246 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:42.718907 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9962f9c-ab2c-4a63-82ea-6794ab00d246 None admin] PATH_INFO: `/v3/projects/cd29577200c54cde8573db439fcbf179` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:42.720926 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9962f9c-ab2c-4a63-82ea-6794ab00d246 None admin] RBAC: Authorizing `identity:get_project(project_id=cd29577200c54cde8573db439fcbf179)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:42.722480 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9962f9c-ab2c-4a63-82ea-6794ab00d246 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:42.724230 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 150/293] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 10:22:42 2022] GET /identity/v3/projects/cd29577200c54cde8573db439fcbf179 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:42.730125 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e5f30-4185-4501-8abd-6d01ed470b03 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:42.839492 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e5f30-4185-4501-8abd-6d01ed470b03 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:42.887237 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d289c65e-4810-46ab-ad5b-0b4ba1d71641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:42.887969 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d289c65e-4810-46ab-ad5b-0b4ba1d71641 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:42.888260 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d289c65e-4810-46ab-ad5b-0b4ba1d71641 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:42.888540 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d289c65e-4810-46ab-ad5b-0b4ba1d71641 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:42.889474 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d289c65e-4810-46ab-ad5b-0b4ba1d71641 None admin] RBAC: Adding query filter params (role.id=907cee10dffd48b2bec00719e425d3bd, scope.project.id=cd29577200c54cde8573db439fcbf179, user.id=9d5c61ff2934469b999fff5a1a1ed206) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:42.889815 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d289c65e-4810-46ab-ad5b-0b4ba1d71641 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:42.891284 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d289c65e-4810-46ab-ad5b-0b4ba1d71641 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:42.898596 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 144/294] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 10:22:42 2022] GET /identity/v3/role_assignments?user.id=9d5c61ff2934469b999fff5a1a1ed206&scope.project.id=cd29577200c54cde8573db439fcbf179&role.id=907cee10dffd48b2bec00719e425d3bd => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:43.376500 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdffc498-20fb-4177-8d43-7cf9aa1167e4 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:43.377243 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdffc498-20fb-4177-8d43-7cf9aa1167e4 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:43.377243 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdffc498-20fb-4177-8d43-7cf9aa1167e4 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:43.378479 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 151/295] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:22:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:22:43.383862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e796ec89-5c12-4f2d-82be-2e3596f17010 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:43.384268 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e796ec89-5c12-4f2d-82be-2e3596f17010 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:43.384432 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e796ec89-5c12-4f2d-82be-2e3596f17010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:43.401684 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-e796ec89-5c12-4f2d-82be-2e3596f17010 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:22:43.402889 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-e796ec89-5c12-4f2d-82be-2e3596f17010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:22:43.415007 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:43.431471 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09319871-8e35-45ef-9e5b-813582776afa None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:43.445354 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09319871-8e35-45ef-9e5b-813582776afa None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:43.445354 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09319871-8e35-45ef-9e5b-813582776afa None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:43.445354 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 152/296] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:22:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:22:43.445354 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d3dc3-d933-4d30-9aab-7317d52392f9 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:43.445354 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d3dc3-d933-4d30-9aab-7317d52392f9 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:43.445354 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d3dc3-d933-4d30-9aab-7317d52392f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:43.458810 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-540d3dc3-d933-4d30-9aab-7317d52392f9 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:22:43.460303 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-540d3dc3-d933-4d30-9aab-7317d52392f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:22:43.476828 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 145/297] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:22:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 10:22:43.500437 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e796ec89-5c12-4f2d-82be-2e3596f17010 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:43.540076 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 153/298] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:22:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 10:22:43.570123 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d3dc3-d933-4d30-9aab-7317d52392f9 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:43.581691 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:43.631991 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e796ec89-5c12-4f2d-82be-2e3596f17010 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:43.679028 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648cb1dd-e9e8-49cb-9917-ecfafb9e64b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:43.680278 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648cb1dd-e9e8-49cb-9917-ecfafb9e64b0 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:43.680732 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648cb1dd-e9e8-49cb-9917-ecfafb9e64b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:43.681471 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648cb1dd-e9e8-49cb-9917-ecfafb9e64b0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:43.683035 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648cb1dd-e9e8-49cb-9917-ecfafb9e64b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:43.685345 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648cb1dd-e9e8-49cb-9917-ecfafb9e64b0 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:43.686970 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d3dc3-d933-4d30-9aab-7317d52392f9 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:43.692024 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 146/299] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:22:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:43.693702 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648cb1dd-e9e8-49cb-9917-ecfafb9e64b0 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:43.716380 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:43.726871 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6151bc-9933-4ef5-be49-08a041311749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:43.733119 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6151bc-9933-4ef5-be49-08a041311749 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:43.733119 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6151bc-9933-4ef5-be49-08a041311749 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:43.733119 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6151bc-9933-4ef5-be49-08a041311749 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:43.740396 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6151bc-9933-4ef5-be49-08a041311749 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:22:43.748827 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-3e6151bc-9933-4ef5-be49-08a041311749 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 10:22:43.748827 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:22:43.748827 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:22:43.748827 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:22:43.748827 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:22:43.748827 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:22:43.748827 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:22:43.748827 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:22:43.748827 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:22:43.748827 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:22:43.748827 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:22:43.748827 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:22:43.748827 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:22:43.748827 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:22:43.748827 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:22:43.748827 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:22:43.749942 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:22:43.749942 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:22:43.749942 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:22:43.749942 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:22:43.749942 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:22:43.749942 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:22:43.749942 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:22:43.749942 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:22:43.749942 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:22:43.749942 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:22:43.749942 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:22:43.749942 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:22:43.749942 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:22:43.749942 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:22:43.749942 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:22:43.749942 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:22:43.751483 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:22:43.751483 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:22:43.751483 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:22:43.751483 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:22:43.751483 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:22:43.751483 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:22:43.751483 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:22:43.751483 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:22:43.751483 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:22:43.751483 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:22:43.751483 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 10:22:43.751483 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:22:43.757296 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 154/300] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 10:22:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:22:43.759631 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6151bc-9933-4ef5-be49-08a041311749 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:43.826472 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648cb1dd-e9e8-49cb-9917-ecfafb9e64b0 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:43.846742 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:43.868232 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6151bc-9933-4ef5-be49-08a041311749 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:43.872676 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446efcb2-44ed-4cb8-bd1d-07eebb7f5ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:43.873565 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446efcb2-44ed-4cb8-bd1d-07eebb7f5ab2 None admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:43.873987 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446efcb2-44ed-4cb8-bd1d-07eebb7f5ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:43.874397 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446efcb2-44ed-4cb8-bd1d-07eebb7f5ab2 None admin] PATH_INFO: `/v3/groups` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:43.875274 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446efcb2-44ed-4cb8-bd1d-07eebb7f5ab2 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:43.877552 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446efcb2-44ed-4cb8-bd1d-07eebb7f5ab2 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:43.907882 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a5ca6-3fd6-46d1-909b-3fbdabb09c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:43.908824 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a5ca6-3fd6-46d1-909b-3fbdabb09c86 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:43.909331 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a5ca6-3fd6-46d1-909b-3fbdabb09c86 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:43.909750 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a5ca6-3fd6-46d1-909b-3fbdabb09c86 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:43.910725 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72a5ca6-3fd6-46d1-909b-3fbdabb09c86 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:43.911167 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72a5ca6-3fd6-46d1-909b-3fbdabb09c86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:43.912976 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72a5ca6-3fd6-46d1-909b-3fbdabb09c86 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:43.922534 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 155/301] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jul 18 10:22:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:43.929164 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a5ca6-3fd6-46d1-909b-3fbdabb09c86 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:43.958419 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 147/302] 10.222.0.39 () {60 vars in 1134 bytes} [Mon Jul 18 10:22:43 2022] POST /identity/v3/groups => generated 229 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:22:44.054083 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a5ca6-3fd6-46d1-909b-3fbdabb09c86 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:44.083749 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:44.105432 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da63bf3c-279d-4336-8803-eb61602a2c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:44.105971 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b05eb8b-c92d-46b7-acef-adc48a925448 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:44.106334 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da63bf3c-279d-4336-8803-eb61602a2c3f None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:44.106614 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da63bf3c-279d-4336-8803-eb61602a2c3f None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:44.106886 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da63bf3c-279d-4336-8803-eb61602a2c3f None admin] PATH_INFO: `/v3/users/a1c1ad39b5d04fd2895715f82e1da852` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:44.107152 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b05eb8b-c92d-46b7-acef-adc48a925448 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:44.107616 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b05eb8b-c92d-46b7-acef-adc48a925448 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:44.109680 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 148/303] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:22:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:22:44.117072 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00978931-b1dd-4d11-9eae-d9ae6995de83 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:44.117364 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00978931-b1dd-4d11-9eae-d9ae6995de83 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:44.117610 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00978931-b1dd-4d11-9eae-d9ae6995de83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:44.135301 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da63bf3c-279d-4336-8803-eb61602a2c3f None admin] RBAC: Authorizing `identity:get_user(user_id=a1c1ad39b5d04fd2895715f82e1da852)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:44.135754 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-00978931-b1dd-4d11-9eae-d9ae6995de83 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:22:44.136986 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-00978931-b1dd-4d11-9eae-d9ae6995de83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:22:44.137803 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da63bf3c-279d-4336-8803-eb61602a2c3f None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:44.140318 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 156/304] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 10:22:43 2022] GET /identity/v3/users/a1c1ad39b5d04fd2895715f82e1da852 => generated 293 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:22:44.153280 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da63bf3c-279d-4336-8803-eb61602a2c3f None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:44.231701 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 149/305] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:22:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 10:22:44.256451 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00978931-b1dd-4d11-9eae-d9ae6995de83 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:44.260985 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:44.288520 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da63bf3c-279d-4336-8803-eb61602a2c3f None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:44.339389 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ff7e8-67bf-4e28-be6d-bb28758bec5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:44.340355 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ff7e8-67bf-4e28-be6d-bb28758bec5c None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:44.340842 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ff7e8-67bf-4e28-be6d-bb28758bec5c None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:44.341318 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ff7e8-67bf-4e28-be6d-bb28758bec5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:44.342579 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126ff7e8-67bf-4e28-be6d-bb28758bec5c None admin] RBAC: Adding query filter params (role.id=c2ae722a355f4d73b11124bcf553fe8c, user.id=a1c1ad39b5d04fd2895715f82e1da852, scope.system=all) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:44.343631 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126ff7e8-67bf-4e28-be6d-bb28758bec5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:44.346641 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126ff7e8-67bf-4e28-be6d-bb28758bec5c None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:44.353790 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 157/306] 10.222.0.39 () {56 vars in 1308 bytes} [Mon Jul 18 10:22:44 2022] GET /identity/v3/role_assignments?user.id=a1c1ad39b5d04fd2895715f82e1da852&scope.system=all&role.id=c2ae722a355f4d73b11124bcf553fe8c => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:44.387637 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00978931-b1dd-4d11-9eae-d9ae6995de83 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:44.428519 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55c4bad-0432-478a-8c44-2d536f6decb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:44.429381 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c4bad-0432-478a-8c44-2d536f6decb8 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:44.429668 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c4bad-0432-478a-8c44-2d536f6decb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:44.429940 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c4bad-0432-478a-8c44-2d536f6decb8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:44.442993 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55c4bad-0432-478a-8c44-2d536f6decb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:22:44.451264 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-d55c4bad-0432-478a-8c44-2d536f6decb8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:22:44.451264 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:22:44.451264 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:22:44.451264 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:22:44.451264 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:22:44.451264 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:22:44.451264 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:22:44.451264 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:22:44.451264 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:22:44.451264 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:22:44.451264 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:22:44.451264 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:22:44.451264 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:22:44.451264 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:22:44.451264 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:22:44.451264 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:22:44.452202 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:22:44.452202 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:22:44.452202 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:22:44.452202 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:22:44.452202 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:22:44.452202 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:22:44.452202 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:22:44.452202 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:22:44.452202 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:22:44.452202 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:22:44.452202 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:22:44.452202 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:22:44.452202 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:22:44.452202 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:22:44.452202 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:22:44.452202 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:22:44.452979 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:22:44.452979 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:22:44.452979 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:22:44.452979 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:22:44.452979 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:22:44.452979 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:22:44.452979 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:22:44.452979 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:22:44.452979 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:22:44.452979 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:22:44.452979 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:22:44.452979 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:22:44.452979 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 150/307] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 10:22:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:22:44.461443 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ff7e8-67bf-4e28-be6d-bb28758bec5c None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:44.525562 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:44.578370 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ff7e8-67bf-4e28-be6d-bb28758bec5c None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:44.616009 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eae2ca-928f-476d-821b-233d412b0c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:44.616689 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eae2ca-928f-476d-821b-233d412b0c83 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:44.616973 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eae2ca-928f-476d-821b-233d412b0c83 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:44.617280 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eae2ca-928f-476d-821b-233d412b0c83 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:44.618033 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eae2ca-928f-476d-821b-233d412b0c83 None admin] RBAC: Adding query filter params (name=member) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:44.618344 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eae2ca-928f-476d-821b-233d412b0c83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:44.619723 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eae2ca-928f-476d-821b-233d412b0c83 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:44.628493 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 158/308] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jul 18 10:22:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:44.633891 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55c4bad-0432-478a-8c44-2d536f6decb8 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:44.699614 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:44.739890 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55c4bad-0432-478a-8c44-2d536f6decb8 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:44.776166 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3121cd3-f204-4216-86b5-35fa401736e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:44.776982 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3121cd3-f204-4216-86b5-35fa401736e9 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:44.777297 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3121cd3-f204-4216-86b5-35fa401736e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:44.777575 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3121cd3-f204-4216-86b5-35fa401736e9 None admin] PATH_INFO: `/v3/users/b2e474b280934bdab00f7051d5f4c608` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:44.778800 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3121cd3-f204-4216-86b5-35fa401736e9 None admin] RBAC: Authorizing `identity:get_user(user_id=b2e474b280934bdab00f7051d5f4c608)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:44.780271 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3121cd3-f204-4216-86b5-35fa401736e9 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:44.783679 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 151/309] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 10:22:44 2022] GET /identity/v3/users/b2e474b280934bdab00f7051d5f4c608 => generated 293 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:44.787854 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eae2ca-928f-476d-821b-233d412b0c83 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:44.892360 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eae2ca-928f-476d-821b-233d412b0c83 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:44.905538 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:44.927589 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9c11dd-b9d5-44ba-8b5c-891bd514eefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:44.928462 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c11dd-b9d5-44ba-8b5c-891bd514eefa None admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:44.928748 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c11dd-b9d5-44ba-8b5c-891bd514eefa None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:44.929026 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c11dd-b9d5-44ba-8b5c-891bd514eefa None admin] PATH_INFO: `/v3/system/users/b2e474b280934bdab00f7051d5f4c608/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:44.930642 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9c11dd-b9d5-44ba-8b5c-891bd514eefa None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b2e474b280934bdab00f7051d5f4c608, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:44.932022 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9c11dd-b9d5-44ba-8b5c-891bd514eefa None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:44.940513 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9355c807-2316-46bc-a310-c61004545a9b None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:44.940803 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9355c807-2316-46bc-a310-c61004545a9b None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:44.941145 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9355c807-2316-46bc-a310-c61004545a9b None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:44.942772 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 152/310] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:22:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:22:44.947504 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f462b7e-2911-40c7-89cf-cefcc23c6dbe None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:44.947796 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f462b7e-2911-40c7-89cf-cefcc23c6dbe None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:44.948074 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f462b7e-2911-40c7-89cf-cefcc23c6dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:44.965964 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-0f462b7e-2911-40c7-89cf-cefcc23c6dbe None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:22:44.967173 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-0f462b7e-2911-40c7-89cf-cefcc23c6dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:22:45.003181 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 159/311] 10.222.0.39 () {58 vars in 1334 bytes} [Mon Jul 18 10:22:44 2022] PUT /identity/v3/system/users/b2e474b280934bdab00f7051d5f4c608/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:22:45.056890 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 153/312] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:22:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 10:22:45.080121 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9c11dd-b9d5-44ba-8b5c-891bd514eefa None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:45.202157 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9c11dd-b9d5-44ba-8b5c-891bd514eefa None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:45.239125 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c263dc3-c538-49c3-8944-3ce6f70f0f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:45.239933 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c263dc3-c538-49c3-8944-3ce6f70f0f1e None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:45.240218 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c263dc3-c538-49c3-8944-3ce6f70f0f1e None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:45.240751 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c263dc3-c538-49c3-8944-3ce6f70f0f1e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:45.251766 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c263dc3-c538-49c3-8944-3ce6f70f0f1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:22:45.259625 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-8c263dc3-c538-49c3-8944-3ce6f70f0f1e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 10:22:45.259625 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:22:45.259625 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:22:45.259625 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:22:45.259625 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:22:45.259625 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:22:45.259625 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:22:45.259625 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:22:45.259625 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:22:45.259625 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:22:45.259625 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:22:45.259625 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:22:45.259625 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:22:45.259625 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:22:45.259625 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:22:45.259625 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:22:45.260485 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:22:45.260485 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:22:45.260485 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:22:45.260485 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:22:45.260485 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:22:45.260485 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:22:45.260485 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:22:45.260485 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:22:45.260485 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:22:45.260485 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:22:45.260485 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:22:45.260485 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:22:45.260485 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:22:45.260485 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:22:45.260485 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:22:45.260485 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:22:45.261696 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:22:45.261696 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:22:45.261696 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:22:45.261696 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:22:45.261696 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:22:45.261696 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:22:45.261696 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:22:45.261696 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:22:45.261696 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:22:45.261696 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:22:45.261696 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 10:22:45.261696 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:22:45.261696 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 160/313] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 10:22:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:22:45.267819 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f462b7e-2911-40c7-89cf-cefcc23c6dbe None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:45.332204 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:45.373819 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f462b7e-2911-40c7-89cf-cefcc23c6dbe None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:45.410311 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b460fcf2-6c38-4ee6-914b-f9c40b6011f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:45.411083 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460fcf2-6c38-4ee6-914b-f9c40b6011f0 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:45.411261 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460fcf2-6c38-4ee6-914b-f9c40b6011f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:45.411602 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b460fcf2-6c38-4ee6-914b-f9c40b6011f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:45.412348 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b460fcf2-6c38-4ee6-914b-f9c40b6011f0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:45.412649 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b460fcf2-6c38-4ee6-914b-f9c40b6011f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:45.414081 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b460fcf2-6c38-4ee6-914b-f9c40b6011f0 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:45.423040 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 154/314] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jul 18 10:22:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:45.430418 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c263dc3-c538-49c3-8944-3ce6f70f0f1e None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:45.471368 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:45.543521 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c263dc3-c538-49c3-8944-3ce6f70f0f1e None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:45.581788 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51cb269-4992-40e1-9274-71a4c193a2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:45.583181 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51cb269-4992-40e1-9274-71a4c193a2e5 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:45.583668 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51cb269-4992-40e1-9274-71a4c193a2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:45.584140 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51cb269-4992-40e1-9274-71a4c193a2e5 None admin] PATH_INFO: `/v3/users/fe3387fce9ea47c9b0d1feb6320046e8` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:45.585572 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51cb269-4992-40e1-9274-71a4c193a2e5 None admin] RBAC: Authorizing `identity:get_user(user_id=fe3387fce9ea47c9b0d1feb6320046e8)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:45.587306 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51cb269-4992-40e1-9274-71a4c193a2e5 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:45.589554 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 161/315] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 10:22:45 2022] GET /identity/v3/users/fe3387fce9ea47c9b0d1feb6320046e8 => generated 297 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:45.594756 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b460fcf2-6c38-4ee6-914b-f9c40b6011f0 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:45.701658 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b460fcf2-6c38-4ee6-914b-f9c40b6011f0 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:45.726184 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:45.736670 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f07bea4-c010-461e-86b2-32c7b3179b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:45.740133 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f07bea4-c010-461e-86b2-32c7b3179b1a None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:45.740133 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f07bea4-c010-461e-86b2-32c7b3179b1a None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:45.740133 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f07bea4-c010-461e-86b2-32c7b3179b1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:45.808993 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f07bea4-c010-461e-86b2-32c7b3179b1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:45.810478 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f07bea4-c010-461e-86b2-32c7b3179b1a None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:45.920071 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 155/316] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 10:22:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:22:45.925871 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51cb269-4992-40e1-9274-71a4c193a2e5 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:46.043162 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51cb269-4992-40e1-9274-71a4c193a2e5 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:46.045789 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:46.081872 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b4a9bf-ad23-400f-8ec8-0d8735aafe3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:46.083082 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4a9bf-ad23-400f-8ec8-0d8735aafe3b None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:46.083512 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4a9bf-ad23-400f-8ec8-0d8735aafe3b None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:46.083934 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4a9bf-ad23-400f-8ec8-0d8735aafe3b None admin] PATH_INFO: `/v3/projects/cd29577200c54cde8573db439fcbf179` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:46.085302 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b4a9bf-ad23-400f-8ec8-0d8735aafe3b None admin] RBAC: Authorizing `identity:get_project(project_id=cd29577200c54cde8573db439fcbf179)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:46.086891 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b4a9bf-ad23-400f-8ec8-0d8735aafe3b None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:46.088891 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 162/317] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 10:22:45 2022] GET /identity/v3/projects/cd29577200c54cde8573db439fcbf179 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:46.097259 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f07bea4-c010-461e-86b2-32c7b3179b1a None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:46.137848 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:46.217926 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f07bea4-c010-461e-86b2-32c7b3179b1a None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:46.234585 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e75f8f-2598-490b-8eb0-276607349b36 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:46.234875 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e75f8f-2598-490b-8eb0-276607349b36 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:46.235176 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e75f8f-2598-490b-8eb0-276607349b36 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:46.237408 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 163/318] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:22:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:22:46.248350 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45cd22a-f79a-4acc-a647-9930a37ecae3 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:46.248780 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45cd22a-f79a-4acc-a647-9930a37ecae3 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:46.249189 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45cd22a-f79a-4acc-a647-9930a37ecae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:46.260848 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0889601-0f9e-4254-9b88-b918a71f5221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:46.261751 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0889601-0f9e-4254-9b88-b918a71f5221 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:46.262182 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0889601-0f9e-4254-9b88-b918a71f5221 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:46.262590 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0889601-0f9e-4254-9b88-b918a71f5221 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:46.263599 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0889601-0f9e-4254-9b88-b918a71f5221 None admin] RBAC: Adding query filter params (role.id=c2ae722a355f4d73b11124bcf553fe8c, scope.project.id=cd29577200c54cde8573db439fcbf179, user.id=fe3387fce9ea47c9b0d1feb6320046e8) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:46.264062 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0889601-0f9e-4254-9b88-b918a71f5221 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:46.265672 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0889601-0f9e-4254-9b88-b918a71f5221 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:46.269729 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-d45cd22a-f79a-4acc-a647-9930a37ecae3 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:22:46.270829 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-d45cd22a-f79a-4acc-a647-9930a37ecae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:22:46.277406 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 156/319] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 10:22:46 2022] GET /identity/v3/role_assignments?user.id=fe3387fce9ea47c9b0d1feb6320046e8&scope.project.id=cd29577200c54cde8573db439fcbf179&role.id=c2ae722a355f4d73b11124bcf553fe8c => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:46.358378 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 164/320] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:22:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 10:22:46.385620 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0889601-0f9e-4254-9b88-b918a71f5221 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:46.445612 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c8819-8c83-4ef8-bc57-7bb5460a805a None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:46.445900 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c8819-8c83-4ef8-bc57-7bb5460a805a None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:46.446176 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c8819-8c83-4ef8-bc57-7bb5460a805a None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:46.447548 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 165/321] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:22:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:22:46.455240 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b8c18-d664-4778-a6ba-753d255dcb19 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:46.455579 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b8c18-d664-4778-a6ba-753d255dcb19 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:46.455863 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b8c18-d664-4778-a6ba-753d255dcb19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:46.477902 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-a23b8c18-d664-4778-a6ba-753d255dcb19 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:22:46.479861 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-a23b8c18-d664-4778-a6ba-753d255dcb19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:22:46.501418 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:46.512582 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0889601-0f9e-4254-9b88-b918a71f5221 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:46.556922 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d28237-227f-4ad0-beb7-1256ce458036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:46.558290 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d28237-227f-4ad0-beb7-1256ce458036 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:46.559099 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d28237-227f-4ad0-beb7-1256ce458036 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:46.559824 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d28237-227f-4ad0-beb7-1256ce458036 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:46.561390 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d28237-227f-4ad0-beb7-1256ce458036 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:46.564675 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d28237-227f-4ad0-beb7-1256ce458036 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:46.566503 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 157/322] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:22:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:46.569848 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 166/323] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:22:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 10:22:46.572163 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d28237-227f-4ad0-beb7-1256ce458036 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:46.592421 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b8c18-d664-4778-a6ba-753d255dcb19 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:46.627183 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:46.685450 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d28237-227f-4ad0-beb7-1256ce458036 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:46.703965 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b8c18-d664-4778-a6ba-753d255dcb19 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:46.724795 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a98ca70-1e06-43d5-b1e5-7c36af2bac77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:46.725504 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98ca70-1e06-43d5-b1e5-7c36af2bac77 None admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:46.725792 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98ca70-1e06-43d5-b1e5-7c36af2bac77 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:46.726067 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98ca70-1e06-43d5-b1e5-7c36af2bac77 None admin] PATH_INFO: `/v3/groups` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:46.726758 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a98ca70-1e06-43d5-b1e5-7c36af2bac77 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:46.728252 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a98ca70-1e06-43d5-b1e5-7c36af2bac77 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:46.742891 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3986098-9499-4713-92ef-0e5d081532b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:46.743801 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3986098-9499-4713-92ef-0e5d081532b7 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:46.744152 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3986098-9499-4713-92ef-0e5d081532b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:46.744495 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3986098-9499-4713-92ef-0e5d081532b7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:46.756340 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3986098-9499-4713-92ef-0e5d081532b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:22:46.764169 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-e3986098-9499-4713-92ef-0e5d081532b7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 10:22:46.764169 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:22:46.764169 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:22:46.764169 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:22:46.764169 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:22:46.764169 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:22:46.764169 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:22:46.764169 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:22:46.764169 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:22:46.764169 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:22:46.764169 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:22:46.764169 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:22:46.764169 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:22:46.764169 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:22:46.764169 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:22:46.764169 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:22:46.765269 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:22:46.765269 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:22:46.765269 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:22:46.765269 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:22:46.765269 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:22:46.765269 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:22:46.765269 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:22:46.765269 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:22:46.765269 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:22:46.765269 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:22:46.765269 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:22:46.765269 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:22:46.765269 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:22:46.765269 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:22:46.765269 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:22:46.765269 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:22:46.766336 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:22:46.766336 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:22:46.766336 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:22:46.766336 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:22:46.766336 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:22:46.766336 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:22:46.766336 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:22:46.766336 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:22:46.766336 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:22:46.766336 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:22:46.766336 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 10:22:46.766336 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:22:46.766336 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 167/324] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 10:22:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:22:46.772158 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3986098-9499-4713-92ef-0e5d081532b7 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:46.858646 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 158/325] 10.222.0.39 () {60 vars in 1134 bytes} [Mon Jul 18 10:22:46 2022] POST /identity/v3/groups => generated 226 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:22:46.863383 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:46.873567 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3986098-9499-4713-92ef-0e5d081532b7 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:46.913806 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2aad58-7aeb-44bb-9ac3-177a0b8cec97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:46.914504 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2aad58-7aeb-44bb-9ac3-177a0b8cec97 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:46.914786 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2aad58-7aeb-44bb-9ac3-177a0b8cec97 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:46.915062 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2aad58-7aeb-44bb-9ac3-177a0b8cec97 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:46.915836 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2aad58-7aeb-44bb-9ac3-177a0b8cec97 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:46.916146 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2aad58-7aeb-44bb-9ac3-177a0b8cec97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:46.917706 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2aad58-7aeb-44bb-9ac3-177a0b8cec97 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:46.927543 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 168/326] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jul 18 10:22:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:22:46.933144 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a98ca70-1e06-43d5-b1e5-7c36af2bac77 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:46.955130 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:47.065973 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a98ca70-1e06-43d5-b1e5-7c36af2bac77 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:47.108130 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4ff24a-e5a4-4a83-ae6f-d5b3ed405d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:47.109116 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ff24a-e5a4-4a83-ae6f-d5b3ed405d82 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:47.109408 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ff24a-e5a4-4a83-ae6f-d5b3ed405d82 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:47.109684 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ff24a-e5a4-4a83-ae6f-d5b3ed405d82 None admin] PATH_INFO: `/v3/users/a1c1ad39b5d04fd2895715f82e1da852` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:47.111498 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4ff24a-e5a4-4a83-ae6f-d5b3ed405d82 None admin] RBAC: Authorizing `identity:get_user(user_id=a1c1ad39b5d04fd2895715f82e1da852)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:47.113209 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4ff24a-e5a4-4a83-ae6f-d5b3ed405d82 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:47.115066 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 159/327] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 10:22:46 2022] GET /identity/v3/users/a1c1ad39b5d04fd2895715f82e1da852 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:47.121282 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2aad58-7aeb-44bb-9ac3-177a0b8cec97 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:47.128227 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80849fd-5ca5-4714-bcb8-918c4dfdbd86 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:47.128227 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80849fd-5ca5-4714-bcb8-918c4dfdbd86 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:47.128227 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80849fd-5ca5-4714-bcb8-918c4dfdbd86 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:47.129719 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 160/328] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:22:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:22:47.134819 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef766738-a27e-4890-896a-0e0f0f449519 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:47.135108 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef766738-a27e-4890-896a-0e0f0f449519 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:47.135388 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef766738-a27e-4890-896a-0e0f0f449519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:47.153450 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-ef766738-a27e-4890-896a-0e0f0f449519 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:22:47.154650 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-ef766738-a27e-4890-896a-0e0f0f449519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:22:47.244548 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 161/329] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:22:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 10:22:47.258708 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2aad58-7aeb-44bb-9ac3-177a0b8cec97 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:47.275614 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef766738-a27e-4890-896a-0e0f0f449519 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:47.294728 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:47.301567 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499244b-2b5b-4920-851d-3c202c21c480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:47.302448 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499244b-2b5b-4920-851d-3c202c21c480 None admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:47.302728 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499244b-2b5b-4920-851d-3c202c21c480 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:47.303005 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499244b-2b5b-4920-851d-3c202c21c480 None admin] PATH_INFO: `/v3/system/users/a1c1ad39b5d04fd2895715f82e1da852/roles/c2ae722a355f4d73b11124bcf553fe8c` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:47.305249 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a499244b-2b5b-4920-851d-3c202c21c480 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a1c1ad39b5d04fd2895715f82e1da852, role_id=c2ae722a355f4d73b11124bcf553fe8c)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:47.306060 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a499244b-2b5b-4920-851d-3c202c21c480 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:47.373877 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 169/330] 10.222.0.39 () {58 vars in 1334 bytes} [Mon Jul 18 10:22:47 2022] PUT /identity/v3/system/users/a1c1ad39b5d04fd2895715f82e1da852/roles/c2ae722a355f4d73b11124bcf553fe8c => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:22:47.406165 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef766738-a27e-4890-896a-0e0f0f449519 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:47.449260 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf50350-815c-43e5-9987-a24cd549f09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:47.450113 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf50350-815c-43e5-9987-a24cd549f09a None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:47.450450 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf50350-815c-43e5-9987-a24cd549f09a None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:47.450727 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf50350-815c-43e5-9987-a24cd549f09a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:47.468605 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf50350-815c-43e5-9987-a24cd549f09a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:22:47.477782 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-fbf50350-815c-43e5-9987-a24cd549f09a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:22:47.477782 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:22:47.477782 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:22:47.477782 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:22:47.477782 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:22:47.477782 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:22:47.477782 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:22:47.477782 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:22:47.477782 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:22:47.477782 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:22:47.477782 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:22:47.477782 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:22:47.477782 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:22:47.477782 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:22:47.477782 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:22:47.477782 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:22:47.478727 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:22:47.478727 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:22:47.478727 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:22:47.478727 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:22:47.478727 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:22:47.478727 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:22:47.478727 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:22:47.478727 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:22:47.478727 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:22:47.478727 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:22:47.478727 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:22:47.478727 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:22:47.478727 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:22:47.478727 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:22:47.478727 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:22:47.478727 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:22:47.479516 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:22:47.479516 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:22:47.479516 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:22:47.479516 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:22:47.479516 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:22:47.479516 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:22:47.479516 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:22:47.479516 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:22:47.479516 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:22:47.479516 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:22:47.479516 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:22:47.479516 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:22:47.481608 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 162/331] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 10:22:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:22:47.488224 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499244b-2b5b-4920-851d-3c202c21c480 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:47.520874 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:47.633058 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499244b-2b5b-4920-851d-3c202c21c480 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:47.675639 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f6b1ee-32a0-475d-9b2b-9af231a7b703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:47.676755 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6b1ee-32a0-475d-9b2b-9af231a7b703 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:47.677271 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6b1ee-32a0-475d-9b2b-9af231a7b703 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:47.677748 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6b1ee-32a0-475d-9b2b-9af231a7b703 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:47.678699 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f6b1ee-32a0-475d-9b2b-9af231a7b703 None admin] RBAC: Adding query filter params (name=member) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:47.679204 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f6b1ee-32a0-475d-9b2b-9af231a7b703 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:47.680790 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f6b1ee-32a0-475d-9b2b-9af231a7b703 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:47.692847 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 170/332] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jul 18 10:22:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:47.698901 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf50350-815c-43e5-9987-a24cd549f09a None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:47.829439 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:47.857107 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf50350-815c-43e5-9987-a24cd549f09a None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:47.898251 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee06b78-106b-4323-aeeb-0a3ad986a84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:47.899491 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee06b78-106b-4323-aeeb-0a3ad986a84a None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:47.899977 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee06b78-106b-4323-aeeb-0a3ad986a84a None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:47.900455 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee06b78-106b-4323-aeeb-0a3ad986a84a None admin] PATH_INFO: `/v3/users/b2e474b280934bdab00f7051d5f4c608` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:47.903057 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee06b78-106b-4323-aeeb-0a3ad986a84a None admin] RBAC: Authorizing `identity:get_user(user_id=b2e474b280934bdab00f7051d5f4c608)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:47.904843 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee06b78-106b-4323-aeeb-0a3ad986a84a None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:47.907606 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 163/333] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 10:22:47 2022] GET /identity/v3/users/b2e474b280934bdab00f7051d5f4c608 => generated 293 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:47.913671 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f6b1ee-32a0-475d-9b2b-9af231a7b703 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:48.020636 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:48.041184 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f6b1ee-32a0-475d-9b2b-9af231a7b703 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:48.091612 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc8efce-69b2-415e-87af-ff24bc56c511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:48.092716 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8efce-69b2-415e-87af-ff24bc56c511 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:48.093230 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8efce-69b2-415e-87af-ff24bc56c511 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:48.093712 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8efce-69b2-415e-87af-ff24bc56c511 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:48.094901 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc8efce-69b2-415e-87af-ff24bc56c511 None admin] RBAC: Adding query filter params (role.id=907cee10dffd48b2bec00719e425d3bd, user.id=b2e474b280934bdab00f7051d5f4c608, scope.system=all) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:48.095434 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc8efce-69b2-415e-87af-ff24bc56c511 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:48.097111 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc8efce-69b2-415e-87af-ff24bc56c511 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:48.124304 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 171/334] 10.222.0.39 () {56 vars in 1308 bytes} [Mon Jul 18 10:22:47 2022] GET /identity/v3/role_assignments?user.id=b2e474b280934bdab00f7051d5f4c608&scope.system=all&role.id=907cee10dffd48b2bec00719e425d3bd => generated 510 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:49.335775 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d3e38-8bd2-43b6-a839-857e771b72e1 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:49.336338 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d3e38-8bd2-43b6-a839-857e771b72e1 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:49.336338 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d3e38-8bd2-43b6-a839-857e771b72e1 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:49.338005 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 164/335] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:22:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:22:49.343117 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906805b-1a9f-4cd6-ac4c-a864df83f5d6 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:49.343506 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906805b-1a9f-4cd6-ac4c-a864df83f5d6 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:49.343701 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906805b-1a9f-4cd6-ac4c-a864df83f5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:49.364383 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-2906805b-1a9f-4cd6-ac4c-a864df83f5d6 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:22:49.365835 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-2906805b-1a9f-4cd6-ac4c-a864df83f5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:22:49.460046 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 172/336] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:22:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:22:49.497225 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d3e38-8bd2-43b6-a839-857e771b72e1 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:49.509568 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e8b99-21ec-4c53-b50a-ed32f32688a6 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:49.509884 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e8b99-21ec-4c53-b50a-ed32f32688a6 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:49.510132 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e8b99-21ec-4c53-b50a-ed32f32688a6 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:49.511511 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 173/337] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:22:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:22:49.517651 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f1039-2558-4abe-a5eb-4044e76e32ff None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:49.518274 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f1039-2558-4abe-a5eb-4044e76e32ff None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:49.518274 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f1039-2558-4abe-a5eb-4044e76e32ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:49.541748 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-c61f1039-2558-4abe-a5eb-4044e76e32ff None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:22:49.542947 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c61f1039-2558-4abe-a5eb-4044e76e32ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:22:49.651061 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:49.658794 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 174/338] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:22:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:22:49.703520 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f1039-2558-4abe-a5eb-4044e76e32ff None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:49.705727 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d3e38-8bd2-43b6-a839-857e771b72e1 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:49.755711 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e71a8d-0512-43ba-92c2-0dce751ac0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:49.756529 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e71a8d-0512-43ba-92c2-0dce751ac0ca None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:49.756812 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e71a8d-0512-43ba-92c2-0dce751ac0ca None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:49.757113 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e71a8d-0512-43ba-92c2-0dce751ac0ca None admin] PATH_INFO: `/v3/roles/member` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:49.786077 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e71a8d-0512-43ba-92c2-0dce751ac0ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:22:49.794055 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-38e71a8d-0512-43ba-92c2-0dce751ac0ca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:22:49.794055 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:22:49.794055 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:22:49.794055 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:22:49.794055 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:22:49.794055 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:22:49.794055 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:22:49.794055 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:22:49.794055 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:22:49.794055 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:22:49.794055 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:22:49.794055 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:22:49.794055 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:22:49.794055 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:22:49.794055 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:22:49.794055 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:22:49.795136 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:22:49.795136 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:22:49.795136 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:22:49.795136 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:22:49.795136 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:22:49.795136 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:22:49.795136 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:22:49.795136 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:22:49.795136 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:22:49.795136 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:22:49.795136 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:22:49.795136 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:22:49.795136 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:22:49.795136 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:22:49.795136 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:22:49.795136 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:22:49.796188 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:22:49.796188 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:22:49.796188 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:22:49.796188 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:22:49.796188 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:22:49.796188 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:22:49.796188 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:22:49.796188 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:22:49.796188 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:22:49.796188 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:22:49.796188 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:22:49.796188 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:22:49.796188 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 165/339] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 10:22:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:22:49.802718 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e71a8d-0512-43ba-92c2-0dce751ac0ca None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:49.812412 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:49.923595 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f1039-2558-4abe-a5eb-4044e76e32ff None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:49.993988 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ddc99-f137-4a9f-b4bc-646c6f2597c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:49.994848 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ddc99-f137-4a9f-b4bc-646c6f2597c7 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:49.995128 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ddc99-f137-4a9f-b4bc-646c6f2597c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:49.995398 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ddc99-f137-4a9f-b4bc-646c6f2597c7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:50.013226 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e71a8d-0512-43ba-92c2-0dce751ac0ca None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:50.019620 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43ddc99-f137-4a9f-b4bc-646c6f2597c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:22:50.032013 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-d43ddc99-f137-4a9f-b4bc-646c6f2597c7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 10:22:50.032013 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:22:50.032013 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:22:50.032013 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:22:50.032013 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:22:50.032013 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:22:50.032013 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:22:50.032013 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:22:50.032013 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:22:50.032013 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:22:50.032013 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:22:50.032013 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:22:50.032013 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:22:50.032013 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:22:50.032013 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:22:50.032013 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:22:50.032929 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:22:50.032929 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:22:50.032929 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:22:50.032929 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:22:50.032929 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:22:50.032929 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:22:50.032929 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:22:50.032929 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:22:50.032929 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:22:50.032929 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:22:50.032929 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:22:50.032929 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:22:50.032929 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:22:50.032929 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:22:50.032929 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:22:50.032929 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:22:50.037335 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:22:50.037335 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:22:50.037335 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:22:50.037335 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:22:50.037335 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:22:50.037335 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:22:50.037335 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:22:50.037335 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:22:50.037335 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:22:50.037335 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:22:50.037335 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 10:22:50.037335 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:22:50.037335 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 175/340] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Jul 18 10:22:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:22:50.048363 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ddc99-f137-4a9f-b4bc-646c6f2597c7 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:50.090808 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d30e17c-37ab-40bc-b4e2-136383b2cf84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:50.091799 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d30e17c-37ab-40bc-b4e2-136383b2cf84 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:50.092596 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d30e17c-37ab-40bc-b4e2-136383b2cf84 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:50.093106 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d30e17c-37ab-40bc-b4e2-136383b2cf84 None admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:50.094078 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d30e17c-37ab-40bc-b4e2-136383b2cf84 None admin] RBAC: Adding query filter params (name=member) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:50.094582 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d30e17c-37ab-40bc-b4e2-136383b2cf84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:50.096159 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d30e17c-37ab-40bc-b4e2-136383b2cf84 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:50.111623 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 166/341] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jul 18 10:22:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:22:50.121609 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d30e17c-37ab-40bc-b4e2-136383b2cf84 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:50.163429 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:50.270037 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ddc99-f137-4a9f-b4bc-646c6f2597c7 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:50.284924 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:50.378341 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d095235-a5e3-4325-8db3-5907cffc250f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:50.379628 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d095235-a5e3-4325-8db3-5907cffc250f None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:50.380061 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d095235-a5e3-4325-8db3-5907cffc250f None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:50.380486 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d095235-a5e3-4325-8db3-5907cffc250f None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:50.381415 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d095235-a5e3-4325-8db3-5907cffc250f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:50.381887 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d095235-a5e3-4325-8db3-5907cffc250f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:50.383405 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d095235-a5e3-4325-8db3-5907cffc250f None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:50.395233 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d30e17c-37ab-40bc-b4e2-136383b2cf84 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:50.403558 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 176/342] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 10:22:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:22:50.409626 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d095235-a5e3-4325-8db3-5907cffc250f None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:50.491411 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2eb029-6321-4d5c-90e0-bd1f70beadf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:50.492355 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2eb029-6321-4d5c-90e0-bd1f70beadf1 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:50.492791 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2eb029-6321-4d5c-90e0-bd1f70beadf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:50.493245 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2eb029-6321-4d5c-90e0-bd1f70beadf1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:50.594947 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d095235-a5e3-4325-8db3-5907cffc250f None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:50.627434 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:50.636942 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2eb029-6321-4d5c-90e0-bd1f70beadf1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:50.638447 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2eb029-6321-4d5c-90e0-bd1f70beadf1 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:50.658221 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91155be8-c3de-49a9-9291-f2b71d013c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:50.658901 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91155be8-c3de-49a9-9291-f2b71d013c2e None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:50.659186 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91155be8-c3de-49a9-9291-f2b71d013c2e None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:50.659473 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91155be8-c3de-49a9-9291-f2b71d013c2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:50.755904 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:50.785108 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91155be8-c3de-49a9-9291-f2b71d013c2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:50.786592 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91155be8-c3de-49a9-9291-f2b71d013c2e None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:50.826227 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 167/343] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 10:22:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 705 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 18 10:22:50.829433 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eecaeb-5298-4751-8b64-c9e111ab163b None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:50.830056 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eecaeb-5298-4751-8b64-c9e111ab163b None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:50.831767 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eecaeb-5298-4751-8b64-c9e111ab163b None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:50.834134 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 168/344] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:22:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:22:50.835705 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eecaeb-5298-4751-8b64-c9e111ab163b None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:50.925895 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 177/345] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 10:22:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:22:50.927224 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37334c07-4eae-47f2-8696-5c3df70574d6 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:50.927679 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37334c07-4eae-47f2-8696-5c3df70574d6 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:50.928104 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37334c07-4eae-47f2-8696-5c3df70574d6 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:50.929840 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 178/346] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:22:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:22:50.931083 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ecc61a-5e86-497b-bf10-cb2c06484928 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:50.931609 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ecc61a-5e86-497b-bf10-cb2c06484928 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:50.932033 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ecc61a-5e86-497b-bf10-cb2c06484928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:50.954628 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-f8ecc61a-5e86-497b-bf10-cb2c06484928 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:22:50.956080 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-f8ecc61a-5e86-497b-bf10-cb2c06484928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:22:50.959710 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eecaeb-5298-4751-8b64-c9e111ab163b None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:50.971798 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:51.002987 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5966d47-b42b-4583-b688-9e9369f67520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:51.004221 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5966d47-b42b-4583-b688-9e9369f67520 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:51.004649 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5966d47-b42b-4583-b688-9e9369f67520 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:51.005109 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5966d47-b42b-4583-b688-9e9369f67520 None admin] PATH_INFO: `/v3/projects/e3ce0a1d0d104f4ba20f8d0b63301a51` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:51.006589 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5966d47-b42b-4583-b688-9e9369f67520 None admin] RBAC: Authorizing `identity:get_project(project_id=e3ce0a1d0d104f4ba20f8d0b63301a51)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:51.008367 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5966d47-b42b-4583-b688-9e9369f67520 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:51.010563 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 169/347] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 10:22:50 2022] GET /identity/v3/projects/e3ce0a1d0d104f4ba20f8d0b63301a51 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:51.011582 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5966d47-b42b-4583-b688-9e9369f67520 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:51.034696 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 179/348] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:22:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:22:51.036106 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5775e2-7793-4dd6-a3e9-87e6341a01b3 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:51.036399 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5775e2-7793-4dd6-a3e9-87e6341a01b3 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:51.036678 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5775e2-7793-4dd6-a3e9-87e6341a01b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:51.054642 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-7b5775e2-7793-4dd6-a3e9-87e6341a01b3 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:22:51.055891 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-7b5775e2-7793-4dd6-a3e9-87e6341a01b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:22:51.065513 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:51.131454 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 180/349] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:22:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:22:51.132461 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5966d47-b42b-4583-b688-9e9369f67520 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:51.132601 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5775e2-7793-4dd6-a3e9-87e6341a01b3 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:51.189854 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115194a8-4b5c-49d5-87b4-2e42fe648afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:51.190987 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115194a8-4b5c-49d5-87b4-2e42fe648afa None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:51.191422 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115194a8-4b5c-49d5-87b4-2e42fe648afa None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:51.191846 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115194a8-4b5c-49d5-87b4-2e42fe648afa None admin] PATH_INFO: `/v3/projects/e3ce0a1d0d104f4ba20f8d0b63301a51` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:51.194845 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115194a8-4b5c-49d5-87b4-2e42fe648afa None admin] RBAC: Authorizing `identity:get_project(project_id=e3ce0a1d0d104f4ba20f8d0b63301a51)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:51.196505 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115194a8-4b5c-49d5-87b4-2e42fe648afa None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:51.198447 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 170/350] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 10:22:51 2022] GET /identity/v3/projects/e3ce0a1d0d104f4ba20f8d0b63301a51 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:51.199377 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115194a8-4b5c-49d5-87b4-2e42fe648afa None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:51.241368 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:51.262666 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5775e2-7793-4dd6-a3e9-87e6341a01b3 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:51.304923 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92638a5-872e-41ba-b9af-6b34d25e10ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:51.305962 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92638a5-872e-41ba-b9af-6b34d25e10ec None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:51.306355 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92638a5-872e-41ba-b9af-6b34d25e10ec None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:51.306635 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92638a5-872e-41ba-b9af-6b34d25e10ec None admin] PATH_INFO: `/v3/groups/43305103e06a4e25acc80d7d0fd36e00` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:51.312754 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:51.314671 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92638a5-872e-41ba-b9af-6b34d25e10ec None admin] RBAC: Authorizing `identity:get_group(group_id=43305103e06a4e25acc80d7d0fd36e00)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:51.317513 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92638a5-872e-41ba-b9af-6b34d25e10ec None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:51.317652 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115194a8-4b5c-49d5-87b4-2e42fe648afa None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:51.318258 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 181/351] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Jul 18 10:22:51 2022] GET /identity/v3/groups/43305103e06a4e25acc80d7d0fd36e00 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:51.319110 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92638a5-872e-41ba-b9af-6b34d25e10ec None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:51.373092 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0582ec30-12e0-4574-b9d0-d7c7ad58c827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:51.373092 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582ec30-12e0-4574-b9d0-d7c7ad58c827 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:51.373092 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582ec30-12e0-4574-b9d0-d7c7ad58c827 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:51.373092 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0582ec30-12e0-4574-b9d0-d7c7ad58c827 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:51.388817 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0582ec30-12e0-4574-b9d0-d7c7ad58c827 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:22:51.397454 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-0582ec30-12e0-4574-b9d0-d7c7ad58c827 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 10:22:51.397454 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:22:51.397454 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:22:51.397454 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:22:51.397454 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:22:51.397454 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:22:51.397454 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:22:51.397454 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:22:51.397454 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:22:51.397454 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:22:51.397454 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:22:51.397454 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:22:51.397454 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:22:51.397454 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:22:51.397454 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:22:51.397454 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:22:51.398982 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:22:51.398982 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:22:51.398982 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:22:51.398982 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:22:51.398982 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:22:51.398982 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:22:51.398982 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:22:51.398982 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:22:51.398982 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:22:51.398982 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:22:51.398982 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:22:51.398982 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:22:51.398982 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:22:51.398982 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:22:51.398982 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:22:51.398982 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:22:51.399897 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:22:51.399897 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:22:51.399897 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:22:51.399897 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:22:51.399897 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:22:51.399897 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:22:51.399897 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:22:51.399897 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:22:51.399897 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:22:51.399897 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:22:51.399897 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 10:22:51.399897 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:22:51.402261 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 171/352] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 10:22:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:22:51.403200 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0582ec30-12e0-4574-b9d0-d7c7ad58c827 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:51.450542 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92638a5-872e-41ba-b9af-6b34d25e10ec None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:51.503743 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8fdaad-3808-4946-ad1c-e74b005ec518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:51.504553 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8fdaad-3808-4946-ad1c-e74b005ec518 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:51.504841 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8fdaad-3808-4946-ad1c-e74b005ec518 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:51.505147 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8fdaad-3808-4946-ad1c-e74b005ec518 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:51.522350 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8fdaad-3808-4946-ad1c-e74b005ec518 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:22:51.526546 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0582ec30-12e0-4574-b9d0-d7c7ad58c827 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:51.531056 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-5e8fdaad-3808-4946-ad1c-e74b005ec518 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:22:51.531056 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:22:51.531056 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:22:51.531056 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:22:51.531056 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:22:51.531056 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:22:51.531056 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:22:51.531056 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:22:51.531056 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:22:51.531056 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:22:51.531056 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:22:51.531056 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:22:51.531056 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:22:51.531056 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:22:51.531056 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:22:51.531056 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:22:51.532199 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:22:51.532199 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:22:51.532199 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:22:51.532199 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:22:51.532199 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:22:51.532199 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:22:51.532199 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:22:51.532199 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:22:51.532199 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:22:51.532199 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:22:51.532199 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:22:51.532199 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:22:51.532199 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:22:51.532199 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:22:51.532199 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:22:51.532199 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:22:51.533255 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:22:51.533255 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:22:51.533255 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:22:51.533255 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:22:51.533255 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:22:51.533255 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:22:51.533255 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:22:51.533255 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:22:51.533255 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:22:51.533255 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:22:51.533255 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:22:51.533255 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:22:51.535362 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 182/353] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 10:22:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:22:51.536891 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db9963-5012-45e2-974b-a26719d8bb69 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:51.537395 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db9963-5012-45e2-974b-a26719d8bb69 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:51.537837 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db9963-5012-45e2-974b-a26719d8bb69 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:51.539518 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 183/354] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:22:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:22:51.540358 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db9963-5012-45e2-974b-a26719d8bb69 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:51.546625 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:51.576082 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1013eff-54c4-436b-88a3-a51082f0c0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:51.577347 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1013eff-54c4-436b-88a3-a51082f0c0f6 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:51.577635 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1013eff-54c4-436b-88a3-a51082f0c0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:51.577917 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1013eff-54c4-436b-88a3-a51082f0c0f6 None admin] PATH_INFO: `/v3/groups/43305103e06a4e25acc80d7d0fd36e00` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:51.581194 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1013eff-54c4-436b-88a3-a51082f0c0f6 None admin] RBAC: Authorizing `identity:get_group(group_id=43305103e06a4e25acc80d7d0fd36e00)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:51.583720 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1013eff-54c4-436b-88a3-a51082f0c0f6 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:51.585991 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 172/355] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Jul 18 10:22:51 2022] GET /identity/v3/groups/43305103e06a4e25acc80d7d0fd36e00 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:51.586995 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1013eff-54c4-436b-88a3-a51082f0c0f6 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:51.628257 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:51.688300 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db9963-5012-45e2-974b-a26719d8bb69 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:51.720603 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1013eff-54c4-436b-88a3-a51082f0c0f6 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:51.732764 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82703ba8-2566-4670-aeb8-cba5abe8c81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:51.733792 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82703ba8-2566-4670-aeb8-cba5abe8c81b None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:51.734082 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82703ba8-2566-4670-aeb8-cba5abe8c81b None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:51.734359 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82703ba8-2566-4670-aeb8-cba5abe8c81b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:51.735547 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82703ba8-2566-4670-aeb8-cba5abe8c81b None admin] RBAC: Adding query filter params (group.id=43305103e06a4e25acc80d7d0fd36e00, role.id=907cee10dffd48b2bec00719e425d3bd, scope.project.id=e3ce0a1d0d104f4ba20f8d0b63301a51) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:51.736391 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82703ba8-2566-4670-aeb8-cba5abe8c81b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:51.737905 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82703ba8-2566-4670-aeb8-cba5abe8c81b None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:51.745779 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 184/356] 10.222.0.39 () {56 vars in 1376 bytes} [Mon Jul 18 10:22:51 2022] GET /identity/v3/role_assignments?group.id=43305103e06a4e25acc80d7d0fd36e00&scope.project.id=e3ce0a1d0d104f4ba20f8d0b63301a51&role.id=907cee10dffd48b2bec00719e425d3bd => generated 260 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:51.749224 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82703ba8-2566-4670-aeb8-cba5abe8c81b None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:51.765680 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b8abb4-e3a6-4ba3-a75d-81b8826b9371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:51.767623 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8abb4-e3a6-4ba3-a75d-81b8826b9371 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:51.768100 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8abb4-e3a6-4ba3-a75d-81b8826b9371 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:51.768561 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8abb4-e3a6-4ba3-a75d-81b8826b9371 None admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:51.769617 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b8abb4-e3a6-4ba3-a75d-81b8826b9371 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:51.769931 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b8abb4-e3a6-4ba3-a75d-81b8826b9371 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:51.771432 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b8abb4-e3a6-4ba3-a75d-81b8826b9371 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:51.783583 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 173/357] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jul 18 10:22:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:51.784784 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ed546-c090-4212-adf6-9ea5d7359584 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:51.785107 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ed546-c090-4212-adf6-9ea5d7359584 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:51.785680 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ed546-c090-4212-adf6-9ea5d7359584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:51.805784 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-868ed546-c090-4212-adf6-9ea5d7359584 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:22:51.807354 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-868ed546-c090-4212-adf6-9ea5d7359584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:22:51.838943 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:51.882359 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82703ba8-2566-4670-aeb8-cba5abe8c81b None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:51.909423 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 174/358] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:22:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:22:51.910979 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ed546-c090-4212-adf6-9ea5d7359584 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:51.934184 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee709e0-d926-45fd-bacb-9c32febad8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:51.934924 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee709e0-d926-45fd-bacb-9c32febad8b5 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:51.935236 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee709e0-d926-45fd-bacb-9c32febad8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:51.936764 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee709e0-d926-45fd-bacb-9c32febad8b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:51.936764 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee709e0-d926-45fd-bacb-9c32febad8b5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:51.936764 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee709e0-d926-45fd-bacb-9c32febad8b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:51.938530 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee709e0-d926-45fd-bacb-9c32febad8b5 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:51.943209 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:51.954609 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 185/359] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jul 18 10:22:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:51.956098 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f6f30f-cf18-4e3e-b389-6084399dd506 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:51.956457 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f6f30f-cf18-4e3e-b389-6084399dd506 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:51.956803 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f6f30f-cf18-4e3e-b389-6084399dd506 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:51.963060 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 186/360] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:22:51 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:22:51.963938 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f6f30f-cf18-4e3e-b389-6084399dd506 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:52.050444 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ed546-c090-4212-adf6-9ea5d7359584 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:52.098957 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f6f30f-cf18-4e3e-b389-6084399dd506 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:52.105782 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508846a2-710a-4f7f-9bfb-15ac11bce439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:52.106463 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508846a2-710a-4f7f-9bfb-15ac11bce439 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:52.106749 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508846a2-710a-4f7f-9bfb-15ac11bce439 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:52.107027 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508846a2-710a-4f7f-9bfb-15ac11bce439 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:52.108482 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508846a2-710a-4f7f-9bfb-15ac11bce439 None admin] RBAC: Adding query filter params (group.id=43305103e06a4e25acc80d7d0fd36e00, role.id=45f8992b0f6941c7a64290b437d6bd5e, scope.project.id=e3ce0a1d0d104f4ba20f8d0b63301a51) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:52.108482 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508846a2-710a-4f7f-9bfb-15ac11bce439 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:52.110371 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508846a2-710a-4f7f-9bfb-15ac11bce439 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:52.116975 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 175/361] 10.222.0.39 () {56 vars in 1376 bytes} [Mon Jul 18 10:22:51 2022] GET /identity/v3/role_assignments?group.id=43305103e06a4e25acc80d7d0fd36e00&scope.project.id=e3ce0a1d0d104f4ba20f8d0b63301a51&role.id=45f8992b0f6941c7a64290b437d6bd5e => generated 260 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:52.117810 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508846a2-710a-4f7f-9bfb-15ac11bce439 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:52.175059 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:52.184425 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf167dc-3b13-47cb-88d9-fde69ec8cae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:52.185912 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf167dc-3b13-47cb-88d9-fde69ec8cae5 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:52.193979 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf167dc-3b13-47cb-88d9-fde69ec8cae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:52.193979 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf167dc-3b13-47cb-88d9-fde69ec8cae5 None admin] PATH_INFO: `/v3/users/a1c1ad39b5d04fd2895715f82e1da852` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:52.193979 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf167dc-3b13-47cb-88d9-fde69ec8cae5 None admin] RBAC: Authorizing `identity:get_user(user_id=a1c1ad39b5d04fd2895715f82e1da852)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:52.193979 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf167dc-3b13-47cb-88d9-fde69ec8cae5 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:52.193979 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 187/362] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 10:22:51 2022] GET /identity/v3/users/a1c1ad39b5d04fd2895715f82e1da852 => generated 293 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:52.195015 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf167dc-3b13-47cb-88d9-fde69ec8cae5 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:52.239914 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:52.265496 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508846a2-710a-4f7f-9bfb-15ac11bce439 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:52.318222 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac438d-d24b-4837-93e8-a3329c2318a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:52.319259 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac438d-d24b-4837-93e8-a3329c2318a6 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:52.319598 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac438d-d24b-4837-93e8-a3329c2318a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:52.319876 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac438d-d24b-4837-93e8-a3329c2318a6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:52.335401 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac438d-d24b-4837-93e8-a3329c2318a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:22:52.340284 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf167dc-3b13-47cb-88d9-fde69ec8cae5 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:52.346586 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-29ac438d-d24b-4837-93e8-a3329c2318a6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 10:22:52.346586 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:22:52.346586 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:22:52.346586 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:22:52.346586 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:22:52.346586 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:22:52.346586 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:22:52.346586 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:22:52.346586 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:22:52.346586 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:22:52.346586 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:22:52.346586 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:22:52.346586 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:22:52.346586 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:22:52.346586 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:22:52.346586 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:22:52.347486 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:22:52.347486 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:22:52.347486 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:22:52.347486 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:22:52.347486 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:22:52.347486 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:22:52.347486 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:22:52.347486 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:22:52.347486 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:22:52.347486 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:22:52.347486 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:22:52.347486 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:22:52.347486 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:22:52.347486 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:22:52.347486 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:22:52.347486 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:22:52.348283 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:22:52.348283 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:22:52.348283 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:22:52.348283 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:22:52.348283 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:22:52.348283 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:22:52.348283 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:22:52.348283 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:22:52.348283 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:22:52.348283 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:22:52.348283 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 10:22:52.348283 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:22:52.348283 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 176/363] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Jul 18 10:22:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:22:52.353074 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34b285-3e66-47c6-b11c-97f733c7dfab None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:52.353074 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34b285-3e66-47c6-b11c-97f733c7dfab None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:52.353074 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34b285-3e66-47c6-b11c-97f733c7dfab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:52.374101 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-cd34b285-3e66-47c6-b11c-97f733c7dfab None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:22:52.377979 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-cd34b285-3e66-47c6-b11c-97f733c7dfab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:22:52.388940 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac27d1-ee11-43f1-9a27-27b9c05bd9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:52.389977 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac27d1-ee11-43f1-9a27-27b9c05bd9e5 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:52.390484 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac27d1-ee11-43f1-9a27-27b9c05bd9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:52.390991 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac27d1-ee11-43f1-9a27-27b9c05bd9e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:52.461411 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 177/364] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:22:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:22:52.462339 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd34b285-3e66-47c6-b11c-97f733c7dfab None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:52.474916 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac27d1-ee11-43f1-9a27-27b9c05bd9e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:52.477004 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac27d1-ee11-43f1-9a27-27b9c05bd9e5 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:52.481377 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:52.588434 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:52.613369 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 188/365] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 10:22:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:22:52.614229 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac27d1-ee11-43f1-9a27-27b9c05bd9e5 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:52.623185 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd34b285-3e66-47c6-b11c-97f733c7dfab None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:52.667625 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f65eeb-2a4a-45d9-8586-cdfba2993f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:52.668914 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f65eeb-2a4a-45d9-8586-cdfba2993f80 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:52.669413 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f65eeb-2a4a-45d9-8586-cdfba2993f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:52.670041 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f65eeb-2a4a-45d9-8586-cdfba2993f80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:52.671438 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f65eeb-2a4a-45d9-8586-cdfba2993f80 None admin] RBAC: Adding query filter params (role.id=c2ae722a355f4d73b11124bcf553fe8c, user.id=a1c1ad39b5d04fd2895715f82e1da852, scope.system=all) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:52.672755 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f65eeb-2a4a-45d9-8586-cdfba2993f80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:52.674610 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f65eeb-2a4a-45d9-8586-cdfba2993f80 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:52.691224 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 178/366] 10.222.0.39 () {56 vars in 1308 bytes} [Mon Jul 18 10:22:52 2022] GET /identity/v3/role_assignments?user.id=a1c1ad39b5d04fd2895715f82e1da852&scope.system=all&role.id=c2ae722a355f4d73b11124bcf553fe8c => generated 510 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:52.692478 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f65eeb-2a4a-45d9-8586-cdfba2993f80 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:52.820618 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f65eeb-2a4a-45d9-8586-cdfba2993f80 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:52.830919 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:52.847304 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac27d1-ee11-43f1-9a27-27b9c05bd9e5 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:52.857439 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:52.869617 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92897afc-3358-463d-a486-34031c1cde81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:52.870675 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92897afc-3358-463d-a486-34031c1cde81 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:52.871054 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92897afc-3358-463d-a486-34031c1cde81 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:52.871426 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92897afc-3358-463d-a486-34031c1cde81 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:52.884979 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92897afc-3358-463d-a486-34031c1cde81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:22:52.893590 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-92897afc-3358-463d-a486-34031c1cde81 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:22:52.893590 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:22:52.893590 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:22:52.893590 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:22:52.893590 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:22:52.893590 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:22:52.893590 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:22:52.893590 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:22:52.893590 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:22:52.893590 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:22:52.893590 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:22:52.893590 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:22:52.893590 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:22:52.893590 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:22:52.893590 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:22:52.893590 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:22:52.894573 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:22:52.894573 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:22:52.894573 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:22:52.894573 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:22:52.894573 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:22:52.894573 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:22:52.894573 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:22:52.894573 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:22:52.894573 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:22:52.894573 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:22:52.894573 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:22:52.894573 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:22:52.894573 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:22:52.894573 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:22:52.894573 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:22:52.894573 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:22:52.895370 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:22:52.895370 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:22:52.895370 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:22:52.895370 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:22:52.895370 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:22:52.895370 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:22:52.895370 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:22:52.895370 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:22:52.895370 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:22:52.895370 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:22:52.895370 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:22:52.895370 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:22:52.895970 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 179/367] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 10:22:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:22:52.901086 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92897afc-3358-463d-a486-34031c1cde81 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:52.940185 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b87e3-01a0-440e-9d81-68d0beb4cc54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:52.941264 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b87e3-01a0-440e-9d81-68d0beb4cc54 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:52.941713 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b87e3-01a0-440e-9d81-68d0beb4cc54 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:52.942136 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b87e3-01a0-440e-9d81-68d0beb4cc54 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:52.944216 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50b87e3-01a0-440e-9d81-68d0beb4cc54 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:52.944216 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50b87e3-01a0-440e-9d81-68d0beb4cc54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:52.945420 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50b87e3-01a0-440e-9d81-68d0beb4cc54 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:52.960356 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 189/368] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 10:22:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:52.961748 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b87e3-01a0-440e-9d81-68d0beb4cc54 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:53.047830 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92897afc-3358-463d-a486-34031c1cde81 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:53.102120 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1187538-33ef-4b54-b2bc-fcaaafe8d21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:53.103038 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1187538-33ef-4b54-b2bc-fcaaafe8d21b None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:53.103386 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1187538-33ef-4b54-b2bc-fcaaafe8d21b None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:53.103724 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1187538-33ef-4b54-b2bc-fcaaafe8d21b None admin] PATH_INFO: `/v3/projects/cd29577200c54cde8573db439fcbf179` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:53.106037 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1187538-33ef-4b54-b2bc-fcaaafe8d21b None admin] RBAC: Authorizing `identity:get_project(project_id=cd29577200c54cde8573db439fcbf179)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:53.107571 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1187538-33ef-4b54-b2bc-fcaaafe8d21b None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:53.113405 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 180/369] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 10:22:52 2022] GET /identity/v3/projects/cd29577200c54cde8573db439fcbf179 => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:53.114320 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1187538-33ef-4b54-b2bc-fcaaafe8d21b None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:53.116367 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b87e3-01a0-440e-9d81-68d0beb4cc54 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:53.162819 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d646e37-182d-41fc-a359-19e9a436db0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:53.163733 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d646e37-182d-41fc-a359-19e9a436db0b None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:53.164166 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d646e37-182d-41fc-a359-19e9a436db0b None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:53.164588 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d646e37-182d-41fc-a359-19e9a436db0b None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:53.166066 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d646e37-182d-41fc-a359-19e9a436db0b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:53.166529 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d646e37-182d-41fc-a359-19e9a436db0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:53.168526 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d646e37-182d-41fc-a359-19e9a436db0b None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:53.180601 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 190/370] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 10:22:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:53.186817 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d646e37-182d-41fc-a359-19e9a436db0b None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:53.190797 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:53.219603 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:53.253336 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1187538-33ef-4b54-b2bc-fcaaafe8d21b None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:53.296277 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e7890b-0cf0-4af3-a981-4c848584ebfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:53.297009 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e7890b-0cf0-4af3-a981-4c848584ebfd None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:53.297306 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e7890b-0cf0-4af3-a981-4c848584ebfd None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:53.297625 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e7890b-0cf0-4af3-a981-4c848584ebfd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:53.320603 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d646e37-182d-41fc-a359-19e9a436db0b None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:53.376853 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e165bd2-3a4b-42cb-a2de-c2894ef06a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:53.377696 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e165bd2-3a4b-42cb-a2de-c2894ef06a24 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:53.378460 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e165bd2-3a4b-42cb-a2de-c2894ef06a24 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:53.378460 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e165bd2-3a4b-42cb-a2de-c2894ef06a24 None admin] PATH_INFO: `/v3/groups/43305103e06a4e25acc80d7d0fd36e00` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:53.379611 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e165bd2-3a4b-42cb-a2de-c2894ef06a24 None admin] RBAC: Authorizing `identity:get_group(group_id=43305103e06a4e25acc80d7d0fd36e00)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:53.380941 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e7890b-0cf0-4af3-a981-4c848584ebfd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:53.381127 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e165bd2-3a4b-42cb-a2de-c2894ef06a24 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:53.382732 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e7890b-0cf0-4af3-a981-4c848584ebfd None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:53.382858 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 191/371] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Jul 18 10:22:53 2022] GET /identity/v3/groups/43305103e06a4e25acc80d7d0fd36e00 => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:53.383506 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e165bd2-3a4b-42cb-a2de-c2894ef06a24 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:53.470593 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:53.505243 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:53.518286 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e165bd2-3a4b-42cb-a2de-c2894ef06a24 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:53.520266 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 181/372] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 10:22:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:22:53.526886 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e7890b-0cf0-4af3-a981-4c848584ebfd None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:53.557997 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bee0dd-8b69-4739-b6e2-b8dc886377f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:53.558943 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bee0dd-8b69-4739-b6e2-b8dc886377f5 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:53.559384 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bee0dd-8b69-4739-b6e2-b8dc886377f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:53.559832 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bee0dd-8b69-4739-b6e2-b8dc886377f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:53.634971 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e7890b-0cf0-4af3-a981-4c848584ebfd None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:53.639240 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bee0dd-8b69-4739-b6e2-b8dc886377f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:53.640913 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bee0dd-8b69-4739-b6e2-b8dc886377f5 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:53.675572 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc78810-a55f-4d96-8a50-b6e45ea3c625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:53.676340 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc78810-a55f-4d96-8a50-b6e45ea3c625 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:53.676880 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc78810-a55f-4d96-8a50-b6e45ea3c625 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:53.677186 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc78810-a55f-4d96-8a50-b6e45ea3c625 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:53.678149 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc78810-a55f-4d96-8a50-b6e45ea3c625 None admin] RBAC: Adding query filter params (group.id=43305103e06a4e25acc80d7d0fd36e00, role.id=907cee10dffd48b2bec00719e425d3bd, scope.project.id=cd29577200c54cde8573db439fcbf179) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:53.678515 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc78810-a55f-4d96-8a50-b6e45ea3c625 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:53.680051 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc78810-a55f-4d96-8a50-b6e45ea3c625 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:53.686859 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 182/373] 10.222.0.39 () {56 vars in 1376 bytes} [Mon Jul 18 10:22:53 2022] GET /identity/v3/role_assignments?group.id=43305103e06a4e25acc80d7d0fd36e00&scope.project.id=cd29577200c54cde8573db439fcbf179&role.id=907cee10dffd48b2bec00719e425d3bd => generated 260 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:53.687474 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc78810-a55f-4d96-8a50-b6e45ea3c625 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:53.729807 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:53.760271 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:53.775032 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 192/374] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 10:22:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:22:53.780905 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bee0dd-8b69-4739-b6e2-b8dc886377f5 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:53.867497 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc78810-a55f-4d96-8a50-b6e45ea3c625 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:53.915075 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bee0dd-8b69-4739-b6e2-b8dc886377f5 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:53.953871 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f151b7d-2d4c-49c5-a661-66217968d358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:53.955074 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f151b7d-2d4c-49c5-a661-66217968d358 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:53.955632 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f151b7d-2d4c-49c5-a661-66217968d358 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:53.956099 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f151b7d-2d4c-49c5-a661-66217968d358 None admin] PATH_INFO: `/v3/projects/ec4a529f46e64ec0b911c3fbc2a942cb` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:53.957543 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f151b7d-2d4c-49c5-a661-66217968d358 None admin] RBAC: Authorizing `identity:get_project(project_id=ec4a529f46e64ec0b911c3fbc2a942cb)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:53.959178 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f151b7d-2d4c-49c5-a661-66217968d358 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:53.961403 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 193/375] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 10:22:53 2022] GET /identity/v3/projects/ec4a529f46e64ec0b911c3fbc2a942cb => generated 344 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:53.969883 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd75a086-b8a2-4d04-bd9b-8e9f0b5cde26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:53.969883 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75a086-b8a2-4d04-bd9b-8e9f0b5cde26 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:53.969883 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75a086-b8a2-4d04-bd9b-8e9f0b5cde26 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:53.969883 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75a086-b8a2-4d04-bd9b-8e9f0b5cde26 None admin] PATH_INFO: `/v3/projects/cd29577200c54cde8573db439fcbf179` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:53.971991 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd75a086-b8a2-4d04-bd9b-8e9f0b5cde26 None admin] RBAC: Authorizing `identity:get_project(project_id=cd29577200c54cde8573db439fcbf179)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:53.972649 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f151b7d-2d4c-49c5-a661-66217968d358 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:53.973478 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd75a086-b8a2-4d04-bd9b-8e9f0b5cde26 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:53.975460 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 183/376] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 10:22:53 2022] GET /identity/v3/projects/cd29577200c54cde8573db439fcbf179 => generated 302 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:53.980494 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd75a086-b8a2-4d04-bd9b-8e9f0b5cde26 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:54.040351 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:54.123387 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f151b7d-2d4c-49c5-a661-66217968d358 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:54.128874 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:54.142296 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd75a086-b8a2-4d04-bd9b-8e9f0b5cde26 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:54.178426 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888bc080-ccfb-47b3-9ad0-66e23aaded95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:54.181308 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888bc080-ccfb-47b3-9ad0-66e23aaded95 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:54.182348 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888bc080-ccfb-47b3-9ad0-66e23aaded95 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:54.182624 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888bc080-ccfb-47b3-9ad0-66e23aaded95 None admin] PATH_INFO: `/v3/groups/7cd775a2e7a149be8a812c1493d7e9e5` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:54.187567 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702f374-ca22-4ec1-8fff-f038dd31e1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:54.189970 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888bc080-ccfb-47b3-9ad0-66e23aaded95 None admin] RBAC: Authorizing `identity:get_group(group_id=7cd775a2e7a149be8a812c1493d7e9e5)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:54.190340 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702f374-ca22-4ec1-8fff-f038dd31e1f6 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:54.190838 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702f374-ca22-4ec1-8fff-f038dd31e1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:54.191317 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6702f374-ca22-4ec1-8fff-f038dd31e1f6 None admin] PATH_INFO: `/v3/groups/43305103e06a4e25acc80d7d0fd36e00` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:54.191426 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888bc080-ccfb-47b3-9ad0-66e23aaded95 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:54.192847 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6702f374-ca22-4ec1-8fff-f038dd31e1f6 None admin] RBAC: Authorizing `identity:get_group(group_id=43305103e06a4e25acc80d7d0fd36e00)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:54.193402 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 194/377] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Jul 18 10:22:53 2022] GET /identity/v3/groups/7cd775a2e7a149be8a812c1493d7e9e5 => generated 229 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:22:54.194668 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c8c7e-b6ac-4968-8d81-38bcc337c153 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:54.195041 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6702f374-ca22-4ec1-8fff-f038dd31e1f6 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:54.197172 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 184/378] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Jul 18 10:22:53 2022] GET /identity/v3/groups/43305103e06a4e25acc80d7d0fd36e00 => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:22:54.199573 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c8c7e-b6ac-4968-8d81-38bcc337c153 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:54.199867 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c8c7e-b6ac-4968-8d81-38bcc337c153 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:54.200651 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702f374-ca22-4ec1-8fff-f038dd31e1f6 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:54.201225 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 195/379] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:22:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:22:54.202485 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c8c7e-b6ac-4968-8d81-38bcc337c153 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:54.338390 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6702f374-ca22-4ec1-8fff-f038dd31e1f6 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:54.354578 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c8c7e-b6ac-4968-8d81-38bcc337c153 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:54.389585 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:54.391709 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d672c1f-19f7-4df7-8dd5-351c21c678c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:54.392739 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d672c1f-19f7-4df7-8dd5-351c21c678c3 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:54.393250 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d672c1f-19f7-4df7-8dd5-351c21c678c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:54.393730 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d672c1f-19f7-4df7-8dd5-351c21c678c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:54.394770 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d672c1f-19f7-4df7-8dd5-351c21c678c3 None admin] RBAC: Adding query filter params (group.id=7cd775a2e7a149be8a812c1493d7e9e5, role.id=e7b6a55ecf6c491487955aaefbf9c388, scope.project.id=ec4a529f46e64ec0b911c3fbc2a942cb) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:54.395336 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d672c1f-19f7-4df7-8dd5-351c21c678c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:54.396590 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e475d2e-e30b-475c-9e67-196969a1d8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:54.397236 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d672c1f-19f7-4df7-8dd5-351c21c678c3 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:54.402239 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e475d2e-e30b-475c-9e67-196969a1d8b4 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:54.402239 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e475d2e-e30b-475c-9e67-196969a1d8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:54.402239 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e475d2e-e30b-475c-9e67-196969a1d8b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:54.402239 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e475d2e-e30b-475c-9e67-196969a1d8b4 None admin] RBAC: Adding query filter params (group.id=43305103e06a4e25acc80d7d0fd36e00, role.id=45f8992b0f6941c7a64290b437d6bd5e, scope.project.id=cd29577200c54cde8573db439fcbf179) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:54.402239 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e475d2e-e30b-475c-9e67-196969a1d8b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:54.402239 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e475d2e-e30b-475c-9e67-196969a1d8b4 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:54.405018 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 185/380] 10.222.0.39 () {56 vars in 1376 bytes} [Mon Jul 18 10:22:54 2022] GET /identity/v3/role_assignments?group.id=7cd775a2e7a149be8a812c1493d7e9e5&scope.project.id=ec4a529f46e64ec0b911c3fbc2a942cb&role.id=e7b6a55ecf6c491487955aaefbf9c388 => generated 260 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:22:54.410868 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb94dcf-50ed-4d92-a22d-b4d5159a3ec1 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:54.411161 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb94dcf-50ed-4d92-a22d-b4d5159a3ec1 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:54.411487 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb94dcf-50ed-4d92-a22d-b4d5159a3ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:54.413568 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 196/381] 10.222.0.39 () {56 vars in 1376 bytes} [Mon Jul 18 10:22:54 2022] GET /identity/v3/role_assignments?group.id=43305103e06a4e25acc80d7d0fd36e00&scope.project.id=cd29577200c54cde8573db439fcbf179&role.id=45f8992b0f6941c7a64290b437d6bd5e => generated 260 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:22:54.434905 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-2cb94dcf-50ed-4d92-a22d-b4d5159a3ec1 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:22:54.436104 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-2cb94dcf-50ed-4d92-a22d-b4d5159a3ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:22:54.460646 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:54.522860 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 186/382] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:22:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:22:54.545652 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e475d2e-e30b-475c-9e67-196969a1d8b4 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:54.669355 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e475d2e-e30b-475c-9e67-196969a1d8b4 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:54.715431 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a77581-7f30-472c-ac69-a8bec12608ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:54.716155 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a77581-7f30-472c-ac69-a8bec12608ae None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:54.716432 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a77581-7f30-472c-ac69-a8bec12608ae None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:54.716706 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a77581-7f30-472c-ac69-a8bec12608ae None admin] PATH_INFO: `/v3/roles/member` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:54.732081 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a77581-7f30-472c-ac69-a8bec12608ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:22:54.741136 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-38a77581-7f30-472c-ac69-a8bec12608ae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:22:54.741136 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:22:54.741136 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:22:54.741136 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:22:54.741136 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:22:54.741136 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:22:54.741136 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:22:54.741136 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:22:54.741136 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:22:54.741136 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:22:54.741136 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:22:54.741136 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:22:54.741136 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:22:54.741136 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:22:54.741136 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:22:54.741136 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:22:54.742047 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:22:54.742047 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:22:54.742047 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:22:54.742047 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:22:54.742047 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:22:54.742047 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:22:54.742047 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:22:54.742047 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:22:54.742047 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:22:54.742047 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:22:54.742047 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:22:54.742047 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:22:54.742047 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:22:54.742047 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:22:54.742047 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:22:54.742047 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:22:54.742874 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:22:54.742874 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:22:54.742874 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:22:54.742874 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:22:54.742874 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:22:54.742874 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:22:54.742874 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:22:54.742874 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:22:54.742874 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:22:54.742874 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:22:54.742874 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:22:54.742874 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:22:54.747141 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 197/383] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 10:22:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:22:54.748493 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb94dcf-50ed-4d92-a22d-b4d5159a3ec1 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:54.858901 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45277613-ec84-4c1f-8101-c1d0b7ee582c None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:54.859224 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45277613-ec84-4c1f-8101-c1d0b7ee582c None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:54.859496 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45277613-ec84-4c1f-8101-c1d0b7ee582c None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:54.862391 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 198/384] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:22:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:22:54.866707 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457166c-30e6-4119-875c-1b3118332ebe None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:54.866998 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457166c-30e6-4119-875c-1b3118332ebe None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:54.867281 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f457166c-30e6-4119-875c-1b3118332ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:54.871222 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb94dcf-50ed-4d92-a22d-b4d5159a3ec1 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:54.887642 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-f457166c-30e6-4119-875c-1b3118332ebe None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:22:54.888840 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-f457166c-30e6-4119-875c-1b3118332ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:22:54.932077 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e53eef-f19d-4bc3-b953-c1091ea2cdad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:54.932807 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e53eef-f19d-4bc3-b953-c1091ea2cdad None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:54.933109 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e53eef-f19d-4bc3-b953-c1091ea2cdad None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:54.933381 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e53eef-f19d-4bc3-b953-c1091ea2cdad None admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:54.934139 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e53eef-f19d-4bc3-b953-c1091ea2cdad None admin] RBAC: Adding query filter params (name=member) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:54.934449 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e53eef-f19d-4bc3-b953-c1091ea2cdad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:54.935842 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e53eef-f19d-4bc3-b953-c1091ea2cdad None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:54.959871 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 187/385] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jul 18 10:22:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:54.963804 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e53eef-f19d-4bc3-b953-c1091ea2cdad None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:54.970065 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:54.999991 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:55.029337 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 199/386] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:22:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 10:22:55.047862 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f457166c-30e6-4119-875c-1b3118332ebe None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:55.179147 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f457166c-30e6-4119-875c-1b3118332ebe None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:55.200383 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e53eef-f19d-4bc3-b953-c1091ea2cdad None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:55.219524 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85fa041-a951-45b0-9987-b6a317abcd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:55.220249 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85fa041-a951-45b0-9987-b6a317abcd8c None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:55.220480 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85fa041-a951-45b0-9987-b6a317abcd8c None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:55.221178 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85fa041-a951-45b0-9987-b6a317abcd8c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:55.233127 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85fa041-a951-45b0-9987-b6a317abcd8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:22:55.242299 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-e85fa041-a951-45b0-9987-b6a317abcd8c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 10:22:55.242299 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:22:55.242299 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:22:55.242299 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:22:55.242299 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:22:55.242299 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:22:55.242299 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:22:55.242299 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:22:55.242299 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:22:55.242299 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:22:55.242299 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:22:55.242299 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:22:55.242299 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:22:55.242299 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:22:55.242299 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:22:55.242299 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:22:55.243176 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:22:55.243176 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:22:55.243176 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:22:55.243176 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:22:55.243176 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:22:55.243176 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:22:55.243176 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:22:55.243176 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:22:55.243176 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:22:55.243176 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:22:55.243176 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:22:55.243176 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:22:55.243176 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:22:55.243176 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:22:55.243176 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:22:55.243176 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:22:55.243953 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:22:55.243953 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:22:55.243953 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:22:55.243953 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:22:55.243953 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:22:55.243953 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:22:55.243953 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:22:55.243953 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:22:55.243953 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:22:55.243953 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:22:55.243953 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 10:22:55.243953 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:22:55.246657 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 200/387] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Jul 18 10:22:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:22:55.251164 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85fa041-a951-45b0-9987-b6a317abcd8c None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:55.274043 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10afed-6149-4a5d-a505-63b2ef759b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:55.275381 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10afed-6149-4a5d-a505-63b2ef759b5f None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:55.275884 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10afed-6149-4a5d-a505-63b2ef759b5f None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:55.276364 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10afed-6149-4a5d-a505-63b2ef759b5f None admin] PATH_INFO: `/v3/groups/43305103e06a4e25acc80d7d0fd36e00` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:55.277862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a10afed-6149-4a5d-a505-63b2ef759b5f None admin] RBAC: Authorizing `identity:get_group(group_id=43305103e06a4e25acc80d7d0fd36e00)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:55.279499 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a10afed-6149-4a5d-a505-63b2ef759b5f None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:55.289067 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 188/388] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Jul 18 10:22:54 2022] GET /identity/v3/groups/43305103e06a4e25acc80d7d0fd36e00 => generated 226 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:55.290271 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10afed-6149-4a5d-a505-63b2ef759b5f None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:55.291540 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:55.379257 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85fa041-a951-45b0-9987-b6a317abcd8c None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:55.397793 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:55.417580 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10afed-6149-4a5d-a505-63b2ef759b5f None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:55.425119 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5f88de-33c1-4cbf-adf5-8b6cc2c7b44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:55.425806 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f88de-33c1-4cbf-adf5-8b6cc2c7b44a None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:55.426088 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f88de-33c1-4cbf-adf5-8b6cc2c7b44a None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:55.426362 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f88de-33c1-4cbf-adf5-8b6cc2c7b44a None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:55.427601 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5f88de-33c1-4cbf-adf5-8b6cc2c7b44a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:55.427928 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5f88de-33c1-4cbf-adf5-8b6cc2c7b44a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:55.429546 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5f88de-33c1-4cbf-adf5-8b6cc2c7b44a None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:55.445133 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 201/389] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 10:22:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:22:55.447248 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5f88de-33c1-4cbf-adf5-8b6cc2c7b44a None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:55.467477 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3d043a-11d9-4927-b319-b16264dc76f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:55.468710 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d043a-11d9-4927-b319-b16264dc76f9 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:55.469821 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d043a-11d9-4927-b319-b16264dc76f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:55.470377 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d043a-11d9-4927-b319-b16264dc76f9 None admin] PATH_INFO: `/v3/projects/e3ce0a1d0d104f4ba20f8d0b63301a51` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:55.472503 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3d043a-11d9-4927-b319-b16264dc76f9 None admin] RBAC: Authorizing `identity:get_project(project_id=e3ce0a1d0d104f4ba20f8d0b63301a51)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:55.474265 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3d043a-11d9-4927-b319-b16264dc76f9 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:55.476519 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 189/390] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 10:22:55 2022] GET /identity/v3/projects/e3ce0a1d0d104f4ba20f8d0b63301a51 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:55.482332 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3d043a-11d9-4927-b319-b16264dc76f9 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:55.581986 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:55.586894 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5f88de-33c1-4cbf-adf5-8b6cc2c7b44a None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:55.607035 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3d043a-11d9-4927-b319-b16264dc76f9 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:55.636354 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d338f126-9518-44d1-a838-eda08a4e00df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:55.637258 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338f126-9518-44d1-a838-eda08a4e00df None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:55.637544 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338f126-9518-44d1-a838-eda08a4e00df None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:55.637816 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338f126-9518-44d1-a838-eda08a4e00df None admin] PATH_INFO: `/v3/groups/43305103e06a4e25acc80d7d0fd36e00` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:55.639412 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d338f126-9518-44d1-a838-eda08a4e00df None admin] RBAC: Authorizing `identity:get_group(group_id=43305103e06a4e25acc80d7d0fd36e00)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:55.642320 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d338f126-9518-44d1-a838-eda08a4e00df None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:55.647930 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 202/391] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Jul 18 10:22:55 2022] GET /identity/v3/groups/43305103e06a4e25acc80d7d0fd36e00 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:22:55.651198 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d338f126-9518-44d1-a838-eda08a4e00df None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:55.654611 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb08bf3b-b142-4823-93b9-7f3b0277fe0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:55.655735 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08bf3b-b142-4823-93b9-7f3b0277fe0a None admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:55.656235 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08bf3b-b142-4823-93b9-7f3b0277fe0a None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:55.657349 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08bf3b-b142-4823-93b9-7f3b0277fe0a None admin] PATH_INFO: `/v3/projects/e3ce0a1d0d104f4ba20f8d0b63301a51/groups/43305103e06a4e25acc80d7d0fd36e00/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:55.660639 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb08bf3b-b142-4823-93b9-7f3b0277fe0a None admin] RBAC: Authorizing `identity:create_grant(project_id=e3ce0a1d0d104f4ba20f8d0b63301a51, group_id=43305103e06a4e25acc80d7d0fd36e00, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:55.662555 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb08bf3b-b142-4823-93b9-7f3b0277fe0a None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:55.744160 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 190/392] 10.222.0.39 () {58 vars in 1442 bytes} [Mon Jul 18 10:22:55 2022] PUT /identity/v3/projects/e3ce0a1d0d104f4ba20f8d0b63301a51/groups/43305103e06a4e25acc80d7d0fd36e00/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:22:55.763029 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d338f126-9518-44d1-a838-eda08a4e00df None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:55.803395 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0937040-77b4-418b-aa8b-aa3b3aeacfff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:55.804273 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0937040-77b4-418b-aa8b-aa3b3aeacfff None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:55.804555 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0937040-77b4-418b-aa8b-aa3b3aeacfff None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:55.804835 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0937040-77b4-418b-aa8b-aa3b3aeacfff None admin] PATH_INFO: `/v3/projects/e3ce0a1d0d104f4ba20f8d0b63301a51` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:55.806098 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0937040-77b4-418b-aa8b-aa3b3aeacfff None admin] RBAC: Authorizing `identity:get_project(project_id=e3ce0a1d0d104f4ba20f8d0b63301a51)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:55.807632 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0937040-77b4-418b-aa8b-aa3b3aeacfff None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:55.813480 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 203/393] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 10:22:55 2022] GET /identity/v3/projects/e3ce0a1d0d104f4ba20f8d0b63301a51 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:22:55.816472 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb08bf3b-b142-4823-93b9-7f3b0277fe0a None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:55.835623 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:55.941332 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb08bf3b-b142-4823-93b9-7f3b0277fe0a None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:55.983495 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c838b63d-b3cf-4a22-934c-dfb80764b9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:55.984535 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838b63d-b3cf-4a22-934c-dfb80764b9a2 None admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:55.985350 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838b63d-b3cf-4a22-934c-dfb80764b9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:55.985630 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838b63d-b3cf-4a22-934c-dfb80764b9a2 None admin] PATH_INFO: `/v3/projects/e3ce0a1d0d104f4ba20f8d0b63301a51/groups/43305103e06a4e25acc80d7d0fd36e00/roles/45f8992b0f6941c7a64290b437d6bd5e` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:55.988141 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c838b63d-b3cf-4a22-934c-dfb80764b9a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=e3ce0a1d0d104f4ba20f8d0b63301a51, group_id=43305103e06a4e25acc80d7d0fd36e00, role_id=45f8992b0f6941c7a64290b437d6bd5e)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:55.989733 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c838b63d-b3cf-4a22-934c-dfb80764b9a2 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:56.076647 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 191/394] 10.222.0.39 () {58 vars in 1442 bytes} [Mon Jul 18 10:22:55 2022] PUT /identity/v3/projects/e3ce0a1d0d104f4ba20f8d0b63301a51/groups/43305103e06a4e25acc80d7d0fd36e00/roles/45f8992b0f6941c7a64290b437d6bd5e => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:22:56.183821 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c426c5eb-4907-4c50-bbdc-e8f1162781c0 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:56.184476 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c426c5eb-4907-4c50-bbdc-e8f1162781c0 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:56.184957 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c426c5eb-4907-4c50-bbdc-e8f1162781c0 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:56.186844 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 204/395] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:22:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:22:56.193421 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0915259-5702-4a25-9028-2050f085200e None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:56.193713 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0915259-5702-4a25-9028-2050f085200e None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:56.193999 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0915259-5702-4a25-9028-2050f085200e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:56.218096 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-f0915259-5702-4a25-9028-2050f085200e None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:22:56.219951 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-f0915259-5702-4a25-9028-2050f085200e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:22:56.314882 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 192/396] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:22:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:22:56.355220 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c426c5eb-4907-4c50-bbdc-e8f1162781c0 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:56.414311 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:56.509744 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c426c5eb-4907-4c50-bbdc-e8f1162781c0 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:56.558437 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b93880-0c85-487a-9dfc-353fcfd1ce1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:56.559241 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b93880-0c85-487a-9dfc-353fcfd1ce1d None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:56.559520 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b93880-0c85-487a-9dfc-353fcfd1ce1d None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:56.559792 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b93880-0c85-487a-9dfc-353fcfd1ce1d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:56.574517 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b93880-0c85-487a-9dfc-353fcfd1ce1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:22:56.582559 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-a4b93880-0c85-487a-9dfc-353fcfd1ce1d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:22:56.582559 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:22:56.582559 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:22:56.582559 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:22:56.582559 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:22:56.582559 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:22:56.582559 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:22:56.582559 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:22:56.582559 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:22:56.582559 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:22:56.582559 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:22:56.582559 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:22:56.582559 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:22:56.582559 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:22:56.582559 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:22:56.582559 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:22:56.583856 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:22:56.583856 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:22:56.583856 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:22:56.583856 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:22:56.583856 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:22:56.583856 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:22:56.583856 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:22:56.583856 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:22:56.583856 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:22:56.583856 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:22:56.583856 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:22:56.583856 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:22:56.583856 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:22:56.583856 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:22:56.583856 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:22:56.583856 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:22:56.585296 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:22:56.585296 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:22:56.585296 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:22:56.585296 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:22:56.585296 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:22:56.585296 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:22:56.585296 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:22:56.585296 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:22:56.585296 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:22:56.585296 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:22:56.585296 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:22:56.585296 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:22:56.585296 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 205/397] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 10:22:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:22:56.591764 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0915259-5702-4a25-9028-2050f085200e None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:56.594699 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:56.737870 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0915259-5702-4a25-9028-2050f085200e None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:56.790751 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d622ab-74f8-4599-a5c7-0583b426bb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:56.791432 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d622ab-74f8-4599-a5c7-0583b426bb4d None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:56.791717 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d622ab-74f8-4599-a5c7-0583b426bb4d None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:56.791994 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d622ab-74f8-4599-a5c7-0583b426bb4d None admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:56.792752 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d622ab-74f8-4599-a5c7-0583b426bb4d None admin] RBAC: Adding query filter params (name=member) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:56.793072 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d622ab-74f8-4599-a5c7-0583b426bb4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:56.794479 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d622ab-74f8-4599-a5c7-0583b426bb4d None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:56.808498 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 193/398] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jul 18 10:22:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:56.814625 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b93880-0c85-487a-9dfc-353fcfd1ce1d None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:56.949657 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:56.959314 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b93880-0c85-487a-9dfc-353fcfd1ce1d None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:56.995116 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d8ee4-c838-4465-94e6-9ce016ed2d3f None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:56.995407 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d8ee4-c838-4465-94e6-9ce016ed2d3f None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:56.995601 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d8ee4-c838-4465-94e6-9ce016ed2d3f None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:56.997235 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 194/399] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:22:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:22:57.002421 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff498b-a6a3-4782-8c6c-8d17384c3f1f None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:57.004239 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff498b-a6a3-4782-8c6c-8d17384c3f1f None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:57.004239 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff498b-a6a3-4782-8c6c-8d17384c3f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:57.011063 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becc46e3-9e12-4472-a8da-61bf6f3b115e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:57.012182 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becc46e3-9e12-4472-a8da-61bf6f3b115e None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:57.012665 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becc46e3-9e12-4472-a8da-61bf6f3b115e None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:57.013181 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becc46e3-9e12-4472-a8da-61bf6f3b115e None admin] PATH_INFO: `/v3/groups/43305103e06a4e25acc80d7d0fd36e00` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:57.017841 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becc46e3-9e12-4472-a8da-61bf6f3b115e None admin] RBAC: Authorizing `identity:get_group(group_id=43305103e06a4e25acc80d7d0fd36e00)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:57.019508 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becc46e3-9e12-4472-a8da-61bf6f3b115e None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:57.022736 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 206/400] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Jul 18 10:22:56 2022] GET /identity/v3/groups/43305103e06a4e25acc80d7d0fd36e00 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:57.027530 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becc46e3-9e12-4472-a8da-61bf6f3b115e None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:57.039954 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-a7ff498b-a6a3-4782-8c6c-8d17384c3f1f None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:22:57.041468 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-a7ff498b-a6a3-4782-8c6c-8d17384c3f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:22:57.184669 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becc46e3-9e12-4472-a8da-61bf6f3b115e None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:57.204826 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:57.218426 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 195/401] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:22:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 10:22:57.241062 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff498b-a6a3-4782-8c6c-8d17384c3f1f None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:57.241265 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af2c8b-f6e5-44aa-bfe1-e6ed2aefacbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:57.242130 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af2c8b-f6e5-44aa-bfe1-e6ed2aefacbb None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:57.242413 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af2c8b-f6e5-44aa-bfe1-e6ed2aefacbb None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:57.242686 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af2c8b-f6e5-44aa-bfe1-e6ed2aefacbb None admin] PATH_INFO: `/v3/projects/cd29577200c54cde8573db439fcbf179` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:57.244972 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af2c8b-f6e5-44aa-bfe1-e6ed2aefacbb None admin] RBAC: Authorizing `identity:get_project(project_id=cd29577200c54cde8573db439fcbf179)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:57.246670 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af2c8b-f6e5-44aa-bfe1-e6ed2aefacbb None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:57.248844 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 207/402] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 10:22:57 2022] GET /identity/v3/projects/cd29577200c54cde8573db439fcbf179 => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:57.254626 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af2c8b-f6e5-44aa-bfe1-e6ed2aefacbb None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:57.305420 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:57.376520 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af2c8b-f6e5-44aa-bfe1-e6ed2aefacbb None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:57.414548 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24589ba8-0e19-41e1-a58b-3c17614acc6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:57.415798 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24589ba8-0e19-41e1-a58b-3c17614acc6c None admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:57.416278 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24589ba8-0e19-41e1-a58b-3c17614acc6c None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:57.416815 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24589ba8-0e19-41e1-a58b-3c17614acc6c None admin] PATH_INFO: `/v3/projects/cd29577200c54cde8573db439fcbf179/groups/43305103e06a4e25acc80d7d0fd36e00/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:57.419156 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24589ba8-0e19-41e1-a58b-3c17614acc6c None admin] RBAC: Authorizing `identity:create_grant(project_id=cd29577200c54cde8573db439fcbf179, group_id=43305103e06a4e25acc80d7d0fd36e00, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:57.420795 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24589ba8-0e19-41e1-a58b-3c17614acc6c None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:57.483845 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff498b-a6a3-4782-8c6c-8d17384c3f1f None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:57.507080 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 208/403] 10.222.0.39 () {58 vars in 1442 bytes} [Mon Jul 18 10:22:57 2022] PUT /identity/v3/projects/cd29577200c54cde8573db439fcbf179/groups/43305103e06a4e25acc80d7d0fd36e00/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:22:57.540473 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69088150-443c-4106-a691-e25bea03cbfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:57.541736 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69088150-443c-4106-a691-e25bea03cbfb None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:57.542237 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69088150-443c-4106-a691-e25bea03cbfb None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:57.542890 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69088150-443c-4106-a691-e25bea03cbfb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:57.559155 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69088150-443c-4106-a691-e25bea03cbfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:22:57.581435 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-69088150-443c-4106-a691-e25bea03cbfb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:22:57.581435 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:22:57.581435 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:22:57.581435 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:22:57.581435 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:22:57.581435 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:22:57.581435 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:22:57.581435 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:22:57.581435 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:22:57.581435 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:22:57.581435 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:22:57.581435 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:22:57.581435 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:22:57.581435 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:22:57.581435 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:22:57.581435 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:22:57.582381 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:22:57.582381 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:22:57.582381 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:22:57.582381 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:22:57.582381 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:22:57.582381 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:22:57.582381 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:22:57.582381 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:22:57.582381 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:22:57.582381 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:22:57.582381 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:22:57.582381 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:22:57.582381 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:22:57.582381 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:22:57.582381 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:22:57.582381 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:22:57.583275 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:22:57.583275 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:22:57.583275 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:22:57.583275 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:22:57.583275 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:22:57.583275 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:22:57.583275 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:22:57.583275 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:22:57.583275 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:22:57.583275 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:22:57.583275 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:22:57.583275 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:22:57.589989 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 196/404] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 10:22:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:22:57.597005 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24589ba8-0e19-41e1-a58b-3c17614acc6c None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:57.699741 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138169c-14bd-4b6c-8b86-03a382f2cd23 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:57.700058 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138169c-14bd-4b6c-8b86-03a382f2cd23 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:57.700293 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138169c-14bd-4b6c-8b86-03a382f2cd23 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:57.706662 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 197/405] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:22:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:22:57.708637 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cfa4f6-136b-4bd3-a314-e7c1e0ae51fb None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:57.709167 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cfa4f6-136b-4bd3-a314-e7c1e0ae51fb None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:57.709657 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cfa4f6-136b-4bd3-a314-e7c1e0ae51fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:57.723925 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:57.728614 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-d6cfa4f6-136b-4bd3-a314-e7c1e0ae51fb None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:22:57.729862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-d6cfa4f6-136b-4bd3-a314-e7c1e0ae51fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:22:57.736089 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24589ba8-0e19-41e1-a58b-3c17614acc6c None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:57.788619 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:57.809230 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 198/406] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:22:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 10:22:57.818681 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4fad8c-e73b-425a-b1cc-53b1273daac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:57.819682 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fad8c-e73b-425a-b1cc-53b1273daac2 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:57.820172 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fad8c-e73b-425a-b1cc-53b1273daac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:57.820639 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fad8c-e73b-425a-b1cc-53b1273daac2 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:57.821617 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4fad8c-e73b-425a-b1cc-53b1273daac2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:57.822136 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4fad8c-e73b-425a-b1cc-53b1273daac2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:57.823841 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4fad8c-e73b-425a-b1cc-53b1273daac2 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:57.825686 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cfa4f6-136b-4bd3-a314-e7c1e0ae51fb None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:57.835320 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 209/407] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 10:22:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:57.842034 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4fad8c-e73b-425a-b1cc-53b1273daac2 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:57.954488 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cfa4f6-136b-4bd3-a314-e7c1e0ae51fb None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:57.990900 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c634b4e-a6e0-4b6d-8261-321e4f2ab2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:57.991922 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c634b4e-a6e0-4b6d-8261-321e4f2ab2d0 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:57.992302 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c634b4e-a6e0-4b6d-8261-321e4f2ab2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:57.992688 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c634b4e-a6e0-4b6d-8261-321e4f2ab2d0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:58.006404 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c634b4e-a6e0-4b6d-8261-321e4f2ab2d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:22:58.017058 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-2c634b4e-a6e0-4b6d-8261-321e4f2ab2d0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 10:22:58.017058 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:22:58.017058 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:22:58.017058 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:22:58.017058 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:22:58.017058 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:22:58.017058 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:22:58.017058 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:22:58.017058 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:22:58.017058 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:22:58.017058 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:22:58.017058 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:22:58.017058 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:22:58.017058 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:22:58.017058 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:22:58.017058 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:22:58.018129 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:22:58.018129 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:22:58.018129 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:22:58.018129 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:22:58.018129 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:22:58.018129 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:22:58.018129 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:22:58.018129 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:22:58.018129 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:22:58.018129 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:22:58.018129 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:22:58.018129 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:22:58.018129 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:22:58.018129 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:22:58.018129 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:22:58.018129 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:22:58.019127 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:22:58.019127 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:22:58.019127 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:22:58.019127 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:22:58.019127 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:22:58.019127 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:22:58.019127 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:22:58.019127 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:22:58.019127 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:22:58.019127 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:22:58.019127 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 10:22:58.019127 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:22:58.022011 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4fad8c-e73b-425a-b1cc-53b1273daac2 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:58.025497 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 199/408] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Jul 18 10:22:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:22:58.028032 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c634b4e-a6e0-4b6d-8261-321e4f2ab2d0 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:58.077896 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:58.095101 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47014f9e-d7bc-4793-97b4-085a07d24582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:58.096275 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47014f9e-d7bc-4793-97b4-085a07d24582 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:58.097585 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47014f9e-d7bc-4793-97b4-085a07d24582 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:58.097585 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47014f9e-d7bc-4793-97b4-085a07d24582 None admin] PATH_INFO: `/v3/groups/7cd775a2e7a149be8a812c1493d7e9e5` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:58.099726 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47014f9e-d7bc-4793-97b4-085a07d24582 None admin] RBAC: Authorizing `identity:get_group(group_id=7cd775a2e7a149be8a812c1493d7e9e5)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:58.101386 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47014f9e-d7bc-4793-97b4-085a07d24582 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:58.106916 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 210/409] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Jul 18 10:22:57 2022] GET /identity/v3/groups/7cd775a2e7a149be8a812c1493d7e9e5 => generated 229 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:22:58.115583 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47014f9e-d7bc-4793-97b4-085a07d24582 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:58.141343 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c634b4e-a6e0-4b6d-8261-321e4f2ab2d0 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:58.171190 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:58.185067 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c587329e-115e-4cf3-b2b1-b08885d5a4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:58.185067 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587329e-115e-4cf3-b2b1-b08885d5a4e8 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:58.185067 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587329e-115e-4cf3-b2b1-b08885d5a4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:58.185067 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587329e-115e-4cf3-b2b1-b08885d5a4e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:58.185473 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c587329e-115e-4cf3-b2b1-b08885d5a4e8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:58.185473 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c587329e-115e-4cf3-b2b1-b08885d5a4e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:58.185473 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c587329e-115e-4cf3-b2b1-b08885d5a4e8 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:58.197077 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 200/410] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 10:22:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:58.197077 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c587329e-115e-4cf3-b2b1-b08885d5a4e8 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:58.285999 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47014f9e-d7bc-4793-97b4-085a07d24582 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:58.302587 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c587329e-115e-4cf3-b2b1-b08885d5a4e8 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:58.309806 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:58.327161 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f8bd3b-aea7-4631-a235-eaf7bd0973e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:58.328399 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8bd3b-aea7-4631-a235-eaf7bd0973e6 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:58.328399 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8bd3b-aea7-4631-a235-eaf7bd0973e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:58.328677 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f8bd3b-aea7-4631-a235-eaf7bd0973e6 None admin] PATH_INFO: `/v3/projects/ec4a529f46e64ec0b911c3fbc2a942cb` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:58.329857 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f8bd3b-aea7-4631-a235-eaf7bd0973e6 None admin] RBAC: Authorizing `identity:get_project(project_id=ec4a529f46e64ec0b911c3fbc2a942cb)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:58.331448 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f8bd3b-aea7-4631-a235-eaf7bd0973e6 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:58.333690 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 211/411] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 10:22:58 2022] GET /identity/v3/projects/ec4a529f46e64ec0b911c3fbc2a942cb => generated 344 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:58.335050 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17234053-5156-4491-a66a-bea9d62f3e96 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:58.335476 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17234053-5156-4491-a66a-bea9d62f3e96 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:58.335902 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17234053-5156-4491-a66a-bea9d62f3e96 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:58.337695 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7a9356-5643-4740-8f22-bd0dfe9280a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:58.338994 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a9356-5643-4740-8f22-bd0dfe9280a0 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:58.339527 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a9356-5643-4740-8f22-bd0dfe9280a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:58.339951 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a9356-5643-4740-8f22-bd0dfe9280a0 None admin] PATH_INFO: `/v3/groups/43305103e06a4e25acc80d7d0fd36e00` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:58.341274 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 212/412] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:22:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:22:58.341685 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7a9356-5643-4740-8f22-bd0dfe9280a0 None admin] RBAC: Authorizing `identity:get_group(group_id=43305103e06a4e25acc80d7d0fd36e00)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:58.342042 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17234053-5156-4491-a66a-bea9d62f3e96 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:58.343496 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7a9356-5643-4740-8f22-bd0dfe9280a0 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:58.349158 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 201/413] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Jul 18 10:22:58 2022] GET /identity/v3/groups/43305103e06a4e25acc80d7d0fd36e00 => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:58.350667 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab63dd3-f9ba-4873-b8b3-bc7589e90b7d None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:58.351105 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab63dd3-f9ba-4873-b8b3-bc7589e90b7d None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:58.351549 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab63dd3-f9ba-4873-b8b3-bc7589e90b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:58.370264 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-eab63dd3-f9ba-4873-b8b3-bc7589e90b7d None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:22:58.371700 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-eab63dd3-f9ba-4873-b8b3-bc7589e90b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:22:58.443152 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 202/414] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:22:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:22:58.444321 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab63dd3-f9ba-4873-b8b3-bc7589e90b7d None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:58.453722 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:58.482348 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17234053-5156-4491-a66a-bea9d62f3e96 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:58.520780 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1670e3b2-f15e-4a87-814f-374adfe30699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:58.521713 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670e3b2-f15e-4a87-814f-374adfe30699 None admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:58.521997 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670e3b2-f15e-4a87-814f-374adfe30699 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:58.522274 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670e3b2-f15e-4a87-814f-374adfe30699 None admin] PATH_INFO: `/v3/projects/ec4a529f46e64ec0b911c3fbc2a942cb/groups/7cd775a2e7a149be8a812c1493d7e9e5/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:58.524533 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1670e3b2-f15e-4a87-814f-374adfe30699 None admin] RBAC: Authorizing `identity:create_grant(project_id=ec4a529f46e64ec0b911c3fbc2a942cb, group_id=7cd775a2e7a149be8a812c1493d7e9e5, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:58.526062 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1670e3b2-f15e-4a87-814f-374adfe30699 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:58.549901 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab63dd3-f9ba-4873-b8b3-bc7589e90b7d None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:58.553019 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:58.584458 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bdfbf9-5c5a-44a4-bbf9-a91cfde8c418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:58.585293 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bdfbf9-5c5a-44a4-bbf9-a91cfde8c418 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:58.585581 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bdfbf9-5c5a-44a4-bbf9-a91cfde8c418 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:58.585859 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bdfbf9-5c5a-44a4-bbf9-a91cfde8c418 None admin] PATH_INFO: `/v3/projects/cd29577200c54cde8573db439fcbf179` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:58.587037 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bdfbf9-5c5a-44a4-bbf9-a91cfde8c418 None admin] RBAC: Authorizing `identity:get_project(project_id=cd29577200c54cde8573db439fcbf179)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:58.588478 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bdfbf9-5c5a-44a4-bbf9-a91cfde8c418 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:58.590440 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 203/415] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 10:22:58 2022] GET /identity/v3/projects/cd29577200c54cde8573db439fcbf179 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:58.595207 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bdfbf9-5c5a-44a4-bbf9-a91cfde8c418 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:58.625093 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 213/416] 10.222.0.39 () {58 vars in 1442 bytes} [Mon Jul 18 10:22:58 2022] PUT /identity/v3/projects/ec4a529f46e64ec0b911c3fbc2a942cb/groups/7cd775a2e7a149be8a812c1493d7e9e5/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:22:58.627282 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1670e3b2-f15e-4a87-814f-374adfe30699 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:58.784262 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bdfbf9-5c5a-44a4-bbf9-a91cfde8c418 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:58.833030 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1670e3b2-f15e-4a87-814f-374adfe30699 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:58.845459 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc65221c-de68-456d-aa6b-9f2e08b3edde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:58.846246 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65221c-de68-456d-aa6b-9f2e08b3edde None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:58.846474 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65221c-de68-456d-aa6b-9f2e08b3edde None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:58.846900 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65221c-de68-456d-aa6b-9f2e08b3edde None admin] PATH_INFO: `/v3/roles/member` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:58.860122 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc65221c-de68-456d-aa6b-9f2e08b3edde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:22:58.870948 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-bc65221c-de68-456d-aa6b-9f2e08b3edde None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:22:58.870948 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:22:58.870948 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:22:58.870948 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:22:58.870948 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:22:58.870948 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:22:58.870948 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:22:58.870948 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:22:58.870948 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:22:58.870948 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:22:58.870948 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:22:58.870948 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:22:58.870948 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:22:58.870948 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:22:58.870948 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:22:58.870948 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:22:58.871886 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:22:58.871886 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:22:58.871886 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:22:58.871886 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:22:58.871886 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:22:58.871886 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:22:58.871886 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:22:58.871886 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:22:58.871886 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:22:58.871886 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:22:58.871886 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:22:58.871886 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:22:58.871886 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:22:58.871886 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:22:58.871886 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:22:58.871886 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:22:58.872680 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:22:58.872680 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:22:58.872680 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:22:58.872680 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:22:58.872680 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:22:58.872680 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:22:58.872680 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:22:58.872680 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:22:58.872680 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:22:58.872680 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:22:58.872680 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:22:58.872680 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:22:58.872680 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 204/417] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 10:22:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:22:58.873406 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e9a51-6580-40e0-b9e7-35833e7e1b42 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:58.873698 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e9a51-6580-40e0-b9e7-35833e7e1b42 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:58.873970 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e9a51-6580-40e0-b9e7-35833e7e1b42 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:58.875520 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 205/418] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:22:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:22:58.877923 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6eb03c-4340-46fd-8f77-6c5879d1a47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:58.879036 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6eb03c-4340-46fd-8f77-6c5879d1a47b None admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:58.879594 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6eb03c-4340-46fd-8f77-6c5879d1a47b None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:58.879975 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6eb03c-4340-46fd-8f77-6c5879d1a47b None admin] PATH_INFO: `/v3/projects/cd29577200c54cde8573db439fcbf179/groups/43305103e06a4e25acc80d7d0fd36e00/roles/45f8992b0f6941c7a64290b437d6bd5e` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:58.880385 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524e9a51-6580-40e0-b9e7-35833e7e1b42 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:58.882501 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6eb03c-4340-46fd-8f77-6c5879d1a47b None admin] RBAC: Authorizing `identity:create_grant(project_id=cd29577200c54cde8573db439fcbf179, group_id=43305103e06a4e25acc80d7d0fd36e00, role_id=45f8992b0f6941c7a64290b437d6bd5e)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:58.884051 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6eb03c-4340-46fd-8f77-6c5879d1a47b None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:58.919072 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:58.950442 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 214/419] 10.222.0.39 () {58 vars in 1442 bytes} [Mon Jul 18 10:22:58 2022] PUT /identity/v3/projects/cd29577200c54cde8573db439fcbf179/groups/43305103e06a4e25acc80d7d0fd36e00/roles/45f8992b0f6941c7a64290b437d6bd5e => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:22:58.951684 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef014cb-23a9-4a91-8809-6c81b7f33612 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:58.952068 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef014cb-23a9-4a91-8809-6c81b7f33612 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:58.952529 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef014cb-23a9-4a91-8809-6c81b7f33612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:58.972063 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-1ef014cb-23a9-4a91-8809-6c81b7f33612 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:22:58.973865 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-1ef014cb-23a9-4a91-8809-6c81b7f33612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:22:58.976629 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:59.014859 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524e9a51-6580-40e0-b9e7-35833e7e1b42 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:59.093263 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 215/420] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:22:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:22:59.097252 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f83f84e-57fe-4a61-bcb9-a8e4da553cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:59.104081 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83f84e-57fe-4a61-bcb9-a8e4da553cce None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:59.104676 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83f84e-57fe-4a61-bcb9-a8e4da553cce None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:59.105192 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83f84e-57fe-4a61-bcb9-a8e4da553cce None admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:59.106175 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f83f84e-57fe-4a61-bcb9-a8e4da553cce None admin] RBAC: Adding query filter params (name=member) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:59.106752 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f83f84e-57fe-4a61-bcb9-a8e4da553cce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:59.108405 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f83f84e-57fe-4a61-bcb9-a8e4da553cce None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:59.120219 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 206/421] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jul 18 10:22:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:59.126877 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef014cb-23a9-4a91-8809-6c81b7f33612 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:59.136117 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f83f84e-57fe-4a61-bcb9-a8e4da553cce None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:59.250560 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef014cb-23a9-4a91-8809-6c81b7f33612 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:59.252678 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:59.257891 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f83f84e-57fe-4a61-bcb9-a8e4da553cce None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:59.295848 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac71ec4-1357-46a1-91bd-1f229b0c38a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:59.296698 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac71ec4-1357-46a1-91bd-1f229b0c38a9 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:59.297192 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac71ec4-1357-46a1-91bd-1f229b0c38a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:59.297481 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac71ec4-1357-46a1-91bd-1f229b0c38a9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:59.298177 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454f3361-2721-42e6-a5d6-c74620904d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:59.299069 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f3361-2721-42e6-a5d6-c74620904d02 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:59.299542 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f3361-2721-42e6-a5d6-c74620904d02 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:59.300015 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f3361-2721-42e6-a5d6-c74620904d02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:59.309667 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:59.329450 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac71ec4-1357-46a1-91bd-1f229b0c38a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:22:59.338029 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-bac71ec4-1357-46a1-91bd-1f229b0c38a9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 10:22:59.338029 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:22:59.338029 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:22:59.338029 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:22:59.338029 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:22:59.338029 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:22:59.338029 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:22:59.338029 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:22:59.338029 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:22:59.338029 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:22:59.338029 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:22:59.338029 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:22:59.338029 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:22:59.338029 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:22:59.338029 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:22:59.338029 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:22:59.338903 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:22:59.338903 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:22:59.338903 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:22:59.338903 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:22:59.338903 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:22:59.338903 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:22:59.338903 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:22:59.338903 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:22:59.338903 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:22:59.338903 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:22:59.338903 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:22:59.338903 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:22:59.338903 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:22:59.338903 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:22:59.338903 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:22:59.338903 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:22:59.339673 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:22:59.339673 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:22:59.339673 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:22:59.339673 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:22:59.339673 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:22:59.339673 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:22:59.339673 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:22:59.339673 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:22:59.339673 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:22:59.339673 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:22:59.339673 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 10:22:59.339673 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:22:59.339673 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 207/422] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Jul 18 10:22:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:22:59.346441 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac71ec4-1357-46a1-91bd-1f229b0c38a9 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:59.433930 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454f3361-2721-42e6-a5d6-c74620904d02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:59.435314 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454f3361-2721-42e6-a5d6-c74620904d02 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:59.539999 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac71ec4-1357-46a1-91bd-1f229b0c38a9 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:59.602287 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 216/423] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 10:22:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:22:59.602966 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e214470-abc0-42e8-aa27-58816fd83b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:59.603733 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e214470-abc0-42e8-aa27-58816fd83b27 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:59.604028 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e214470-abc0-42e8-aa27-58816fd83b27 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:59.604313 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e214470-abc0-42e8-aa27-58816fd83b27 None admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:59.610665 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e214470-abc0-42e8-aa27-58816fd83b27 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:22:59.610665 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e214470-abc0-42e8-aa27-58816fd83b27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:59.610665 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e214470-abc0-42e8-aa27-58816fd83b27 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:59.612342 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454f3361-2721-42e6-a5d6-c74620904d02 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:59.625333 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 208/424] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 10:22:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:59.628377 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e214470-abc0-42e8-aa27-58816fd83b27 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:59.649412 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:59.690488 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:59.794400 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e214470-abc0-42e8-aa27-58816fd83b27 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:59.803745 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454f3361-2721-42e6-a5d6-c74620904d02 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:59.834417 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280afa62-2361-4f5d-830b-ecfeb997d448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:59.835084 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280afa62-2361-4f5d-830b-ecfeb997d448 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:59.835370 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280afa62-2361-4f5d-830b-ecfeb997d448 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:59.835651 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280afa62-2361-4f5d-830b-ecfeb997d448 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:59.838795 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc968a1f-8b82-4064-b356-0bfe4a7e7ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:59.839663 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc968a1f-8b82-4064-b356-0bfe4a7e7ee6 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:59.839951 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc968a1f-8b82-4064-b356-0bfe4a7e7ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:59.840228 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc968a1f-8b82-4064-b356-0bfe4a7e7ee6 None admin] PATH_INFO: `/v3/projects/e3ce0a1d0d104f4ba20f8d0b63301a51` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:59.841457 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc968a1f-8b82-4064-b356-0bfe4a7e7ee6 None admin] RBAC: Authorizing `identity:get_project(project_id=e3ce0a1d0d104f4ba20f8d0b63301a51)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:59.842893 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc968a1f-8b82-4064-b356-0bfe4a7e7ee6 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:59.845510 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 217/425] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 10:22:59 2022] GET /identity/v3/projects/e3ce0a1d0d104f4ba20f8d0b63301a51 => generated 298 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:22:59.846741 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf723d-acc2-4daa-900a-94b58b8ecfe5 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:59.847016 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf723d-acc2-4daa-900a-94b58b8ecfe5 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:59.847297 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf723d-acc2-4daa-900a-94b58b8ecfe5 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:22:59.848530 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 218/426] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:22:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:22:59.853212 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf723d-acc2-4daa-900a-94b58b8ecfe5 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:22:59.912048 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280afa62-2361-4f5d-830b-ecfeb997d448 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:22:59.913648 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280afa62-2361-4f5d-830b-ecfeb997d448 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:22:59.933455 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:59.960619 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf723d-acc2-4daa-900a-94b58b8ecfe5 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:22:59.969088 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:22:59.997302 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f9d192-ed1a-44c1-adca-460b642b9ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:22:59.998175 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9d192-ed1a-44c1-adca-460b642b9ebe None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:22:59.998456 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9d192-ed1a-44c1-adca-460b642b9ebe None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:22:59.998732 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9d192-ed1a-44c1-adca-460b642b9ebe None admin] PATH_INFO: `/v3/groups/43305103e06a4e25acc80d7d0fd36e00` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:00.000494 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f9d192-ed1a-44c1-adca-460b642b9ebe None admin] RBAC: Authorizing `identity:get_group(group_id=43305103e06a4e25acc80d7d0fd36e00)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:00.002050 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f9d192-ed1a-44c1-adca-460b642b9ebe None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:00.004469 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 219/427] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Jul 18 10:22:59 2022] GET /identity/v3/groups/43305103e06a4e25acc80d7d0fd36e00 => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:00.006048 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a07440-af48-4785-a75a-b006d2287fc9 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:00.006661 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a07440-af48-4785-a75a-b006d2287fc9 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:00.006661 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a07440-af48-4785-a75a-b006d2287fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:00.023380 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-87a07440-af48-4785-a75a-b006d2287fc9 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:23:00.024674 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-87a07440-af48-4785-a75a-b006d2287fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:23:00.034087 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 209/428] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 10:22:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:23:00.035309 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280afa62-2361-4f5d-830b-ecfeb997d448 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:00.099982 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 220/429] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:23:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:23:00.106361 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a07440-af48-4785-a75a-b006d2287fc9 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:00.149396 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280afa62-2361-4f5d-830b-ecfeb997d448 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:00.168005 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:00.188391 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88e1e8d-affd-4ffa-aa2b-7c80761efce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:00.189291 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e1e8d-affd-4ffa-aa2b-7c80761efce7 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:00.189823 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e1e8d-affd-4ffa-aa2b-7c80761efce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:00.190268 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e1e8d-affd-4ffa-aa2b-7c80761efce7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:00.191320 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88e1e8d-affd-4ffa-aa2b-7c80761efce7 None admin] RBAC: Adding query filter params (group.id=43305103e06a4e25acc80d7d0fd36e00, role.id=907cee10dffd48b2bec00719e425d3bd, scope.project.id=e3ce0a1d0d104f4ba20f8d0b63301a51) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:00.191835 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88e1e8d-affd-4ffa-aa2b-7c80761efce7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:00.193691 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88e1e8d-affd-4ffa-aa2b-7c80761efce7 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:00.201165 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 210/430] 10.222.0.39 () {56 vars in 1376 bytes} [Mon Jul 18 10:23:00 2022] GET /identity/v3/role_assignments?group.id=43305103e06a4e25acc80d7d0fd36e00&scope.project.id=e3ce0a1d0d104f4ba20f8d0b63301a51&role.id=907cee10dffd48b2bec00719e425d3bd => generated 611 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:00.202348 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88e1e8d-affd-4ffa-aa2b-7c80761efce7 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:00.234000 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a07440-af48-4785-a75a-b006d2287fc9 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:00.236556 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:00.272109 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b35fd-5464-4581-8079-a9d533db2ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:00.272983 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b35fd-5464-4581-8079-a9d533db2ed8 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:00.273321 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b35fd-5464-4581-8079-a9d533db2ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:00.273603 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b35fd-5464-4581-8079-a9d533db2ed8 None admin] PATH_INFO: `/v3/projects/e3ce0a1d0d104f4ba20f8d0b63301a51` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:00.274803 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459b35fd-5464-4581-8079-a9d533db2ed8 None admin] RBAC: Authorizing `identity:get_project(project_id=e3ce0a1d0d104f4ba20f8d0b63301a51)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:00.276276 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459b35fd-5464-4581-8079-a9d533db2ed8 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:00.278340 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 221/431] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 10:23:00 2022] GET /identity/v3/projects/e3ce0a1d0d104f4ba20f8d0b63301a51 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:00.290455 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b35fd-5464-4581-8079-a9d533db2ed8 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:00.325104 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88e1e8d-affd-4ffa-aa2b-7c80761efce7 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:00.371687 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2936d9d-d2f0-4b8e-899d-ad1e46e8f211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:00.372876 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2936d9d-d2f0-4b8e-899d-ad1e46e8f211 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:00.373428 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2936d9d-d2f0-4b8e-899d-ad1e46e8f211 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:00.375562 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2936d9d-d2f0-4b8e-899d-ad1e46e8f211 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:00.393808 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2936d9d-d2f0-4b8e-899d-ad1e46e8f211 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:23:00.403091 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-b2936d9d-d2f0-4b8e-899d-ad1e46e8f211 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:23:00.403091 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:00.403091 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:00.403091 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:00.403091 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:00.403091 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:00.403091 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:00.403091 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:00.403091 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:00.403091 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:00.403091 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:00.403091 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:00.403091 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:23:00.403091 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:23:00.403091 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:23:00.403091 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:23:00.403990 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:23:00.403990 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:23:00.403990 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:23:00.403990 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:23:00.403990 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:00.403990 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:00.403990 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:00.403990 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:00.403990 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:00.403990 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:00.403990 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:00.403990 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:00.403990 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:00.403990 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:00.403990 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:00.403990 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:00.404768 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:00.404768 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:00.404768 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:00.404768 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:00.404768 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:23:00.404768 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:23:00.404768 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:23:00.404768 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:23:00.404768 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:23:00.404768 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:23:00.404768 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 10:23:00.404768 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:00.407481 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 211/432] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 10:23:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:00.414273 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2936d9d-d2f0-4b8e-899d-ad1e46e8f211 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:00.452099 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b35fd-5464-4581-8079-a9d533db2ed8 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:00.463151 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:00.493411 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a811cfd7-de17-4c91-922a-0aa5e7196d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:00.494441 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811cfd7-de17-4c91-922a-0aa5e7196d0a None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:00.494831 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811cfd7-de17-4c91-922a-0aa5e7196d0a None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:00.495214 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811cfd7-de17-4c91-922a-0aa5e7196d0a None admin] PATH_INFO: `/v3/groups/43305103e06a4e25acc80d7d0fd36e00` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:00.497607 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a811cfd7-de17-4c91-922a-0aa5e7196d0a None admin] RBAC: Authorizing `identity:get_group(group_id=43305103e06a4e25acc80d7d0fd36e00)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:00.501859 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a811cfd7-de17-4c91-922a-0aa5e7196d0a None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:00.504196 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 222/433] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Jul 18 10:23:00 2022] GET /identity/v3/groups/43305103e06a4e25acc80d7d0fd36e00 => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:00.509684 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a811cfd7-de17-4c91-922a-0aa5e7196d0a None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:00.537317 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2936d9d-d2f0-4b8e-899d-ad1e46e8f211 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:00.583097 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:00.587505 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db705c2c-68be-468c-964b-4e83ad4c9a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:00.588291 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db705c2c-68be-468c-964b-4e83ad4c9a65 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:00.588613 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db705c2c-68be-468c-964b-4e83ad4c9a65 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:00.588893 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db705c2c-68be-468c-964b-4e83ad4c9a65 None admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:00.589689 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db705c2c-68be-468c-964b-4e83ad4c9a65 None admin] RBAC: Adding query filter params (name=member) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:00.590058 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db705c2c-68be-468c-964b-4e83ad4c9a65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:00.591395 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db705c2c-68be-468c-964b-4e83ad4c9a65 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:00.601182 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 212/434] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jul 18 10:23:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:00.607145 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db705c2c-68be-468c-964b-4e83ad4c9a65 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:00.680255 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a811cfd7-de17-4c91-922a-0aa5e7196d0a None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:00.724018 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c01ff-fba3-4068-9c83-a98683d25f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:00.724781 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c01ff-fba3-4068-9c83-a98683d25f84 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:00.725001 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c01ff-fba3-4068-9c83-a98683d25f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:00.725351 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c01ff-fba3-4068-9c83-a98683d25f84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:00.726192 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99c01ff-fba3-4068-9c83-a98683d25f84 None admin] RBAC: Adding query filter params (group.id=43305103e06a4e25acc80d7d0fd36e00, role.id=45f8992b0f6941c7a64290b437d6bd5e, scope.project.id=e3ce0a1d0d104f4ba20f8d0b63301a51) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:00.726513 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99c01ff-fba3-4068-9c83-a98683d25f84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:00.728109 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99c01ff-fba3-4068-9c83-a98683d25f84 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:00.736986 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 223/435] 10.222.0.39 () {56 vars in 1376 bytes} [Mon Jul 18 10:23:00 2022] GET /identity/v3/role_assignments?group.id=43305103e06a4e25acc80d7d0fd36e00&scope.project.id=e3ce0a1d0d104f4ba20f8d0b63301a51&role.id=45f8992b0f6941c7a64290b437d6bd5e => generated 611 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:23:00.739077 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db705c2c-68be-468c-964b-4e83ad4c9a65 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:00.741322 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:00.780733 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d425acc-260f-4010-a2f5-a2b4eb53d8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:00.782246 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d425acc-260f-4010-a2f5-a2b4eb53d8aa None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:00.782692 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d425acc-260f-4010-a2f5-a2b4eb53d8aa None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:00.783138 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d425acc-260f-4010-a2f5-a2b4eb53d8aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:00.862486 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d425acc-260f-4010-a2f5-a2b4eb53d8aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:00.863969 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d425acc-260f-4010-a2f5-a2b4eb53d8aa None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:00.979946 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 213/436] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 10:23:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:23:00.982067 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f7d7f-516b-48a3-89cb-42ecb772f90d None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:00.982067 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f7d7f-516b-48a3-89cb-42ecb772f90d None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:00.982262 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f7d7f-516b-48a3-89cb-42ecb772f90d None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:00.983580 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 224/437] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:23:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:23:00.987001 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d425acc-260f-4010-a2f5-a2b4eb53d8aa None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:00.989217 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e722c-5e8d-4c27-b741-bc12e7235dd9 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:00.989452 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:00.989821 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e722c-5e8d-4c27-b741-bc12e7235dd9 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:00.990031 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e722c-5e8d-4c27-b741-bc12e7235dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:01.014663 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-253e722c-5e8d-4c27-b741-bc12e7235dd9 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:23:01.016511 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-253e722c-5e8d-4c27-b741-bc12e7235dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:23:01.121740 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 225/438] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:23:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 10:23:01.143586 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d425acc-260f-4010-a2f5-a2b4eb53d8aa None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:01.150359 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e722c-5e8d-4c27-b741-bc12e7235dd9 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:01.186053 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf22b3-51b4-4988-a35a-22361f3d726d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:01.187050 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf22b3-51b4-4988-a35a-22361f3d726d None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:01.187868 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf22b3-51b4-4988-a35a-22361f3d726d None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:01.188745 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf22b3-51b4-4988-a35a-22361f3d726d None admin] PATH_INFO: `/v3/projects/cd29577200c54cde8573db439fcbf179` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:01.190066 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bf22b3-51b4-4988-a35a-22361f3d726d None admin] RBAC: Authorizing `identity:get_project(project_id=cd29577200c54cde8573db439fcbf179)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:01.191520 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bf22b3-51b4-4988-a35a-22361f3d726d None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:01.193334 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:01.193589 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 214/439] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 10:23:00 2022] GET /identity/v3/projects/cd29577200c54cde8573db439fcbf179 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:23:01.199159 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf22b3-51b4-4988-a35a-22361f3d726d None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:01.275508 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e722c-5e8d-4c27-b741-bc12e7235dd9 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:01.278010 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:01.324711 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e72aa-acaa-47f6-9f77-891d1902f159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:01.325231 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf22b3-51b4-4988-a35a-22361f3d726d None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:01.325616 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e72aa-acaa-47f6-9f77-891d1902f159 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:01.325894 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e72aa-acaa-47f6-9f77-891d1902f159 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:01.328864 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9e72aa-acaa-47f6-9f77-891d1902f159 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:01.338928 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9e72aa-acaa-47f6-9f77-891d1902f159 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:23:01.346774 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-1f9e72aa-acaa-47f6-9f77-891d1902f159 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:23:01.346774 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:01.346774 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:01.346774 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:01.346774 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:01.346774 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:01.346774 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:01.346774 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:01.346774 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:01.346774 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:01.346774 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:01.346774 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:01.346774 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:23:01.346774 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:23:01.346774 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:23:01.346774 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:23:01.347680 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:23:01.347680 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:23:01.347680 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:23:01.347680 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:23:01.347680 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:01.347680 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:01.347680 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:01.347680 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:01.347680 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:01.347680 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:01.347680 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:01.347680 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:01.347680 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:01.347680 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:01.347680 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:01.347680 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:01.348558 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:01.348558 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:01.348558 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:01.348558 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:01.348558 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:23:01.348558 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:23:01.348558 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:23:01.348558 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:23:01.348558 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:23:01.348558 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:23:01.348558 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:23:01.348558 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:01.348558 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 226/440] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 10:23:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:23:01.353688 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e72aa-acaa-47f6-9f77-891d1902f159 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:01.366052 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2097a813-2c77-48fd-b8c0-2b02a47abb64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:01.366544 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097a813-2c77-48fd-b8c0-2b02a47abb64 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:01.366832 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097a813-2c77-48fd-b8c0-2b02a47abb64 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:01.367111 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097a813-2c77-48fd-b8c0-2b02a47abb64 None admin] PATH_INFO: `/v3/groups/43305103e06a4e25acc80d7d0fd36e00` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:01.368308 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2097a813-2c77-48fd-b8c0-2b02a47abb64 None admin] RBAC: Authorizing `identity:get_group(group_id=43305103e06a4e25acc80d7d0fd36e00)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:01.369905 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2097a813-2c77-48fd-b8c0-2b02a47abb64 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:01.377360 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 215/441] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Jul 18 10:23:01 2022] GET /identity/v3/groups/43305103e06a4e25acc80d7d0fd36e00 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:23:01.378317 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2097a813-2c77-48fd-b8c0-2b02a47abb64 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:01.461473 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:01.468102 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9e72aa-acaa-47f6-9f77-891d1902f159 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:01.492310 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2097a813-2c77-48fd-b8c0-2b02a47abb64 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:01.505585 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf318150-6a6f-4fe8-9e15-d70327662a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:01.506254 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf318150-6a6f-4fe8-9e15-d70327662a95 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:01.506528 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf318150-6a6f-4fe8-9e15-d70327662a95 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:01.506802 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf318150-6a6f-4fe8-9e15-d70327662a95 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:01.507549 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf318150-6a6f-4fe8-9e15-d70327662a95 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:01.507856 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf318150-6a6f-4fe8-9e15-d70327662a95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:01.509239 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf318150-6a6f-4fe8-9e15-d70327662a95 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:01.518133 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 227/442] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 10:23:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:23:01.521892 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89f8d3-ddf9-4625-8fa2-2c1eccbb7223 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:01.522279 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89f8d3-ddf9-4625-8fa2-2c1eccbb7223 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:01.522571 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89f8d3-ddf9-4625-8fa2-2c1eccbb7223 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:01.523832 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 228/443] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:23:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:23:01.524519 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a89f8d3-ddf9-4625-8fa2-2c1eccbb7223 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:01.529072 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f455b8-f7f8-43a2-9a6c-86dbedda2aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:01.529742 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f455b8-f7f8-43a2-9a6c-86dbedda2aad None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:01.530022 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f455b8-f7f8-43a2-9a6c-86dbedda2aad None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:01.530294 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f455b8-f7f8-43a2-9a6c-86dbedda2aad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:01.531163 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f455b8-f7f8-43a2-9a6c-86dbedda2aad None admin] RBAC: Adding query filter params (group.id=43305103e06a4e25acc80d7d0fd36e00, role.id=907cee10dffd48b2bec00719e425d3bd, scope.project.id=cd29577200c54cde8573db439fcbf179) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:01.532037 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f455b8-f7f8-43a2-9a6c-86dbedda2aad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:01.533516 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f455b8-f7f8-43a2-9a6c-86dbedda2aad None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:01.541074 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 216/444] 10.222.0.39 () {56 vars in 1376 bytes} [Mon Jul 18 10:23:01 2022] GET /identity/v3/role_assignments?group.id=43305103e06a4e25acc80d7d0fd36e00&scope.project.id=cd29577200c54cde8573db439fcbf179&role.id=907cee10dffd48b2bec00719e425d3bd => generated 611 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:01.541074 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9396d-c910-490b-a261-6cedaac7468e None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:01.541074 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9396d-c910-490b-a261-6cedaac7468e None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:01.541353 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9396d-c910-490b-a261-6cedaac7468e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:01.546381 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:01.560367 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-50a9396d-c910-490b-a261-6cedaac7468e None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:23:01.562038 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-50a9396d-c910-490b-a261-6cedaac7468e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:23:01.640078 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 217/445] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:23:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:23:01.651855 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a89f8d3-ddf9-4625-8fa2-2c1eccbb7223 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:01.664636 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a9396d-c910-490b-a261-6cedaac7468e None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:01.691864 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e3fdc-3d22-4f91-b07b-a1afe1a880ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:01.692755 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e3fdc-3d22-4f91-b07b-a1afe1a880ab None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:01.692869 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e3fdc-3d22-4f91-b07b-a1afe1a880ab None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:01.693083 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e3fdc-3d22-4f91-b07b-a1afe1a880ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:01.724404 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:01.781328 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912e3fdc-3d22-4f91-b07b-a1afe1a880ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:01.782815 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912e3fdc-3d22-4f91-b07b-a1afe1a880ab None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:01.784676 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a9396d-c910-490b-a261-6cedaac7468e None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:01.821293 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:01.827592 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266ea3bb-64b0-4a04-9294-76b9816e1dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:01.829655 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ea3bb-64b0-4a04-9294-76b9816e1dd3 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:01.829945 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ea3bb-64b0-4a04-9294-76b9816e1dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:01.830219 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ea3bb-64b0-4a04-9294-76b9816e1dd3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:01.841663 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266ea3bb-64b0-4a04-9294-76b9816e1dd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:23:01.851565 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-266ea3bb-64b0-4a04-9294-76b9816e1dd3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 10:23:01.851565 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:01.851565 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:01.851565 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:01.851565 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:01.851565 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:01.851565 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:01.851565 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:01.851565 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:01.851565 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:01.851565 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:01.851565 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:01.851565 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:23:01.851565 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:23:01.851565 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:23:01.851565 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:23:01.852499 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:23:01.852499 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:23:01.852499 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:23:01.852499 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:23:01.852499 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:01.852499 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:01.852499 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:01.852499 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:01.852499 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:01.852499 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:01.852499 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:01.852499 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:01.852499 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:01.852499 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:01.852499 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:01.852499 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:01.853344 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:01.853344 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:01.853344 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:01.853344 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:01.853344 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:23:01.853344 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:23:01.853344 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:23:01.853344 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:23:01.853344 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:23:01.853344 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:23:01.853344 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 10:23:01.853344 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:01.854270 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 218/446] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Jul 18 10:23:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:23:01.860222 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266ea3bb-64b0-4a04-9294-76b9816e1dd3 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:01.902524 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 229/447] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 10:23:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:23:01.908706 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e3fdc-3d22-4f91-b07b-a1afe1a880ab None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:01.967072 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:01.974500 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266ea3bb-64b0-4a04-9294-76b9816e1dd3 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:02.008901 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc84c3b3-3f02-4164-a3d6-64bbc6d25b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:02.009855 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84c3b3-3f02-4164-a3d6-64bbc6d25b05 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:02.009855 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84c3b3-3f02-4164-a3d6-64bbc6d25b05 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:02.010148 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84c3b3-3f02-4164-a3d6-64bbc6d25b05 None admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:02.010900 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc84c3b3-3f02-4164-a3d6-64bbc6d25b05 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:02.011211 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc84c3b3-3f02-4164-a3d6-64bbc6d25b05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:02.012576 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc84c3b3-3f02-4164-a3d6-64bbc6d25b05 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:02.012698 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e3fdc-3d22-4f91-b07b-a1afe1a880ab None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:02.021336 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 219/448] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 10:23:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:23:02.027048 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc84c3b3-3f02-4164-a3d6-64bbc6d25b05 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:02.047810 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2784ec-0064-44f2-8490-363e797f581e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:02.048658 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2784ec-0064-44f2-8490-363e797f581e None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:02.048937 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2784ec-0064-44f2-8490-363e797f581e None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:02.049233 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2784ec-0064-44f2-8490-363e797f581e None admin] PATH_INFO: `/v3/projects/ec4a529f46e64ec0b911c3fbc2a942cb` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:02.050411 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2784ec-0064-44f2-8490-363e797f581e None admin] RBAC: Authorizing `identity:get_project(project_id=ec4a529f46e64ec0b911c3fbc2a942cb)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:02.051820 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2784ec-0064-44f2-8490-363e797f581e None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:02.053514 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 230/449] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 10:23:01 2022] GET /identity/v3/projects/ec4a529f46e64ec0b911c3fbc2a942cb => generated 344 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:23:02.058793 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2784ec-0064-44f2-8490-363e797f581e None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:02.084699 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:02.135324 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc84c3b3-3f02-4164-a3d6-64bbc6d25b05 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:02.159909 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2784ec-0064-44f2-8490-363e797f581e None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:02.168609 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf29bb-e6be-4d54-a94c-2e20f391ab1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:02.169278 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf29bb-e6be-4d54-a94c-2e20f391ab1a None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:02.169560 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf29bb-e6be-4d54-a94c-2e20f391ab1a None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:02.169832 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf29bb-e6be-4d54-a94c-2e20f391ab1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:02.182401 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:02.193660 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0979e0-4df2-47ea-8c52-a4e40f606218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:02.194510 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0979e0-4df2-47ea-8c52-a4e40f606218 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:02.194793 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0979e0-4df2-47ea-8c52-a4e40f606218 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:02.195125 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0979e0-4df2-47ea-8c52-a4e40f606218 None admin] PATH_INFO: `/v3/groups/7cd775a2e7a149be8a812c1493d7e9e5` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:02.196224 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0979e0-4df2-47ea-8c52-a4e40f606218 None admin] RBAC: Authorizing `identity:get_group(group_id=7cd775a2e7a149be8a812c1493d7e9e5)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:02.197689 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0979e0-4df2-47ea-8c52-a4e40f606218 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:02.199462 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 231/450] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Jul 18 10:23:02 2022] GET /identity/v3/groups/7cd775a2e7a149be8a812c1493d7e9e5 => generated 229 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:02.205826 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0979e0-4df2-47ea-8c52-a4e40f606218 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:02.242779 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaf29bb-e6be-4d54-a94c-2e20f391ab1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:02.244235 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaf29bb-e6be-4d54-a94c-2e20f391ab1a None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:02.296051 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:02.303554 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0979e0-4df2-47ea-8c52-a4e40f606218 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:02.338144 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18075fa5-8595-47fb-894d-5d6b5b3e2a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:02.338794 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18075fa5-8595-47fb-894d-5d6b5b3e2a7e None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:02.339072 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18075fa5-8595-47fb-894d-5d6b5b3e2a7e None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:02.339343 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18075fa5-8595-47fb-894d-5d6b5b3e2a7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:02.340164 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18075fa5-8595-47fb-894d-5d6b5b3e2a7e None admin] RBAC: Adding query filter params (group.id=7cd775a2e7a149be8a812c1493d7e9e5, role.id=e7b6a55ecf6c491487955aaefbf9c388, scope.project.id=ec4a529f46e64ec0b911c3fbc2a942cb) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:02.340294 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 220/451] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 10:23:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 18 10:23:02.340473 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18075fa5-8595-47fb-894d-5d6b5b3e2a7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:02.341918 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18075fa5-8595-47fb-894d-5d6b5b3e2a7e None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:02.346614 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf29bb-e6be-4d54-a94c-2e20f391ab1a None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:02.361072 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 232/452] 10.222.0.39 () {56 vars in 1376 bytes} [Mon Jul 18 10:23:02 2022] GET /identity/v3/role_assignments?group.id=7cd775a2e7a149be8a812c1493d7e9e5&scope.project.id=ec4a529f46e64ec0b911c3fbc2a942cb&role.id=e7b6a55ecf6c491487955aaefbf9c388 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:23:02.450425 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf29bb-e6be-4d54-a94c-2e20f391ab1a None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:02.486380 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750aadf-18f4-4059-9afc-254a6ae71ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:02.487252 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750aadf-18f4-4059-9afc-254a6ae71ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:02.487534 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750aadf-18f4-4059-9afc-254a6ae71ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:02.487806 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750aadf-18f4-4059-9afc-254a6ae71ea5 None admin] PATH_INFO: `/v3/projects/cd29577200c54cde8573db439fcbf179` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:02.489010 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2750aadf-18f4-4059-9afc-254a6ae71ea5 None admin] RBAC: Authorizing `identity:get_project(project_id=cd29577200c54cde8573db439fcbf179)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:02.490723 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2750aadf-18f4-4059-9afc-254a6ae71ea5 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:02.492421 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 221/453] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 10:23:02 2022] GET /identity/v3/projects/cd29577200c54cde8573db439fcbf179 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:23:02.498001 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18075fa5-8595-47fb-894d-5d6b5b3e2a7e None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:02.557405 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:02.601310 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18075fa5-8595-47fb-894d-5d6b5b3e2a7e None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:02.634084 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c50212-66eb-4a3e-ad71-fcfe164c29b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:02.634934 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c50212-66eb-4a3e-ad71-fcfe164c29b2 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:02.635218 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c50212-66eb-4a3e-ad71-fcfe164c29b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:02.635494 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c50212-66eb-4a3e-ad71-fcfe164c29b2 None admin] PATH_INFO: `/v3/groups/43305103e06a4e25acc80d7d0fd36e00` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:02.636649 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c50212-66eb-4a3e-ad71-fcfe164c29b2 None admin] RBAC: Authorizing `identity:get_group(group_id=43305103e06a4e25acc80d7d0fd36e00)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:02.638179 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c50212-66eb-4a3e-ad71-fcfe164c29b2 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:02.639797 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 233/454] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Jul 18 10:23:02 2022] GET /identity/v3/groups/43305103e06a4e25acc80d7d0fd36e00 => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:02.646388 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750aadf-18f4-4059-9afc-254a6ae71ea5 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:02.670256 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:02.745840 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750aadf-18f4-4059-9afc-254a6ae71ea5 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:02.779383 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f0d79f-bad6-412a-8fcd-0f4ccb345092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:02.780027 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0d79f-bad6-412a-8fcd-0f4ccb345092 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:02.780304 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0d79f-bad6-412a-8fcd-0f4ccb345092 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:02.780574 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0d79f-bad6-412a-8fcd-0f4ccb345092 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:02.781542 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f0d79f-bad6-412a-8fcd-0f4ccb345092 None admin] RBAC: Adding query filter params (group.id=43305103e06a4e25acc80d7d0fd36e00, role.id=45f8992b0f6941c7a64290b437d6bd5e, scope.project.id=cd29577200c54cde8573db439fcbf179) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:02.781855 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f0d79f-bad6-412a-8fcd-0f4ccb345092 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:02.783269 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f0d79f-bad6-412a-8fcd-0f4ccb345092 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:02.788894 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 222/455] 10.222.0.39 () {56 vars in 1376 bytes} [Mon Jul 18 10:23:02 2022] GET /identity/v3/role_assignments?group.id=43305103e06a4e25acc80d7d0fd36e00&scope.project.id=cd29577200c54cde8573db439fcbf179&role.id=45f8992b0f6941c7a64290b437d6bd5e => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:05.367358 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67ca8d-0e3d-458e-ba0b-46707483cf9b None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:05.367858 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67ca8d-0e3d-458e-ba0b-46707483cf9b None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:05.367858 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67ca8d-0e3d-458e-ba0b-46707483cf9b None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:05.369492 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 234/456] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:23:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:23:05.375250 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f0ad29-4d49-4cd7-85a3-29835395c9e8 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:05.376693 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f0ad29-4d49-4cd7-85a3-29835395c9e8 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:05.377205 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f0ad29-4d49-4cd7-85a3-29835395c9e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:05.394971 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-24f0ad29-4d49-4cd7-85a3-29835395c9e8 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:23:05.396476 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-24f0ad29-4d49-4cd7-85a3-29835395c9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:23:05.477142 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 223/457] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:23:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:23:05.496767 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67ca8d-0e3d-458e-ba0b-46707483cf9b None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:05.506692 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acad537-6cbe-408e-bf2c-13c259276952 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:05.506987 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acad537-6cbe-408e-bf2c-13c259276952 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:05.507258 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acad537-6cbe-408e-bf2c-13c259276952 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:05.508767 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 224/458] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:23:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:23:05.513834 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0041df98-cbcd-4795-bb3f-fd0b9f4e296f None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:05.514118 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0041df98-cbcd-4795-bb3f-fd0b9f4e296f None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:05.514397 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0041df98-cbcd-4795-bb3f-fd0b9f4e296f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:05.539149 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-0041df98-cbcd-4795-bb3f-fd0b9f4e296f None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:23:05.540335 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-0041df98-cbcd-4795-bb3f-fd0b9f4e296f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:23:05.563997 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:05.623840 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67ca8d-0e3d-458e-ba0b-46707483cf9b None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:05.651867 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:05.664818 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ebeb3f-0c47-4e91-a2b2-a1ed05cc8062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:05.666007 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebeb3f-0c47-4e91-a2b2-a1ed05cc8062 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:05.666491 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebeb3f-0c47-4e91-a2b2-a1ed05cc8062 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:05.666959 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebeb3f-0c47-4e91-a2b2-a1ed05cc8062 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:05.680553 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ebeb3f-0c47-4e91-a2b2-a1ed05cc8062 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:05.682384 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ebeb3f-0c47-4e91-a2b2-a1ed05cc8062 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:05.704167 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-86ebeb3f-0c47-4e91-a2b2-a1ed05cc8062 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:05.704167 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:05.704167 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:05.704167 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:05.704167 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:05.704167 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:05.704167 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:05.704167 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:05.704167 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:05.704167 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:05.704167 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:05.704167 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:05.704167 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:05.704167 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:05.704167 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:05.705075 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:05.705075 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:05.705075 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:05.705075 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:05.705075 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:05.705075 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:05.705075 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:05.705075 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:05.705075 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:05.705075 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:05.705075 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:05.705075 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:05.705075 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:05.705075 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:05.705075 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:05.705075 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:05.705075 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:05.705921 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:05.705921 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:05.705921 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:05.705921 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:05.706586 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 225/459] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:23:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 10:23:05.712763 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 235/460] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:05.714323 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0041df98-cbcd-4795-bb3f-fd0b9f4e296f None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:05.746429 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ebeb3f-0c47-4e91-a2b2-a1ed05cc8062 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:05.840161 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0041df98-cbcd-4795-bb3f-fd0b9f4e296f None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:05.878687 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d0d81d-40c4-4d58-a92f-0d725fb841cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:05.879711 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d0d81d-40c4-4d58-a92f-0d725fb841cc None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:05.880192 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d0d81d-40c4-4d58-a92f-0d725fb841cc None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:05.880663 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d0d81d-40c4-4d58-a92f-0d725fb841cc None admin] PATH_INFO: `/v3/domains` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:05.881611 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d0d81d-40c4-4d58-a92f-0d725fb841cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:05.882115 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d0d81d-40c4-4d58-a92f-0d725fb841cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:05.883786 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d0d81d-40c4-4d58-a92f-0d725fb841cc None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:05.901879 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 226/461] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:23:05.903386 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d0d81d-40c4-4d58-a92f-0d725fb841cc None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:05.913819 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:05.944997 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ebeb3f-0c47-4e91-a2b2-a1ed05cc8062 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:05.980008 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd5999-fb38-40d1-b893-b465a83e38b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:05.981250 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd5999-fb38-40d1-b893-b465a83e38b1 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:05.981689 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd5999-fb38-40d1-b893-b465a83e38b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:05.982166 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd5999-fb38-40d1-b893-b465a83e38b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:05.996359 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edd5999-fb38-40d1-b893-b465a83e38b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:05.998184 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edd5999-fb38-40d1-b893-b465a83e38b1 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:06.016252 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d0d81d-40c4-4d58-a92f-0d725fb841cc None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:06.018532 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-4edd5999-fb38-40d1-b893-b465a83e38b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:06.018532 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:06.018532 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:06.018532 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:06.018532 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:06.018532 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:06.018532 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:06.018532 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:06.018532 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:06.018532 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:06.018532 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:06.018532 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:06.018532 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:06.018532 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:06.018532 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:06.019624 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:06.019624 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:06.019624 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:06.019624 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:06.019624 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:06.019624 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:06.019624 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:06.019624 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:06.019624 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:06.019624 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:06.019624 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:06.019624 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:06.019624 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:06.019624 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:06.019624 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:06.019624 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:06.019624 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:06.020657 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:06.020657 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:06.020657 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:06.020657 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:06.022641 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 236/462] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:06.028946 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651825f-5241-4f8e-ba6d-a242b240c362 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:06.029498 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651825f-5241-4f8e-ba6d-a242b240c362 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:06.029959 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651825f-5241-4f8e-ba6d-a242b240c362 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:06.031742 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 237/463] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:23:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:23:06.032698 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6651825f-5241-4f8e-ba6d-a242b240c362 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:06.054746 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b787e212-0613-44f1-9743-d78dee617510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:06.055419 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787e212-0613-44f1-9743-d78dee617510 None admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:06.055700 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787e212-0613-44f1-9743-d78dee617510 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:06.055977 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787e212-0613-44f1-9743-d78dee617510 None admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:06.056681 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b787e212-0613-44f1-9743-d78dee617510 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:06.058135 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b787e212-0613-44f1-9743-d78dee617510 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:06.067764 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:06.147116 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6651825f-5241-4f8e-ba6d-a242b240c362 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:06.182302 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f8d93-cab5-48aa-b3a6-faf2295c8f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:06.182972 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f8d93-cab5-48aa-b3a6-faf2295c8f58 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:06.183257 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f8d93-cab5-48aa-b3a6-faf2295c8f58 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:06.183533 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f8d93-cab5-48aa-b3a6-faf2295c8f58 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:06.184257 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71f8d93-cab5-48aa-b3a6-faf2295c8f58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:06.184693 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71f8d93-cab5-48aa-b3a6-faf2295c8f58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:06.186196 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71f8d93-cab5-48aa-b3a6-faf2295c8f58 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:06.196535 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 227/464] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Jul 18 10:23:05 2022] POST /identity/v3/users => generated 246 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:23:06.199009 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f08994-cbfd-460a-a077-2f2443d06ccf None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:06.201927 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f08994-cbfd-460a-a077-2f2443d06ccf None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:06.202077 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 238/465] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:06.204137 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f08994-cbfd-460a-a077-2f2443d06ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:06.204305 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780a232-e9e0-4992-826a-79d20b56db1c None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:06.204305 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780a232-e9e0-4992-826a-79d20b56db1c None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:06.204305 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780a232-e9e0-4992-826a-79d20b56db1c None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:06.205770 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 239/466] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:23:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:23:06.211681 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e780a232-e9e0-4992-826a-79d20b56db1c None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:06.229617 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-e6f08994-cbfd-460a-a077-2f2443d06ccf None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:23:06.230923 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-e6f08994-cbfd-460a-a077-2f2443d06ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:23:06.307722 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:06.318683 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:06.325453 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 228/467] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:23:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:23:06.327270 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d952b59-c8f2-43b5-9ca6-1e41b9195713 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:06.327870 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d952b59-c8f2-43b5-9ca6-1e41b9195713 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:06.328326 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d952b59-c8f2-43b5-9ca6-1e41b9195713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:06.333439 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e780a232-e9e0-4992-826a-79d20b56db1c None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:06.358258 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-9d952b59-c8f2-43b5-9ca6-1e41b9195713 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:23:06.360426 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-9d952b59-c8f2-43b5-9ca6-1e41b9195713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:23:06.374381 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e27e0-1de1-4473-8e8d-9d8241009af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:06.375086 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e27e0-1de1-4473-8e8d-9d8241009af8 None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:06.375374 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e27e0-1de1-4473-8e8d-9d8241009af8 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:06.375673 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e27e0-1de1-4473-8e8d-9d8241009af8 None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:06.376408 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437e27e0-1de1-4473-8e8d-9d8241009af8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:06.377905 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437e27e0-1de1-4473-8e8d-9d8241009af8 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:06.447505 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 229/468] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:23:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:23:06.448109 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d952b59-c8f2-43b5-9ca6-1e41b9195713 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:06.458004 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 240/469] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Jul 18 10:23:06 2022] POST /identity/v3/users => generated 248 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:23:06.497262 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e27e0-1de1-4473-8e8d-9d8241009af8 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:06.599533 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d952b59-c8f2-43b5-9ca6-1e41b9195713 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:06.629344 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:06.643306 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c2bca-4b88-4dcd-9209-6b54ac00718c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:06.644675 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c2bca-4b88-4dcd-9209-6b54ac00718c None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:06.645185 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c2bca-4b88-4dcd-9209-6b54ac00718c None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:06.645658 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c2bca-4b88-4dcd-9209-6b54ac00718c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:06.658776 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c2bca-4b88-4dcd-9209-6b54ac00718c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:06.661066 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c2bca-4b88-4dcd-9209-6b54ac00718c None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:06.684445 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-7b3c2bca-4b88-4dcd-9209-6b54ac00718c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:06.684445 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:06.684445 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:06.684445 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:06.684445 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:06.684445 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:06.684445 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:06.684445 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:06.684445 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:06.684445 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:06.684445 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:06.684445 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:06.684445 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:06.684445 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:06.684445 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:06.685426 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:06.685426 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:06.685426 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:06.685426 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:06.685426 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:06.685426 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:06.685426 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:06.685426 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:06.685426 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:06.685426 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:06.685426 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:06.685426 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:06.685426 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:06.685426 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:06.685426 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:06.685426 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:06.685426 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:06.686255 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:06.686255 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:06.686255 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:06.686255 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:06.689328 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 230/470] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:06.694974 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c2bca-4b88-4dcd-9209-6b54ac00718c None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:06.715438 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e27e0-1de1-4473-8e8d-9d8241009af8 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:06.759829 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c0e15d-31ee-4c3a-bc9a-523c68293a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:06.760882 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c0e15d-31ee-4c3a-bc9a-523c68293a71 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:06.761188 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c0e15d-31ee-4c3a-bc9a-523c68293a71 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:06.761463 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c0e15d-31ee-4c3a-bc9a-523c68293a71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:06.778865 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c0e15d-31ee-4c3a-bc9a-523c68293a71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:06.780329 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c0e15d-31ee-4c3a-bc9a-523c68293a71 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:06.789212 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:06.812832 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-65c0e15d-31ee-4c3a-bc9a-523c68293a71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:06.812832 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:06.812832 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:06.812832 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:06.812832 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:06.812832 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:06.812832 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:06.812832 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:06.812832 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:06.812832 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:06.812832 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:06.812832 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:06.812832 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:06.812832 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:06.812832 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:06.813794 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:06.813794 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:06.813794 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:06.813794 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:06.813794 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:06.813794 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:06.813794 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:06.813794 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:06.813794 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:06.813794 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:06.813794 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:06.813794 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:06.813794 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:06.813794 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:06.813794 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:06.813794 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:06.813794 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:06.814612 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:06.814612 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:06.814612 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:06.814612 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:06.817235 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 241/471] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:23:06.826068 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c0e15d-31ee-4c3a-bc9a-523c68293a71 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:06.840190 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c2bca-4b88-4dcd-9209-6b54ac00718c None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:06.881235 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc68c902-b07c-494b-a9b2-d39d3e8d37d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:06.882417 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68c902-b07c-494b-a9b2-d39d3e8d37d9 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:06.883083 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68c902-b07c-494b-a9b2-d39d3e8d37d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:06.883745 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68c902-b07c-494b-a9b2-d39d3e8d37d9 None admin] PATH_INFO: `/v3/domains` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:06.884675 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc68c902-b07c-494b-a9b2-d39d3e8d37d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:06.885245 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc68c902-b07c-494b-a9b2-d39d3e8d37d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:06.886986 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc68c902-b07c-494b-a9b2-d39d3e8d37d9 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:06.904089 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 231/472] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:23:06.907456 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc68c902-b07c-494b-a9b2-d39d3e8d37d9 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:06.941066 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c0e15d-31ee-4c3a-bc9a-523c68293a71 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:06.946781 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:06.980457 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584bc731-153b-4897-9cbe-37c3450589e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:06.981199 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584bc731-153b-4897-9cbe-37c3450589e2 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:06.981447 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584bc731-153b-4897-9cbe-37c3450589e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:06.981802 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584bc731-153b-4897-9cbe-37c3450589e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:06.982472 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584bc731-153b-4897-9cbe-37c3450589e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:06.982785 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584bc731-153b-4897-9cbe-37c3450589e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:06.984358 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584bc731-153b-4897-9cbe-37c3450589e2 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:06.998162 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 242/473] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:07.004215 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584bc731-153b-4897-9cbe-37c3450589e2 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:07.034676 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc68c902-b07c-494b-a9b2-d39d3e8d37d9 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:07.072475 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36602044-7443-4d97-a1f8-30c03b5dd9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:07.073236 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36602044-7443-4d97-a1f8-30c03b5dd9b9 None admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:07.073522 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36602044-7443-4d97-a1f8-30c03b5dd9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:07.073851 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36602044-7443-4d97-a1f8-30c03b5dd9b9 None admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:07.074561 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36602044-7443-4d97-a1f8-30c03b5dd9b9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:07.076062 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36602044-7443-4d97-a1f8-30c03b5dd9b9 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:07.091911 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:07.141735 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584bc731-153b-4897-9cbe-37c3450589e2 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:07.176186 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 232/474] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Jul 18 10:23:06 2022] POST /identity/v3/users => generated 248 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:23:07.178042 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc54cf-0f5e-45ba-bb94-21827d8eaec5 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:07.178381 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc54cf-0f5e-45ba-bb94-21827d8eaec5 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:07.178665 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc54cf-0f5e-45ba-bb94-21827d8eaec5 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:07.180467 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 233/475] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:23:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:23:07.186720 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd9270-4c1b-47af-9b6c-4b7e8b4f1401 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:07.186720 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd9270-4c1b-47af-9b6c-4b7e8b4f1401 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:07.186720 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd9270-4c1b-47af-9b6c-4b7e8b4f1401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:07.189524 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c1ea3d-e8de-442d-8ef3-23f14461b0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:07.190402 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1ea3d-e8de-442d-8ef3-23f14461b0c3 None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:07.190861 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1ea3d-e8de-442d-8ef3-23f14461b0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:07.191317 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1ea3d-e8de-442d-8ef3-23f14461b0c3 None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:07.192238 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c1ea3d-e8de-442d-8ef3-23f14461b0c3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:07.194044 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c1ea3d-e8de-442d-8ef3-23f14461b0c3 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:07.219516 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-b8cd9270-4c1b-47af-9b6c-4b7e8b4f1401 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:23:07.221164 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-b8cd9270-4c1b-47af-9b6c-4b7e8b4f1401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:23:07.304612 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 243/476] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Jul 18 10:23:07 2022] POST /identity/v3/users => generated 249 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:23:07.311543 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 234/477] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:23:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 10:23:07.356458 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c1ea3d-e8de-442d-8ef3-23f14461b0c3 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:07.488732 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c1ea3d-e8de-442d-8ef3-23f14461b0c3 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:07.502945 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:07.524957 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926578c2-d5a0-40f1-b6b6-e77e6b810c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:07.525712 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926578c2-d5a0-40f1-b6b6-e77e6b810c89 None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:07.525995 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926578c2-d5a0-40f1-b6b6-e77e6b810c89 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:07.526275 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926578c2-d5a0-40f1-b6b6-e77e6b810c89 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:07.527095 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926578c2-d5a0-40f1-b6b6-e77e6b810c89 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:07.528540 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926578c2-d5a0-40f1-b6b6-e77e6b810c89 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:07.560862 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.sql.core [None req-926578c2-d5a0-40f1-b6b6-e77e6b810c89 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 18 10:23:07.560862 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 18 10:23:07.560862 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [parameters: {'id': '27216cc97fc747b9b54cc8e96ac8c525', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 18 10:23:07.560862 dv-cinder-837546-3-smb devstack@keystone.service[80393]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80393) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 18 10:23:07.578010 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-926578c2-d5a0-40f1-b6b6-e77e6b810c89 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 18 10:23:07.578010 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:07.578010 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 10:23:07.578010 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 18 10:23:07.578010 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 10:23:07.578010 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 18 10:23:07.578010 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 10:23:07.578010 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application result = self._query(query) Jul 18 10:23:07.578010 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 10:23:07.578010 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application conn.query(q) Jul 18 10:23:07.578010 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 10:23:07.578010 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 10:23:07.578010 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 10:23:07.578010 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application result.read() Jul 18 10:23:07.578010 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 10:23:07.578907 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 18 10:23:07.578907 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 10:23:07.578907 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 18 10:23:07.578907 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 10:23:07.578907 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 18 10:23:07.578907 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 10:23:07.578907 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 18 10:23:07.578907 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 18 10:23:07.578907 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:07.578907 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 18 10:23:07.578907 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:07.578907 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:07.578907 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 18 10:23:07.578907 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 18 10:23:07.578907 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 18 10:23:07.578907 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return ref.to_dict() Jul 18 10:23:07.578907 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 18 10:23:07.578907 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application next(self.gen) Jul 18 10:23:07.579799 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 18 10:23:07.579799 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application yield resource Jul 18 10:23:07.579799 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 18 10:23:07.579799 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application next(self.gen) Jul 18 10:23:07.579799 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 18 10:23:07.579799 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self.session.rollback() Jul 18 10:23:07.579799 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 10:23:07.579799 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self.force_reraise() Jul 18 10:23:07.579799 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 10:23:07.579799 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise self.value Jul 18 10:23:07.579799 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 18 10:23:07.579799 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 18 10:23:07.579799 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 18 10:23:07.579799 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application session.commit() Jul 18 10:23:07.579799 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 18 10:23:07.579799 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 18 10:23:07.579799 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 18 10:23:07.581148 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._prepare_impl() Jul 18 10:23:07.581148 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 18 10:23:07.581148 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self.session.flush() Jul 18 10:23:07.581148 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 18 10:23:07.581148 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._flush(objects) Jul 18 10:23:07.581148 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 18 10:23:07.581148 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 18 10:23:07.581148 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 18 10:23:07.581148 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application compat.raise_( Jul 18 10:23:07.581148 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 10:23:07.581148 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception Jul 18 10:23:07.581148 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 18 10:23:07.581148 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application flush_context.execute() Jul 18 10:23:07.581148 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 18 10:23:07.581148 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rec.execute(self) Jul 18 10:23:07.581148 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 18 10:23:07.581148 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 18 10:23:07.581974 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 18 10:23:07.581974 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 18 10:23:07.581974 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 18 10:23:07.581974 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 18 10:23:07.581974 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 18 10:23:07.581974 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 18 10:23:07.581974 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 18 10:23:07.581974 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 18 10:23:07.581974 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 18 10:23:07.581974 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 18 10:23:07.581974 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 18 10:23:07.581974 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 18 10:23:07.581974 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 18 10:23:07.581974 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 18 10:23:07.581974 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 10:23:07.581974 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception Jul 18 10:23:07.582832 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 10:23:07.582832 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 18 10:23:07.582832 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 10:23:07.582832 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 18 10:23:07.582832 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 10:23:07.582832 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application result = self._query(query) Jul 18 10:23:07.582832 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 10:23:07.582832 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application conn.query(q) Jul 18 10:23:07.582832 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 10:23:07.582832 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 10:23:07.582832 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 10:23:07.582832 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application result.read() Jul 18 10:23:07.582832 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 10:23:07.582832 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 18 10:23:07.582832 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 10:23:07.582832 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 18 10:23:07.583716 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 10:23:07.583716 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 18 10:23:07.583716 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 10:23:07.583716 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 18 10:23:07.583716 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 18 10:23:07.583716 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 18 10:23:07.583716 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [parameters: {'id': '27216cc97fc747b9b54cc8e96ac8c525', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 18 10:23:07.583716 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 18 10:23:07.583716 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:07.583716 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 10:23:07.583716 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:07.583716 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:07.583716 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:07.583716 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:07.583716 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:07.583716 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:07.584545 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:07.584545 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:07.584545 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:07.584545 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:07.584545 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:07.584545 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:07.584545 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 18 10:23:07.584545 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 18 10:23:07.584545 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:07.584545 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:07.584545 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 18 10:23:07.584545 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 18 10:23:07.584545 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 18 10:23:07.584545 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 18 10:23:07.584545 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 18 10:23:07.584545 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:07.585431 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 244/478] 10.222.0.39 () {60 vars in 1131 bytes} [Mon Jul 18 10:23:07 2022] POST /identity/v3/roles => generated 144 bytes in 224 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:07.586349 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd9270-4c1b-47af-9b6c-4b7e8b4f1401 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:07.613216 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:07.698782 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd9270-4c1b-47af-9b6c-4b7e8b4f1401 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:07.737930 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7f013b-5f78-4fc5-a723-a0c112151627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:07.738745 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f013b-5f78-4fc5-a723-a0c112151627 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:07.739027 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f013b-5f78-4fc5-a723-a0c112151627 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:07.739565 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f013b-5f78-4fc5-a723-a0c112151627 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:07.754976 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7f013b-5f78-4fc5-a723-a0c112151627 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:23:07.763674 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-6b7f013b-5f78-4fc5-a723-a0c112151627 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 10:23:07.763674 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:07.763674 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:07.763674 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:07.763674 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:07.763674 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:07.763674 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:07.763674 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:07.763674 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:07.763674 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:07.763674 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:07.763674 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:07.763674 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:23:07.763674 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:23:07.763674 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:23:07.763674 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:23:07.764565 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:23:07.764565 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:23:07.764565 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:23:07.764565 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:23:07.764565 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:07.764565 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:07.764565 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:07.764565 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:07.764565 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:07.764565 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:07.764565 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:07.764565 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:07.764565 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:07.764565 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:07.764565 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:07.764565 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:07.765935 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:07.765935 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:07.765935 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:07.765935 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:07.765935 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:23:07.765935 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:23:07.765935 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:23:07.765935 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:23:07.765935 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:23:07.765935 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:23:07.765935 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 10:23:07.765935 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:07.765935 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 235/479] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Jul 18 10:23:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:07.774690 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926578c2-d5a0-40f1-b6b6-e77e6b810c89 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:07.921174 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926578c2-d5a0-40f1-b6b6-e77e6b810c89 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:07.959610 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87739b7b-61a1-4b02-8aa7-80579c36e71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:07.960278 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87739b7b-61a1-4b02-8aa7-80579c36e71a None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:07.960643 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87739b7b-61a1-4b02-8aa7-80579c36e71a None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:07.960880 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87739b7b-61a1-4b02-8aa7-80579c36e71a None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:07.961719 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87739b7b-61a1-4b02-8aa7-80579c36e71a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:07.962025 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87739b7b-61a1-4b02-8aa7-80579c36e71a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:07.963514 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87739b7b-61a1-4b02-8aa7-80579c36e71a None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:07.973153 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 245/480] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 10:23:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:08.643821 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc74b0-1b6f-4e67-83f9-4af003a69306 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:08.644333 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc74b0-1b6f-4e67-83f9-4af003a69306 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:08.644406 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc74b0-1b6f-4e67-83f9-4af003a69306 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:08.646011 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 236/481] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:23:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:23:08.652101 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a638d-c461-4f2f-8482-283280b25f83 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:08.652617 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a638d-c461-4f2f-8482-283280b25f83 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:08.652769 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a638d-c461-4f2f-8482-283280b25f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:08.678140 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-531a638d-c461-4f2f-8482-283280b25f83 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:23:08.679350 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-531a638d-c461-4f2f-8482-283280b25f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:23:08.719486 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:08.776026 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 246/482] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:23:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:23:08.802227 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc74b0-1b6f-4e67-83f9-4af003a69306 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:08.924274 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:08.954717 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc74b0-1b6f-4e67-83f9-4af003a69306 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:09.003593 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb7ec96-82e0-4bea-87c3-71d0ee69f5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:09.004402 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7ec96-82e0-4bea-87c3-71d0ee69f5af None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:09.004688 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7ec96-82e0-4bea-87c3-71d0ee69f5af None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:09.004993 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7ec96-82e0-4bea-87c3-71d0ee69f5af None admin] PATH_INFO: `/v3/roles/service` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:09.025460 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb7ec96-82e0-4bea-87c3-71d0ee69f5af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:23:09.033395 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-6fb7ec96-82e0-4bea-87c3-71d0ee69f5af None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:23:09.033395 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:09.033395 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:09.033395 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:09.033395 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:09.033395 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:09.033395 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:09.033395 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:09.033395 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:09.033395 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:09.033395 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:09.033395 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:09.033395 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:23:09.033395 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:23:09.033395 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:23:09.033395 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:23:09.034258 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:23:09.034258 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:23:09.034258 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:23:09.034258 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:23:09.034258 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:09.034258 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:09.034258 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:09.034258 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:09.034258 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:09.034258 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:09.034258 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:09.034258 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:09.034258 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:09.034258 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:09.034258 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:09.034258 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:09.035028 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:09.035028 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:09.035028 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:09.035028 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:09.035028 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:23:09.035028 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:23:09.035028 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:23:09.035028 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:23:09.035028 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:23:09.035028 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:23:09.035028 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:23:09.035028 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:09.035028 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 237/483] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jul 18 10:23:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:09.040645 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a638d-c461-4f2f-8482-283280b25f83 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:09.199884 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a638d-c461-4f2f-8482-283280b25f83 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:09.250520 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db8abe-4845-4e27-842d-75470cba6756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:09.251578 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db8abe-4845-4e27-842d-75470cba6756 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:09.252073 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db8abe-4845-4e27-842d-75470cba6756 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:09.252551 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db8abe-4845-4e27-842d-75470cba6756 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:09.252864 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897307f-e9d9-490a-915c-bc8242d54d0c None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:09.253227 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897307f-e9d9-490a-915c-bc8242d54d0c None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:09.253513 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897307f-e9d9-490a-915c-bc8242d54d0c None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:09.254723 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8db8abe-4845-4e27-842d-75470cba6756 None admin] RBAC: Adding query filter params (name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:09.254899 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 238/484] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:23:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:23:09.255407 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8db8abe-4845-4e27-842d-75470cba6756 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:09.256964 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8db8abe-4845-4e27-842d-75470cba6756 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:09.264424 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c331f9f-d4a5-43ec-a7d5-07afaf8f6aa4 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:09.264718 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c331f9f-d4a5-43ec-a7d5-07afaf8f6aa4 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:09.265077 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c331f9f-d4a5-43ec-a7d5-07afaf8f6aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:09.268688 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 247/485] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Jul 18 10:23:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:23:09.278770 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db8abe-4845-4e27-842d-75470cba6756 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:09.300324 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-4c331f9f-d4a5-43ec-a7d5-07afaf8f6aa4 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:23:09.301882 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-4c331f9f-d4a5-43ec-a7d5-07afaf8f6aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:23:09.336414 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:09.446677 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 239/486] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:23:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:23:09.462904 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db8abe-4845-4e27-842d-75470cba6756 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:09.476843 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c331f9f-d4a5-43ec-a7d5-07afaf8f6aa4 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:09.527806 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df3e243-a82b-4912-8050-abc001e73855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:09.528619 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3e243-a82b-4912-8050-abc001e73855 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:09.528904 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3e243-a82b-4912-8050-abc001e73855 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:09.529850 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3e243-a82b-4912-8050-abc001e73855 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:09.551427 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df3e243-a82b-4912-8050-abc001e73855 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:09.553479 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df3e243-a82b-4912-8050-abc001e73855 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:09.573397 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:09.584100 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-6df3e243-a82b-4912-8050-abc001e73855 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:09.584100 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:09.584100 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:09.584100 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:09.584100 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:09.584100 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:09.584100 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:09.584100 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:09.584100 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:09.584100 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:09.584100 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:09.584100 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:09.584100 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:09.584100 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:09.584100 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:09.585591 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:09.585591 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:09.585591 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:09.585591 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:09.585591 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:09.585591 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:09.585591 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:09.585591 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:09.585591 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:09.585591 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:09.585591 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:09.585591 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:09.585591 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:09.585591 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:09.585591 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:09.585591 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:09.585591 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:09.586531 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:09.586531 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:09.586531 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:09.586531 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:09.588459 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 248/487] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:09.598255 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df3e243-a82b-4912-8050-abc001e73855 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:09.617096 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c331f9f-d4a5-43ec-a7d5-07afaf8f6aa4 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:09.686327 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a115e-8ff3-4556-8b17-bd1d6c58dac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:09.687675 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a115e-8ff3-4556-8b17-bd1d6c58dac3 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:09.687957 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a115e-8ff3-4556-8b17-bd1d6c58dac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:09.688225 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a115e-8ff3-4556-8b17-bd1d6c58dac3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:09.701477 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:09.710606 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3a115e-8ff3-4556-8b17-bd1d6c58dac3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:23:09.722454 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df3e243-a82b-4912-8050-abc001e73855 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:09.730757 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-aa3a115e-8ff3-4556-8b17-bd1d6c58dac3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:23:09.730757 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:09.730757 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:09.730757 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:09.730757 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:09.730757 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:09.730757 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:09.730757 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:09.730757 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:09.730757 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:09.730757 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:09.730757 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:09.730757 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:23:09.730757 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:23:09.730757 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:23:09.730757 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:23:09.731720 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:23:09.731720 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:23:09.731720 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:23:09.731720 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:23:09.731720 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:09.731720 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:09.731720 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:09.731720 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:09.731720 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:09.731720 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:09.731720 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:09.731720 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:09.731720 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:09.731720 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:09.731720 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:09.731720 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:09.732510 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:09.732510 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:09.732510 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:09.732510 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:09.732510 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:23:09.732510 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:23:09.732510 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:23:09.732510 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:23:09.732510 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:23:09.732510 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:23:09.732510 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:23:09.732510 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:09.732510 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 240/488] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jul 18 10:23:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:09.742019 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a115e-8ff3-4556-8b17-bd1d6c58dac3 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:09.764413 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd655a87-064b-41ce-9376-d0c434399559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:09.765628 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd655a87-064b-41ce-9376-d0c434399559 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:09.766146 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd655a87-064b-41ce-9376-d0c434399559 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:09.766624 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd655a87-064b-41ce-9376-d0c434399559 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:09.767617 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd655a87-064b-41ce-9376-d0c434399559 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:09.768136 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd655a87-064b-41ce-9376-d0c434399559 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:09.769807 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd655a87-064b-41ce-9376-d0c434399559 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:09.782838 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 249/489] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:09.788367 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd655a87-064b-41ce-9376-d0c434399559 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:09.957582 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a115e-8ff3-4556-8b17-bd1d6c58dac3 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:09.980084 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd655a87-064b-41ce-9376-d0c434399559 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:10.018057 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:10.025884 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5fe9e2-a375-409e-8228-e73f83fe39c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:10.026928 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5fe9e2-a375-409e-8228-e73f83fe39c3 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:10.027464 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5fe9e2-a375-409e-8228-e73f83fe39c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:10.027950 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5fe9e2-a375-409e-8228-e73f83fe39c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:10.028902 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5fe9e2-a375-409e-8228-e73f83fe39c3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:10.031149 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5fe9e2-a375-409e-8228-e73f83fe39c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:10.033931 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5fe9e2-a375-409e-8228-e73f83fe39c3 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:10.044236 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5be97d-8f98-4f50-ba18-bf81f435691c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:10.050820 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 241/490] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Jul 18 10:23:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:10.050820 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ac085-d319-4e61-a70d-853495e462a5 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:10.050820 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ac085-d319-4e61-a70d-853495e462a5 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:10.050820 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ac085-d319-4e61-a70d-853495e462a5 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:10.050820 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 242/491] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:23:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:23:10.051208 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ac085-d319-4e61-a70d-853495e462a5 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:10.051624 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5be97d-8f98-4f50-ba18-bf81f435691c None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:10.052131 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5be97d-8f98-4f50-ba18-bf81f435691c None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:10.052616 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5be97d-8f98-4f50-ba18-bf81f435691c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:10.066593 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5be97d-8f98-4f50-ba18-bf81f435691c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:10.068197 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5be97d-8f98-4f50-ba18-bf81f435691c None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:10.083993 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-1a5be97d-8f98-4f50-ba18-bf81f435691c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 10:23:10.083993 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:10.083993 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:10.083993 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:10.083993 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:10.083993 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:10.083993 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:10.083993 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:10.083993 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:10.083993 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:10.083993 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:10.083993 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:10.083993 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:23:10.083993 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:23:10.083993 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:23:10.083993 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:23:10.084906 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:10.084906 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:10.084906 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:23:10.084906 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:23:10.084906 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:23:10.084906 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:23:10.084906 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:10.084906 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:10.084906 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:10.084906 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:10.084906 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:10.084906 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:10.084906 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:10.084906 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:10.084906 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:10.084906 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:10.084906 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:10.084906 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:10.085818 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:10.085818 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:10.085818 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:23:10.085818 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:23:10.085818 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:23:10.085818 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:23:10.085818 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:23:10.085818 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:23:10.085818 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 10:23:10.085818 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:10.090509 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 250/492] 10.222.0.39 () {56 vars in 1093 bytes} [Mon Jul 18 10:23:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:10.090509 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc6392-c90a-4ff4-8325-adc55a7b54d5 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:10.090509 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc6392-c90a-4ff4-8325-adc55a7b54d5 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:10.090762 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc6392-c90a-4ff4-8325-adc55a7b54d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:10.096967 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:10.113114 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-5cbc6392-c90a-4ff4-8325-adc55a7b54d5 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:23:10.114583 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-5cbc6392-c90a-4ff4-8325-adc55a7b54d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:23:10.166961 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ac085-d319-4e61-a70d-853495e462a5 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:10.190179 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 251/493] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:23:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:23:10.191650 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11bbe9f-0265-4439-9973-fa4537dcb654 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:10.192008 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11bbe9f-0265-4439-9973-fa4537dcb654 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:10.192351 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11bbe9f-0265-4439-9973-fa4537dcb654 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:10.193866 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 252/494] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:23:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:23:10.194459 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11bbe9f-0265-4439-9973-fa4537dcb654 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:10.212170 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dce144-d641-4403-945f-995de26cb063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:10.213464 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dce144-d641-4403-945f-995de26cb063 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:10.214093 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dce144-d641-4403-945f-995de26cb063 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:10.214655 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dce144-d641-4403-945f-995de26cb063 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:10.226168 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dce144-d641-4403-945f-995de26cb063 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:10.227623 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dce144-d641-4403-945f-995de26cb063 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:10.245923 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-14dce144-d641-4403-945f-995de26cb063 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:10.245923 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:10.245923 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:10.245923 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:10.245923 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:10.245923 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:10.245923 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:10.245923 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:10.245923 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:10.245923 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:10.245923 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:10.245923 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:10.245923 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:10.245923 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:10.245923 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:10.246797 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:10.246797 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:10.246797 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:10.246797 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:10.246797 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:10.246797 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:10.246797 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:10.246797 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:10.246797 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:10.246797 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:10.246797 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:10.246797 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:10.246797 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:10.246797 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:10.246797 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:10.246797 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:10.246797 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:10.247626 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:10.247626 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:10.247626 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:10.247626 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:10.247626 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 243/495] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:10.248570 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4936de-bbdd-4713-993d-7ba9016d9f9d None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:10.248855 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4936de-bbdd-4713-993d-7ba9016d9f9d None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:10.249149 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4936de-bbdd-4713-993d-7ba9016d9f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:10.267123 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-ac4936de-bbdd-4713-993d-7ba9016d9f9d None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:23:10.268317 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-ac4936de-bbdd-4713-993d-7ba9016d9f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:23:10.310445 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11bbe9f-0265-4439-9973-fa4537dcb654 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:10.311826 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:10.345893 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:10.346962 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fc3cdb-06ed-4513-aa87-be5693c192ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:10.347943 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc3cdb-06ed-4513-aa87-be5693c192ce None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:10.348238 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc3cdb-06ed-4513-aa87-be5693c192ce None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:10.348601 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc3cdb-06ed-4513-aa87-be5693c192ce None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:10.349598 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fc3cdb-06ed-4513-aa87-be5693c192ce None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:10.349911 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fc3cdb-06ed-4513-aa87-be5693c192ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:10.351457 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fc3cdb-06ed-4513-aa87-be5693c192ce None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:10.353567 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 244/496] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:23:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:23:10.354853 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4936de-bbdd-4713-993d-7ba9016d9f9d None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:10.391810 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 253/497] 10.222.0.39 () {56 vars in 1133 bytes} [Mon Jul 18 10:23:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:10.393307 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fc3cdb-06ed-4513-aa87-be5693c192ce None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:10.466322 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4936de-bbdd-4713-993d-7ba9016d9f9d None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:10.503382 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf7160-f913-453c-bddc-574e8a04993a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:10.504109 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf7160-f913-453c-bddc-574e8a04993a None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:10.504311 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fc3cdb-06ed-4513-aa87-be5693c192ce None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:10.504413 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf7160-f913-453c-bddc-574e8a04993a None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:10.504652 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf7160-f913-453c-bddc-574e8a04993a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:10.515600 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf7160-f913-453c-bddc-574e8a04993a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:23:10.523450 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-31bf7160-f913-453c-bddc-574e8a04993a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:23:10.523450 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:10.523450 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:10.523450 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:10.523450 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:10.523450 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:10.523450 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:10.523450 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:10.523450 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:10.523450 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:10.523450 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:10.523450 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:10.523450 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:23:10.523450 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:23:10.523450 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:23:10.523450 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:23:10.524402 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:23:10.524402 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:23:10.524402 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:23:10.524402 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:23:10.524402 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:10.524402 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:10.524402 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:10.524402 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:10.524402 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:10.524402 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:10.524402 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:10.524402 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:10.524402 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:10.524402 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:10.524402 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:10.524402 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:10.525216 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:10.525216 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:10.525216 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:10.525216 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:10.525216 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:23:10.525216 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:23:10.525216 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:23:10.525216 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:23:10.525216 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:23:10.525216 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:23:10.525216 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:23:10.525216 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:10.525216 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 245/498] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jul 18 10:23:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:10.525883 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf7160-f913-453c-bddc-574e8a04993a None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:10.547401 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce03b6dd-ac99-4d2a-aa3b-29e00881b82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:10.548079 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03b6dd-ac99-4d2a-aa3b-29e00881b82c None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:10.548365 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03b6dd-ac99-4d2a-aa3b-29e00881b82c None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:10.548638 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03b6dd-ac99-4d2a-aa3b-29e00881b82c None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:10.549402 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce03b6dd-ac99-4d2a-aa3b-29e00881b82c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:10.549732 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce03b6dd-ac99-4d2a-aa3b-29e00881b82c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:10.551235 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce03b6dd-ac99-4d2a-aa3b-29e00881b82c None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:10.564046 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 254/499] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:10.564841 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce03b6dd-ac99-4d2a-aa3b-29e00881b82c None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:10.571825 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:10.623787 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:10.648195 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf7160-f913-453c-bddc-574e8a04993a None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:10.677679 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce03b6dd-ac99-4d2a-aa3b-29e00881b82c None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:10.684882 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c82429-0acf-43ab-8225-b81fd4715737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:10.685715 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c82429-0acf-43ab-8225-b81fd4715737 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:10.685994 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c82429-0acf-43ab-8225-b81fd4715737 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:10.686271 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c82429-0acf-43ab-8225-b81fd4715737 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:10.696917 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c82429-0acf-43ab-8225-b81fd4715737 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:23:10.704785 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-81c82429-0acf-43ab-8225-b81fd4715737 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:23:10.704785 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:10.704785 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:10.704785 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:10.704785 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:10.704785 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:10.704785 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:10.704785 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:10.704785 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:10.704785 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:10.704785 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:10.704785 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:10.704785 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:23:10.704785 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:23:10.704785 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:23:10.704785 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:23:10.705856 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:23:10.705856 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:23:10.705856 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:23:10.705856 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:23:10.705856 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:10.705856 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:10.705856 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:10.705856 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:10.705856 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:10.705856 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:10.705856 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:10.705856 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:10.705856 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:10.705856 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:10.705856 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:10.705856 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:10.706930 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:10.706930 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:10.706930 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:10.706930 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:10.706930 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:23:10.706930 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:23:10.706930 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:23:10.706930 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:23:10.706930 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:23:10.706930 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:23:10.706930 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:23:10.706930 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:10.706930 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 246/500] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jul 18 10:23:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:10.706930 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c82429-0acf-43ab-8225-b81fd4715737 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:10.713499 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a843fc-2e50-435e-a69a-72d4f24f2293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:10.714149 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a843fc-2e50-435e-a69a-72d4f24f2293 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:10.714426 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a843fc-2e50-435e-a69a-72d4f24f2293 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:10.714697 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a843fc-2e50-435e-a69a-72d4f24f2293 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:10.782327 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a843fc-2e50-435e-a69a-72d4f24f2293 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:10.783701 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a843fc-2e50-435e-a69a-72d4f24f2293 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:10.799656 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:10.806309 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c82429-0acf-43ab-8225-b81fd4715737 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:10.835044 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:10.840843 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0320900-83f5-4219-887f-8167ed12085f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:10.841863 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0320900-83f5-4219-887f-8167ed12085f None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:10.842150 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0320900-83f5-4219-887f-8167ed12085f None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:10.842431 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0320900-83f5-4219-887f-8167ed12085f None admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:10.843381 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0320900-83f5-4219-887f-8167ed12085f None admin] RBAC: Adding query filter params (name=service) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:10.843698 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0320900-83f5-4219-887f-8167ed12085f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:10.845105 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0320900-83f5-4219-887f-8167ed12085f None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:10.853247 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 247/501] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Jul 18 10:23:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:10.854194 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0320900-83f5-4219-887f-8167ed12085f None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:10.895136 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 255/502] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 10:23:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:23:10.895136 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365cc8e-750e-44a7-9af2-2ddcef722244 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:10.895136 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365cc8e-750e-44a7-9af2-2ddcef722244 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:10.895136 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365cc8e-750e-44a7-9af2-2ddcef722244 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:10.895136 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 256/503] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:23:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:23:10.895136 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365cc8e-750e-44a7-9af2-2ddcef722244 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:10.954947 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0320900-83f5-4219-887f-8167ed12085f None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:10.989653 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1301ae43-aa8a-46e9-9118-22e6afe07f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:10.990448 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301ae43-aa8a-46e9-9118-22e6afe07f40 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:10.990736 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301ae43-aa8a-46e9-9118-22e6afe07f40 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:10.991014 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301ae43-aa8a-46e9-9118-22e6afe07f40 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:10.996125 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365cc8e-750e-44a7-9af2-2ddcef722244 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:10.998436 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1301ae43-aa8a-46e9-9118-22e6afe07f40 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:10.999989 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1301ae43-aa8a-46e9-9118-22e6afe07f40 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:11.016378 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-1301ae43-aa8a-46e9-9118-22e6afe07f40 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 18 10:23:11.016378 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:11.016378 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:11.016378 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:11.016378 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:11.016378 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:11.016378 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:11.016378 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:11.016378 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:11.016378 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:11.016378 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:11.016378 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:11.016378 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:23:11.016378 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:23:11.016378 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:23:11.016378 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:23:11.017529 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:11.017529 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:11.017529 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:23:11.017529 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:23:11.017529 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:23:11.017529 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:23:11.017529 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:11.017529 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:11.017529 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:11.017529 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:11.017529 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:11.017529 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:11.017529 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:11.017529 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:11.017529 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:11.017529 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:11.017529 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:11.017529 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:11.018629 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:11.018629 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:11.018629 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:23:11.018629 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:23:11.018629 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:23:11.018629 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:23:11.018629 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:23:11.018629 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:23:11.018629 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 18 10:23:11.018629 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:11.018629 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 248/504] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 10:23:10 2022] GET /identity/v3/users/glance => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:11.018629 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1301ae43-aa8a-46e9-9118-22e6afe07f40 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:11.033508 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3211afb-b882-4a8d-8f36-363306f3eec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:11.034123 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3211afb-b882-4a8d-8f36-363306f3eec7 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:11.034408 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3211afb-b882-4a8d-8f36-363306f3eec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:11.034688 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3211afb-b882-4a8d-8f36-363306f3eec7 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:11.035433 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3211afb-b882-4a8d-8f36-363306f3eec7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:11.035745 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3211afb-b882-4a8d-8f36-363306f3eec7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:11.037123 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3211afb-b882-4a8d-8f36-363306f3eec7 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:11.037286 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:11.045063 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 257/505] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Jul 18 10:23:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:11.045852 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3211afb-b882-4a8d-8f36-363306f3eec7 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:11.060410 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:11.125248 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1301ae43-aa8a-46e9-9118-22e6afe07f40 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:11.146896 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3211afb-b882-4a8d-8f36-363306f3eec7 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:11.160123 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8371739-fb1b-4de2-8141-bfc7fd73ab43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:11.160918 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8371739-fb1b-4de2-8141-bfc7fd73ab43 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:11.161230 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8371739-fb1b-4de2-8141-bfc7fd73ab43 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:11.161507 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8371739-fb1b-4de2-8141-bfc7fd73ab43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:11.172255 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8371739-fb1b-4de2-8141-bfc7fd73ab43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:11.173866 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8371739-fb1b-4de2-8141-bfc7fd73ab43 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:11.180519 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c991e4-54c8-41a4-ba3c-11dea73d618a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:11.181337 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c991e4-54c8-41a4-ba3c-11dea73d618a None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:11.181622 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c991e4-54c8-41a4-ba3c-11dea73d618a None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:11.181894 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c991e4-54c8-41a4-ba3c-11dea73d618a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:11.192196 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c991e4-54c8-41a4-ba3c-11dea73d618a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:11.192371 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-a8371739-fb1b-4de2-8141-bfc7fd73ab43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:11.192371 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:11.192371 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:11.192371 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:11.192371 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:11.192371 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:11.192371 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:11.192371 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:11.192371 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:11.192371 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:11.192371 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:11.192371 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:11.192371 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:11.192371 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:11.192371 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:11.193272 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:11.193272 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:11.193272 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:11.193272 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:11.193272 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:11.193272 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:11.193272 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:11.193272 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:11.193272 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:11.193272 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:11.193272 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:11.193272 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:11.193272 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:11.193272 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:11.193272 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:11.193272 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:11.193272 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:11.194101 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:11.194101 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:11.194101 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:11.194101 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:11.194101 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 249/506] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:11.194747 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7c33a-c41f-4857-b93a-32fbf651d991 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:11.195038 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7c33a-c41f-4857-b93a-32fbf651d991 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:11.195315 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7c33a-c41f-4857-b93a-32fbf651d991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:11.197137 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c991e4-54c8-41a4-ba3c-11dea73d618a None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:11.212927 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-90c7c33a-c41f-4857-b93a-32fbf651d991 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:23:11.214159 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-90c7c33a-c41f-4857-b93a-32fbf651d991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:23:11.214886 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-c9c991e4-54c8-41a4-ba3c-11dea73d618a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:11.214886 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:11.214886 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:11.214886 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:11.214886 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:11.214886 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:11.214886 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:11.214886 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:11.214886 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:11.214886 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:11.214886 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:11.214886 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:11.214886 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:11.214886 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:11.214886 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:11.215781 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:11.215781 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:11.215781 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:11.215781 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:11.215781 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:11.215781 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:11.215781 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:11.215781 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:11.215781 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:11.215781 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:11.215781 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:11.215781 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:11.215781 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:11.215781 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:11.215781 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:11.215781 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:11.215781 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:11.216601 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:11.216601 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:11.216601 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:11.216601 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:11.216601 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 258/507] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:11.216919 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c991e4-54c8-41a4-ba3c-11dea73d618a None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:11.280278 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:11.280745 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:11.285699 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 250/508] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:23:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:23:11.286448 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c7c33a-c41f-4857-b93a-32fbf651d991 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:11.319659 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c991e4-54c8-41a4-ba3c-11dea73d618a None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:11.354252 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aacb8a-f105-429d-bdea-bae12cbdb5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:11.354919 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aacb8a-f105-429d-bdea-bae12cbdb5ca None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:11.355199 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aacb8a-f105-429d-bdea-bae12cbdb5ca None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:11.355718 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aacb8a-f105-429d-bdea-bae12cbdb5ca None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:11.356294 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aacb8a-f105-429d-bdea-bae12cbdb5ca None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:11.356628 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aacb8a-f105-429d-bdea-bae12cbdb5ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:11.358226 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aacb8a-f105-429d-bdea-bae12cbdb5ca None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:11.375217 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 259/509] 10.222.0.39 () {56 vars in 1137 bytes} [Mon Jul 18 10:23:11 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:11.376019 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aacb8a-f105-429d-bdea-bae12cbdb5ca None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:11.394315 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c7c33a-c41f-4857-b93a-32fbf651d991 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:11.427375 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b600fcf-d4c3-45c8-aaf0-ab1e880435c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:11.428169 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b600fcf-d4c3-45c8-aaf0-ab1e880435c9 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:11.428456 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b600fcf-d4c3-45c8-aaf0-ab1e880435c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:11.428737 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b600fcf-d4c3-45c8-aaf0-ab1e880435c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:11.439145 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b600fcf-d4c3-45c8-aaf0-ab1e880435c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:11.440599 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b600fcf-d4c3-45c8-aaf0-ab1e880435c9 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:11.457946 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-7b600fcf-d4c3-45c8-aaf0-ab1e880435c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:11.457946 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:11.457946 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:11.457946 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:11.457946 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:11.457946 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:11.457946 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:11.457946 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:11.457946 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:11.457946 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:11.457946 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:11.457946 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:11.457946 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:11.457946 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:11.457946 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:11.458939 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:11.458939 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:11.458939 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:11.458939 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:11.458939 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:11.458939 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:11.458939 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:11.458939 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:11.458939 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:11.458939 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:11.458939 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:11.458939 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:11.458939 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:11.458939 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:11.458939 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:11.458939 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:11.458939 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:11.459942 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:11.459942 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:11.459942 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:11.459942 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:11.459942 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 251/510] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:11.459942 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b600fcf-d4c3-45c8-aaf0-ab1e880435c9 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:11.475915 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aacb8a-f105-429d-bdea-bae12cbdb5ca None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:11.499522 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:11.510656 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce71ec45-f22a-4181-899f-0614eb551dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:11.512664 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:11.512914 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71ec45-f22a-4181-899f-0614eb551dcf None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:11.512914 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71ec45-f22a-4181-899f-0614eb551dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:11.512914 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71ec45-f22a-4181-899f-0614eb551dcf None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:11.512914 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce71ec45-f22a-4181-899f-0614eb551dcf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:11.513240 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce71ec45-f22a-4181-899f-0614eb551dcf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:11.514397 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce71ec45-f22a-4181-899f-0614eb551dcf None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:11.525324 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 260/511] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:11.526127 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce71ec45-f22a-4181-899f-0614eb551dcf None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:11.560636 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b600fcf-d4c3-45c8-aaf0-ab1e880435c9 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:11.594223 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace1dac0-b2de-40b1-b318-bd6888cf0157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:11.594884 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1dac0-b2de-40b1-b318-bd6888cf0157 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:11.595175 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1dac0-b2de-40b1-b318-bd6888cf0157 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:11.595451 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1dac0-b2de-40b1-b318-bd6888cf0157 None admin] PATH_INFO: `/v3/domains` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:11.596169 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace1dac0-b2de-40b1-b318-bd6888cf0157 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:11.596477 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace1dac0-b2de-40b1-b318-bd6888cf0157 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:11.597975 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace1dac0-b2de-40b1-b318-bd6888cf0157 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:11.609986 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 252/512] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:11.610791 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace1dac0-b2de-40b1-b318-bd6888cf0157 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:11.631733 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce71ec45-f22a-4181-899f-0614eb551dcf None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:11.664918 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2d48d-d758-43a2-a812-38d574c5cbd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:11.665743 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2d48d-d758-43a2-a812-38d574c5cbd8 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:11.666026 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2d48d-d758-43a2-a812-38d574c5cbd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:11.666299 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2d48d-d758-43a2-a812-38d574c5cbd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:11.677510 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc2d48d-d758-43a2-a812-38d574c5cbd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:11.678939 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc2d48d-d758-43a2-a812-38d574c5cbd8 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:11.696949 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-4cc2d48d-d758-43a2-a812-38d574c5cbd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:11.696949 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:11.696949 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:11.696949 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:11.696949 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:11.696949 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:11.696949 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:11.696949 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:11.696949 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:11.696949 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:11.696949 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:11.696949 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:11.696949 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:11.696949 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:11.696949 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:11.697951 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:11.697951 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:11.697951 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:11.697951 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:11.697951 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:11.697951 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:11.697951 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:11.697951 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:11.697951 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:11.697951 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:11.697951 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:11.697951 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:11.697951 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:11.697951 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:11.697951 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:11.697951 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:11.697951 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:11.698979 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:11.698979 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:11.698979 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:11.698979 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:11.701350 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 261/513] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:11.702041 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2d48d-d758-43a2-a812-38d574c5cbd8 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:11.710444 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace1dac0-b2de-40b1-b318-bd6888cf0157 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:11.721066 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:11.736900 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:11.744319 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d5f53e-d1b0-4190-80f7-2c0a754d3ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:11.744972 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5f53e-d1b0-4190-80f7-2c0a754d3ee4 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:11.745291 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5f53e-d1b0-4190-80f7-2c0a754d3ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:11.745565 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5f53e-d1b0-4190-80f7-2c0a754d3ee4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:11.802532 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2d48d-d758-43a2-a812-38d574c5cbd8 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:11.813932 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d5f53e-d1b0-4190-80f7-2c0a754d3ee4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:11.815342 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d5f53e-d1b0-4190-80f7-2c0a754d3ee4 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:11.836373 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff6cd4d-4bd3-4875-ab0d-f8156cd97025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:11.837034 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6cd4d-4bd3-4875-ab0d-f8156cd97025 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:11.837337 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6cd4d-4bd3-4875-ab0d-f8156cd97025 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:11.837611 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6cd4d-4bd3-4875-ab0d-f8156cd97025 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:11.838321 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff6cd4d-4bd3-4875-ab0d-f8156cd97025 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:11.838625 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff6cd4d-4bd3-4875-ab0d-f8156cd97025 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:11.839961 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff6cd4d-4bd3-4875-ab0d-f8156cd97025 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:11.857751 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 262/514] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:11.857751 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff6cd4d-4bd3-4875-ab0d-f8156cd97025 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:11.912486 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 253/515] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 10:23:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:23:11.913180 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d5f53e-d1b0-4190-80f7-2c0a754d3ee4 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:11.926104 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:11.954940 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:11.961442 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff6cd4d-4bd3-4875-ab0d-f8156cd97025 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:11.995204 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f12413f-cb17-454f-b183-e071ad1302bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:11.995996 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f12413f-cb17-454f-b183-e071ad1302bd None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:11.996279 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f12413f-cb17-454f-b183-e071ad1302bd None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:11.996555 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f12413f-cb17-454f-b183-e071ad1302bd None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:12.066790 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f12413f-cb17-454f-b183-e071ad1302bd None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:12.068165 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f12413f-cb17-454f-b183-e071ad1302bd None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:12.083367 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-8f12413f-cb17-454f-b183-e071ad1302bd None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 18 10:23:12.083367 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:12.083367 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:12.083367 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:12.083367 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:12.083367 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:12.083367 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:12.083367 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:12.083367 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:12.083367 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:12.083367 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:12.083367 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:12.083367 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:23:12.083367 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:23:12.083367 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:23:12.083367 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:23:12.084438 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:12.084438 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:12.084438 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:23:12.084438 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:23:12.084438 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:23:12.084438 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:23:12.084438 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:12.084438 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:12.084438 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:12.084438 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:12.084438 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:12.084438 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:12.084438 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:12.084438 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:12.084438 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:12.084438 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:12.084438 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:12.084438 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:12.085386 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:12.085386 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:12.085386 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:23:12.085386 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:23:12.085386 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:23:12.085386 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:23:12.085386 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:23:12.085386 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:23:12.085386 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 18 10:23:12.085386 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:12.085386 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 263/516] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jul 18 10:23:11 2022] GET /identity/v3/users/neutron => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:12.085386 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f12413f-cb17-454f-b183-e071ad1302bd None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:12.097174 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d5f53e-d1b0-4190-80f7-2c0a754d3ee4 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:12.136550 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb18700-28a5-4d92-9a6c-466ca4c67d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:12.137369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb18700-28a5-4d92-9a6c-466ca4c67d7e None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:12.137652 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb18700-28a5-4d92-9a6c-466ca4c67d7e None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:12.137924 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb18700-28a5-4d92-9a6c-466ca4c67d7e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:12.146004 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb18700-28a5-4d92-9a6c-466ca4c67d7e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:12.147507 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb18700-28a5-4d92-9a6c-466ca4c67d7e None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:12.162537 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-0eb18700-28a5-4d92-9a6c-466ca4c67d7e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:23:12.162537 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:12.162537 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:12.162537 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:12.162537 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:12.162537 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:12.162537 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:12.162537 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:12.162537 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:12.162537 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:12.162537 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:12.162537 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:12.162537 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:23:12.162537 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:23:12.162537 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:23:12.163492 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:23:12.163492 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:12.163492 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:12.163492 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:12.163492 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:12.163492 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:12.163492 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:12.163492 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:12.163492 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:12.163492 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:12.163492 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:12.163492 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:12.163492 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:12.163492 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:12.163492 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:12.163492 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:12.163492 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:12.164337 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:23:12.164337 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:23:12.164337 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:23:12.164337 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:23:12.164337 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:23:12.164337 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:23:12.164337 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:23:12.164337 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:12.164337 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 254/517] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 10:23:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:12.164784 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb18700-28a5-4d92-9a6c-466ca4c67d7e None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:12.189767 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f12413f-cb17-454f-b183-e071ad1302bd None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:12.223097 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e6c479-af12-4cda-b63b-485d7867dcc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:12.223758 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6c479-af12-4cda-b63b-485d7867dcc2 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:12.224040 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6c479-af12-4cda-b63b-485d7867dcc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:12.224317 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6c479-af12-4cda-b63b-485d7867dcc2 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:12.225031 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e6c479-af12-4cda-b63b-485d7867dcc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:12.225367 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e6c479-af12-4cda-b63b-485d7867dcc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:12.226733 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e6c479-af12-4cda-b63b-485d7867dcc2 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:12.234274 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:12.239501 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 264/518] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:12.240293 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e6c479-af12-4cda-b63b-485d7867dcc2 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:12.256123 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:12.267305 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb18700-28a5-4d92-9a6c-466ca4c67d7e None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:12.300748 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb151357-bc64-46ee-b75c-2d1cf4b4e204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:12.301571 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb151357-bc64-46ee-b75c-2d1cf4b4e204 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:12.301852 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb151357-bc64-46ee-b75c-2d1cf4b4e204 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:12.302124 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb151357-bc64-46ee-b75c-2d1cf4b4e204 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:12.309744 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb151357-bc64-46ee-b75c-2d1cf4b4e204 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:12.311218 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb151357-bc64-46ee-b75c-2d1cf4b4e204 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:12.325731 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-fb151357-bc64-46ee-b75c-2d1cf4b4e204 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 10:23:12.325731 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:12.325731 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:12.325731 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:12.325731 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:12.325731 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:12.325731 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:12.325731 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:12.325731 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:12.325731 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:12.325731 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:12.325731 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:12.325731 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:23:12.325731 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:23:12.325731 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:23:12.325731 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:23:12.326744 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:12.326744 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:12.326744 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:23:12.326744 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:23:12.326744 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:23:12.326744 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:23:12.326744 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:12.326744 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:12.326744 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:12.326744 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:12.326744 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:12.326744 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:12.326744 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:12.326744 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:12.326744 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:12.326744 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:12.326744 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:12.326744 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:12.328722 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:12.328722 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:12.328722 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:23:12.328722 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:23:12.328722 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:23:12.328722 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:23:12.328722 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:23:12.328722 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:23:12.328722 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 10:23:12.328722 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:12.328722 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 255/519] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 10:23:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:12.329476 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb151357-bc64-46ee-b75c-2d1cf4b4e204 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:12.341218 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e6c479-af12-4cda-b63b-485d7867dcc2 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:12.374721 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db9ff7-3c25-44e0-b2be-4b581bd5a5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:12.375509 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db9ff7-3c25-44e0-b2be-4b581bd5a5f5 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:12.375793 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db9ff7-3c25-44e0-b2be-4b581bd5a5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:12.376064 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db9ff7-3c25-44e0-b2be-4b581bd5a5f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:12.385972 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9db9ff7-3c25-44e0-b2be-4b581bd5a5f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:12.387396 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9db9ff7-3c25-44e0-b2be-4b581bd5a5f5 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:12.404960 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-f9db9ff7-3c25-44e0-b2be-4b581bd5a5f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:12.404960 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:12.404960 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:12.404960 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:12.404960 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:12.404960 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:12.404960 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:12.404960 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:12.404960 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:12.404960 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:12.404960 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:12.404960 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:12.404960 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:12.404960 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:12.404960 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:12.406047 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:12.406047 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:12.406047 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:12.406047 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:12.406047 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:12.406047 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:12.406047 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:12.406047 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:12.406047 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:12.406047 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:12.406047 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:12.406047 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:12.406047 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:12.406047 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:12.406047 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:12.406047 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:12.406047 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:12.407029 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:12.407029 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:12.407029 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:12.407029 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:12.407029 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 265/520] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:12.407029 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db9ff7-3c25-44e0-b2be-4b581bd5a5f5 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:12.427969 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb151357-bc64-46ee-b75c-2d1cf4b4e204 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:12.456531 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:12.461947 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ddaef-104d-46c5-9e54-e00684236164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:12.462613 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ddaef-104d-46c5-9e54-e00684236164 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:12.462900 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ddaef-104d-46c5-9e54-e00684236164 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:12.463181 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ddaef-104d-46c5-9e54-e00684236164 None admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:12.464071 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25ddaef-104d-46c5-9e54-e00684236164 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:12.464383 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25ddaef-104d-46c5-9e54-e00684236164 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:12.465857 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25ddaef-104d-46c5-9e54-e00684236164 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:12.476264 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:12.503463 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 256/521] 10.222.0.39 () {56 vars in 1139 bytes} [Mon Jul 18 10:23:12 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:12.504366 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ddaef-104d-46c5-9e54-e00684236164 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:12.510689 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db9ff7-3c25-44e0-b2be-4b581bd5a5f5 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:12.544447 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5caf11-fdac-4147-9563-d7ac3a0a6e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:12.545138 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5caf11-fdac-4147-9563-d7ac3a0a6e44 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:12.545428 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5caf11-fdac-4147-9563-d7ac3a0a6e44 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:12.545709 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5caf11-fdac-4147-9563-d7ac3a0a6e44 None admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:12.547063 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5caf11-fdac-4147-9563-d7ac3a0a6e44 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:12.547375 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5caf11-fdac-4147-9563-d7ac3a0a6e44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:12.548790 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5caf11-fdac-4147-9563-d7ac3a0a6e44 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:12.566730 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 266/522] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 10:23:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:12.567523 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5caf11-fdac-4147-9563-d7ac3a0a6e44 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:12.605489 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ddaef-104d-46c5-9e54-e00684236164 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:12.639745 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e1e8cd-4478-4590-b5ab-ebfd965246a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:12.640422 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1e8cd-4478-4590-b5ab-ebfd965246a0 None admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:12.640710 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1e8cd-4478-4590-b5ab-ebfd965246a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:12.640994 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1e8cd-4478-4590-b5ab-ebfd965246a0 None admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:12.641742 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e1e8cd-4478-4590-b5ab-ebfd965246a0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:12.643199 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e1e8cd-4478-4590-b5ab-ebfd965246a0 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:12.666142 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5caf11-fdac-4147-9563-d7ac3a0a6e44 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:12.691876 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:12.700316 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39509347-1dba-4e62-b33b-86e723361b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:12.700992 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39509347-1dba-4e62-b33b-86e723361b19 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:12.701310 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39509347-1dba-4e62-b33b-86e723361b19 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:12.701589 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39509347-1dba-4e62-b33b-86e723361b19 None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:12.702576 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39509347-1dba-4e62-b33b-86e723361b19 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:12.702893 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39509347-1dba-4e62-b33b-86e723361b19 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:12.704316 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39509347-1dba-4e62-b33b-86e723361b19 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:12.714934 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 257/523] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Jul 18 10:23:12 2022] POST /identity/v3/users => generated 247 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:23:12.715832 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e1e8cd-4478-4590-b5ab-ebfd965246a0 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:12.721787 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 267/524] 10.222.0.39 () {56 vars in 1137 bytes} [Mon Jul 18 10:23:12 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:12.722666 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39509347-1dba-4e62-b33b-86e723361b19 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:12.779657 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:12.839447 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39509347-1dba-4e62-b33b-86e723361b19 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:12.842540 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e1e8cd-4478-4590-b5ab-ebfd965246a0 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:12.880904 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783f2ca1-70cd-4896-a495-8b8c8daa3634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:12.881534 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f2ca1-70cd-4896-a495-8b8c8daa3634 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:12.881821 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f2ca1-70cd-4896-a495-8b8c8daa3634 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:12.881919 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e67435d-b1b8-429b-b6cb-75125695d4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:12.882716 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f2ca1-70cd-4896-a495-8b8c8daa3634 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:12.882819 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67435d-b1b8-429b-b6cb-75125695d4c4 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:12.882902 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67435d-b1b8-429b-b6cb-75125695d4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:12.883118 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67435d-b1b8-429b-b6cb-75125695d4c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:12.883840 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e67435d-b1b8-429b-b6cb-75125695d4c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:12.884148 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e67435d-b1b8-429b-b6cb-75125695d4c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:12.885571 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e67435d-b1b8-429b-b6cb-75125695d4c4 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:12.899547 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 258/525] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:12.900299 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e67435d-b1b8-429b-b6cb-75125695d4c4 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:12.948975 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:12.965410 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783f2ca1-70cd-4896-a495-8b8c8daa3634 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:12.966893 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783f2ca1-70cd-4896-a495-8b8c8daa3634 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:13.024228 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e67435d-b1b8-429b-b6cb-75125695d4c4 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:13.028251 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:13.065707 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a669b627-0b42-4357-b9de-88f77755b4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:13.066377 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669b627-0b42-4357-b9de-88f77755b4c0 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:13.066661 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669b627-0b42-4357-b9de-88f77755b4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:13.066940 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669b627-0b42-4357-b9de-88f77755b4c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:13.067879 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a669b627-0b42-4357-b9de-88f77755b4c0 None admin] RBAC: Adding query filter params (role.id=d151ec157a524341b7194453e46b6b25, scope.project.id=a6098fe56d304980aa14bd95b4b92c17, user.id=8bbebf16219943879df84bdc9a900516) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:13.068195 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a669b627-0b42-4357-b9de-88f77755b4c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:13.069673 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a669b627-0b42-4357-b9de-88f77755b4c0 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:13.085087 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 268/526] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 10:23:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:23:13.085292 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 259/527] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 10:23:12 2022] GET /identity/v3/role_assignments?user.id=8bbebf16219943879df84bdc9a900516&scope.project.id=a6098fe56d304980aa14bd95b4b92c17&role.id=d151ec157a524341b7194453e46b6b25 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:13.085385 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783f2ca1-70cd-4896-a495-8b8c8daa3634 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:13.085494 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a669b627-0b42-4357-b9de-88f77755b4c0 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:13.177903 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:13.195449 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783f2ca1-70cd-4896-a495-8b8c8daa3634 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:13.232069 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a669b627-0b42-4357-b9de-88f77755b4c0 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:13.244530 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c584aea-d869-451f-942e-0f10e356a55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:13.245657 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c584aea-d869-451f-942e-0f10e356a55f None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:13.246234 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c584aea-d869-451f-942e-0f10e356a55f None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:13.246513 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c584aea-d869-451f-942e-0f10e356a55f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:13.272601 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c0811b-06cf-4f53-8c4d-7bcb709bbc79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:13.273432 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0811b-06cf-4f53-8c4d-7bcb709bbc79 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:13.273710 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0811b-06cf-4f53-8c4d-7bcb709bbc79 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:13.273982 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c0811b-06cf-4f53-8c4d-7bcb709bbc79 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:13.290508 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c0811b-06cf-4f53-8c4d-7bcb709bbc79 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:13.292293 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c0811b-06cf-4f53-8c4d-7bcb709bbc79 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:13.309881 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-94c0811b-06cf-4f53-8c4d-7bcb709bbc79 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:23:13.309881 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:13.309881 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:13.309881 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:13.309881 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:13.309881 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:13.309881 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:13.309881 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:13.309881 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:13.309881 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:13.309881 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:13.309881 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:13.309881 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:23:13.309881 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:23:13.309881 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:23:13.310779 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:23:13.310779 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:13.310779 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:13.310779 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:13.310779 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:13.310779 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:13.310779 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:13.310779 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:13.310779 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:13.310779 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:13.310779 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:13.310779 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:13.310779 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:13.310779 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:13.310779 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:13.310779 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:13.310779 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:13.311711 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:23:13.311711 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:23:13.311711 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:23:13.311711 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:23:13.311711 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:23:13.311711 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:23:13.311711 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:23:13.311711 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:13.311711 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 260/528] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 10:23:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:13.312961 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c0811b-06cf-4f53-8c4d-7bcb709bbc79 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:13.332165 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c584aea-d869-451f-942e-0f10e356a55f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:13.334098 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c584aea-d869-451f-942e-0f10e356a55f None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:13.350580 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:13.437978 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c0811b-06cf-4f53-8c4d-7bcb709bbc79 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:13.443819 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:13.465862 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 269/529] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 10:23:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:23:13.466635 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c584aea-d869-451f-942e-0f10e356a55f None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:13.483383 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae2657-ec0c-4b2d-a166-45c34b906989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:13.484479 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae2657-ec0c-4b2d-a166-45c34b906989 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:13.484756 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae2657-ec0c-4b2d-a166-45c34b906989 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:13.485028 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae2657-ec0c-4b2d-a166-45c34b906989 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:13.498673 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbae2657-ec0c-4b2d-a166-45c34b906989 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:13.500341 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbae2657-ec0c-4b2d-a166-45c34b906989 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:13.520158 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-dbae2657-ec0c-4b2d-a166-45c34b906989 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:13.520158 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:13.520158 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:13.520158 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:13.520158 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:13.520158 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:13.520158 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:13.520158 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:13.520158 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:13.520158 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:13.520158 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:13.520158 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:13.520158 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:13.520158 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:13.520158 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:13.521748 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:13.521748 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:13.521748 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:13.521748 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:13.521748 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:13.521748 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:13.521748 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:13.521748 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:13.521748 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:13.521748 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:13.521748 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:13.521748 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:13.521748 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:13.521748 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:13.521748 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:13.521748 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:13.521748 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:13.523134 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:13.523134 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:13.523134 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:13.523134 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:13.523134 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 261/530] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:13.523134 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae2657-ec0c-4b2d-a166-45c34b906989 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:13.598755 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c584aea-d869-451f-942e-0f10e356a55f None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:13.619311 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:13.639958 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae2657-ec0c-4b2d-a166-45c34b906989 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:13.646257 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7924d7b-4fd9-4ee3-ad15-5587005449ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:13.647206 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7924d7b-4fd9-4ee3-ad15-5587005449ef None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:13.647692 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7924d7b-4fd9-4ee3-ad15-5587005449ef None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:13.648186 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7924d7b-4fd9-4ee3-ad15-5587005449ef None admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:13.649740 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7924d7b-4fd9-4ee3-ad15-5587005449ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:13.650278 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7924d7b-4fd9-4ee3-ad15-5587005449ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:13.652830 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7924d7b-4fd9-4ee3-ad15-5587005449ef None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:13.670338 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 270/531] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 10:23:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:13.672320 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7924d7b-4fd9-4ee3-ad15-5587005449ef None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:13.679380 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74457a-1b64-4bfa-b908-8ac67c325bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:13.680265 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74457a-1b64-4bfa-b908-8ac67c325bba None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:13.680622 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74457a-1b64-4bfa-b908-8ac67c325bba None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:13.680989 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74457a-1b64-4bfa-b908-8ac67c325bba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:13.694272 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d74457a-1b64-4bfa-b908-8ac67c325bba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:13.696100 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d74457a-1b64-4bfa-b908-8ac67c325bba None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:13.716442 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-0d74457a-1b64-4bfa-b908-8ac67c325bba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:13.716442 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:13.716442 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:13.716442 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:13.716442 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:13.716442 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:13.716442 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:13.716442 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:13.716442 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:13.716442 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:13.716442 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:13.716442 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:13.716442 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:13.716442 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:13.716442 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:13.718482 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:13.718482 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:13.718482 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:13.718482 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:13.718482 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:13.718482 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:13.718482 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:13.718482 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:13.718482 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:13.718482 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:13.718482 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:13.718482 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:13.718482 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:13.718482 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:13.718482 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:13.718482 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:13.718482 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:13.719415 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:13.719415 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:13.719415 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:13.719415 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:13.719415 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 262/532] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:13.720389 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74457a-1b64-4bfa-b908-8ac67c325bba None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:13.737682 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:13.814058 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7924d7b-4fd9-4ee3-ad15-5587005449ef None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:13.837633 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74457a-1b64-4bfa-b908-8ac67c325bba None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:13.860467 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86378dfc-a0e4-4509-8ebd-3a02bf75a0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:13.861819 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86378dfc-a0e4-4509-8ebd-3a02bf75a0c2 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:13.865218 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86378dfc-a0e4-4509-8ebd-3a02bf75a0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:13.865737 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86378dfc-a0e4-4509-8ebd-3a02bf75a0c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:13.867271 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86378dfc-a0e4-4509-8ebd-3a02bf75a0c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:13.868066 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86378dfc-a0e4-4509-8ebd-3a02bf75a0c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:13.870356 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86378dfc-a0e4-4509-8ebd-3a02bf75a0c2 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:13.877778 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:13.883551 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa665b0-6eea-4ab0-8c4f-cdedcdcea818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:13.884385 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa665b0-6eea-4ab0-8c4f-cdedcdcea818 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:13.884733 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa665b0-6eea-4ab0-8c4f-cdedcdcea818 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:13.885102 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa665b0-6eea-4ab0-8c4f-cdedcdcea818 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:13.886070 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa665b0-6eea-4ab0-8c4f-cdedcdcea818 None admin] RBAC: Adding query filter params (role.id=d151ec157a524341b7194453e46b6b25, scope.project.id=a6098fe56d304980aa14bd95b4b92c17, user.id=48d1f7d0286745a396905aee50c9410b) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:13.886398 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa665b0-6eea-4ab0-8c4f-cdedcdcea818 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:13.888077 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa665b0-6eea-4ab0-8c4f-cdedcdcea818 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:13.893356 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 271/533] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:13.894485 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86378dfc-a0e4-4509-8ebd-3a02bf75a0c2 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:13.905711 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 263/534] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 10:23:13 2022] GET /identity/v3/role_assignments?user.id=48d1f7d0286745a396905aee50c9410b&scope.project.id=a6098fe56d304980aa14bd95b4b92c17&role.id=d151ec157a524341b7194453e46b6b25 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:13.907556 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa665b0-6eea-4ab0-8c4f-cdedcdcea818 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:14.045214 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86378dfc-a0e4-4509-8ebd-3a02bf75a0c2 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:14.060149 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:14.087226 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa665b0-6eea-4ab0-8c4f-cdedcdcea818 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:14.120667 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd53f47-d204-46b2-97a1-9bbd8a28e6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:14.121611 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd53f47-d204-46b2-97a1-9bbd8a28e6cb None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:14.121989 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd53f47-d204-46b2-97a1-9bbd8a28e6cb None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:14.122365 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd53f47-d204-46b2-97a1-9bbd8a28e6cb None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:14.123188 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd53f47-d204-46b2-97a1-9bbd8a28e6cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:14.123593 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd53f47-d204-46b2-97a1-9bbd8a28e6cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:14.128667 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd53f47-d204-46b2-97a1-9bbd8a28e6cb None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:14.134819 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8922f3-9761-49bf-a18c-a0ea1c577367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:14.135817 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8922f3-9761-49bf-a18c-a0ea1c577367 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:14.136272 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8922f3-9761-49bf-a18c-a0ea1c577367 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:14.136709 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8922f3-9761-49bf-a18c-a0ea1c577367 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:14.143916 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 272/535] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:14.145788 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8922f3-9761-49bf-a18c-a0ea1c577367 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:14.147255 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8922f3-9761-49bf-a18c-a0ea1c577367 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:14.148793 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd53f47-d204-46b2-97a1-9bbd8a28e6cb None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:14.167513 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-fa8922f3-9761-49bf-a18c-a0ea1c577367 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:23:14.167513 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:14.167513 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:14.167513 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:14.167513 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:14.167513 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:14.167513 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:14.167513 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:14.167513 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:14.167513 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:14.167513 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:14.167513 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:14.167513 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:23:14.167513 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:23:14.167513 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:23:14.168507 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:23:14.168507 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:14.168507 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:14.168507 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:14.168507 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:14.168507 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:14.168507 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:14.168507 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:14.168507 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:14.168507 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:14.168507 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:14.168507 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:14.168507 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:14.168507 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:14.168507 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:14.168507 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:14.168507 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:14.169403 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:23:14.169403 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:23:14.169403 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:23:14.169403 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:23:14.169403 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:23:14.169403 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:23:14.169403 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:23:14.169403 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:14.173249 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 264/536] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 10:23:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:14.178901 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8922f3-9761-49bf-a18c-a0ea1c577367 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:14.279962 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:14.343517 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd53f47-d204-46b2-97a1-9bbd8a28e6cb None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:14.366738 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8922f3-9761-49bf-a18c-a0ea1c577367 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:14.407148 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c29bca7-8385-418e-bd48-e9d43b628acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:14.407952 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29bca7-8385-418e-bd48-e9d43b628acd None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:14.408235 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29bca7-8385-418e-bd48-e9d43b628acd None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:14.408510 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29bca7-8385-418e-bd48-e9d43b628acd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:14.419345 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c29bca7-8385-418e-bd48-e9d43b628acd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:14.420823 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c29bca7-8385-418e-bd48-e9d43b628acd None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:14.434220 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e089bfe-1e20-4c8f-aa0e-cc8d74d6552f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:14.434901 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e089bfe-1e20-4c8f-aa0e-cc8d74d6552f None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:14.435189 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e089bfe-1e20-4c8f-aa0e-cc8d74d6552f None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:14.435462 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e089bfe-1e20-4c8f-aa0e-cc8d74d6552f None admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:14.436256 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e089bfe-1e20-4c8f-aa0e-cc8d74d6552f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:14.437131 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e089bfe-1e20-4c8f-aa0e-cc8d74d6552f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:14.438844 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e089bfe-1e20-4c8f-aa0e-cc8d74d6552f None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:14.459038 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-2c29bca7-8385-418e-bd48-e9d43b628acd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:23:14.459038 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:14.459038 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:14.459038 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:14.459038 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:14.459038 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:14.459038 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:14.459038 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:14.459038 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:14.459038 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:14.459038 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:14.459038 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:14.459038 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:23:14.459038 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:23:14.459038 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:23:14.459943 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:23:14.459943 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:14.459943 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:14.459943 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:14.459943 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:14.459943 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:14.459943 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:14.459943 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:14.459943 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:14.459943 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:14.459943 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:14.459943 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:14.459943 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:14.459943 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:14.459943 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:14.459943 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:14.459943 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:14.460774 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:23:14.460774 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:23:14.460774 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:23:14.460774 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:23:14.460774 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:23:14.460774 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:23:14.460774 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:23:14.460774 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:14.461206 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 273/537] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 10:23:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:14.466048 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c29bca7-8385-418e-bd48-e9d43b628acd None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:14.473901 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 265/538] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 10:23:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:23:14.483031 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e089bfe-1e20-4c8f-aa0e-cc8d74d6552f None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:14.505120 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:14.596051 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c29bca7-8385-418e-bd48-e9d43b628acd None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:14.635793 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8924bf3f-1369-40f0-a6ba-70ea241f49b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:14.636804 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924bf3f-1369-40f0-a6ba-70ea241f49b7 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:14.637408 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924bf3f-1369-40f0-a6ba-70ea241f49b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:14.637885 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8924bf3f-1369-40f0-a6ba-70ea241f49b7 None admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:14.639449 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8924bf3f-1369-40f0-a6ba-70ea241f49b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:14.640616 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8924bf3f-1369-40f0-a6ba-70ea241f49b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:14.642332 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8924bf3f-1369-40f0-a6ba-70ea241f49b7 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:14.656740 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 274/539] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 10:23:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:14.663420 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8924bf3f-1369-40f0-a6ba-70ea241f49b7 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:14.720238 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e089bfe-1e20-4c8f-aa0e-cc8d74d6552f None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:14.760869 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:14.762397 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:14.785705 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8924bf3f-1369-40f0-a6ba-70ea241f49b7 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:14.806173 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f61ea7-f13e-4488-9fcf-d790cc386deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:14.807194 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f61ea7-f13e-4488-9fcf-d790cc386deb None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:14.807635 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f61ea7-f13e-4488-9fcf-d790cc386deb None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:14.808063 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f61ea7-f13e-4488-9fcf-d790cc386deb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:14.809078 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f61ea7-f13e-4488-9fcf-d790cc386deb None admin] RBAC: Adding query filter params (role.id=d151ec157a524341b7194453e46b6b25, scope.project.id=a6098fe56d304980aa14bd95b4b92c17, user.id=2f88e3a2b95e477bae1cc98e9e18dc24) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:14.812301 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f61ea7-f13e-4488-9fcf-d790cc386deb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:14.812301 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f61ea7-f13e-4488-9fcf-d790cc386deb None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:14.825759 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 266/540] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 10:23:14 2022] GET /identity/v3/role_assignments?user.id=2f88e3a2b95e477bae1cc98e9e18dc24&scope.project.id=a6098fe56d304980aa14bd95b4b92c17&role.id=d151ec157a524341b7194453e46b6b25 => generated 259 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:14.845666 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f04afaa-f142-43cd-b22d-435209a83034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:14.846764 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04afaa-f142-43cd-b22d-435209a83034 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:14.847273 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04afaa-f142-43cd-b22d-435209a83034 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:14.847744 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f04afaa-f142-43cd-b22d-435209a83034 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:14.848819 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f04afaa-f142-43cd-b22d-435209a83034 None admin] RBAC: Adding query filter params (role.id=d151ec157a524341b7194453e46b6b25, scope.project.id=a6098fe56d304980aa14bd95b4b92c17, user.id=7cc4f041a5b242138a92a54633dcece6) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:14.849363 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f04afaa-f142-43cd-b22d-435209a83034 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:14.851014 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f04afaa-f142-43cd-b22d-435209a83034 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:14.858230 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 275/541] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 10:23:14 2022] GET /identity/v3/role_assignments?user.id=7cc4f041a5b242138a92a54633dcece6&scope.project.id=a6098fe56d304980aa14bd95b4b92c17&role.id=d151ec157a524341b7194453e46b6b25 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:14.969009 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c0954-0cba-43a4-8972-ed86ae009447 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:14.969389 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c0954-0cba-43a4-8972-ed86ae009447 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:14.969591 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c0954-0cba-43a4-8972-ed86ae009447 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:14.971073 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 267/542] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:23:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:23:14.977361 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32089b89-33ad-4178-8724-cbcb9602d130 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:14.977889 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32089b89-33ad-4178-8724-cbcb9602d130 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:14.977889 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32089b89-33ad-4178-8724-cbcb9602d130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:15.002147 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-32089b89-33ad-4178-8724-cbcb9602d130 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:23:15.003388 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-32089b89-33ad-4178-8724-cbcb9602d130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:23:15.082126 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 276/543] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:23:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:23:15.118953 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c0954-0cba-43a4-8972-ed86ae009447 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:15.265530 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c0954-0cba-43a4-8972-ed86ae009447 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:15.315324 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e3d454-4465-4ecc-92c0-66c1d4769efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:15.316207 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3d454-4465-4ecc-92c0-66c1d4769efd None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:15.316492 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3d454-4465-4ecc-92c0-66c1d4769efd None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:15.316819 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3d454-4465-4ecc-92c0-66c1d4769efd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:15.330325 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e3d454-4465-4ecc-92c0-66c1d4769efd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:23:15.338359 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-61e3d454-4465-4ecc-92c0-66c1d4769efd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:23:15.338359 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:15.338359 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:15.338359 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:15.338359 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:15.338359 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:15.338359 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:15.338359 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:15.338359 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:15.338359 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:15.338359 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:15.338359 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:15.338359 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:23:15.338359 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:23:15.338359 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:23:15.338359 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:23:15.339238 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:23:15.339238 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:23:15.339238 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:23:15.339238 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:23:15.339238 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:15.339238 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:15.339238 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:15.339238 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:15.339238 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:15.339238 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:15.339238 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:15.339238 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:15.339238 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:15.339238 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:15.339238 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:15.339238 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:15.340045 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:15.340045 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:15.340045 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:15.340045 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:15.340045 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:23:15.340045 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:23:15.340045 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:23:15.340045 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:23:15.340045 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:23:15.340045 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:23:15.340045 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:23:15.340045 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:15.340045 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 268/544] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jul 18 10:23:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:15.347194 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32089b89-33ad-4178-8724-cbcb9602d130 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:15.397622 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0db334-535c-43cb-a78d-096da18e385a None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:15.397829 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0db334-535c-43cb-a78d-096da18e385a None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:15.398116 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0db334-535c-43cb-a78d-096da18e385a None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:15.399696 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 269/545] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:23:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:23:15.408441 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31de8dc-09dc-4d57-bed9-ab74322128fa None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:15.408729 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31de8dc-09dc-4d57-bed9-ab74322128fa None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:15.409009 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31de8dc-09dc-4d57-bed9-ab74322128fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:15.443261 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-b31de8dc-09dc-4d57-bed9-ab74322128fa None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:23:15.444781 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-b31de8dc-09dc-4d57-bed9-ab74322128fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:23:15.505446 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:15.508338 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:15.518839 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32089b89-33ad-4178-8724-cbcb9602d130 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:15.543391 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 270/546] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:23:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:23:15.568257 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31de8dc-09dc-4d57-bed9-ab74322128fa None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:15.568597 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e80a42-c3a3-4fb0-8ea4-bfd96914c276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:15.569317 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e80a42-c3a3-4fb0-8ea4-bfd96914c276 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:15.569603 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e80a42-c3a3-4fb0-8ea4-bfd96914c276 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:15.569882 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e80a42-c3a3-4fb0-8ea4-bfd96914c276 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:15.570775 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e80a42-c3a3-4fb0-8ea4-bfd96914c276 None admin] RBAC: Adding query filter params (name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:15.570978 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e80a42-c3a3-4fb0-8ea4-bfd96914c276 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:15.572444 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e80a42-c3a3-4fb0-8ea4-bfd96914c276 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:15.591453 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 277/547] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Jul 18 10:23:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:15.598251 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e80a42-c3a3-4fb0-8ea4-bfd96914c276 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:15.677226 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31de8dc-09dc-4d57-bed9-ab74322128fa None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:15.747389 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b215b49-014d-4bd3-ae0e-0c3763493af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:15.749765 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b215b49-014d-4bd3-ae0e-0c3763493af7 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:15.750453 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b215b49-014d-4bd3-ae0e-0c3763493af7 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:15.750937 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b215b49-014d-4bd3-ae0e-0c3763493af7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:15.761119 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e80a42-c3a3-4fb0-8ea4-bfd96914c276 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:15.789831 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b215b49-014d-4bd3-ae0e-0c3763493af7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:23:15.791004 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def8988-7e12-4680-bcb3-213355497133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:15.791856 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def8988-7e12-4680-bcb3-213355497133 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:15.792141 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def8988-7e12-4680-bcb3-213355497133 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:15.792458 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def8988-7e12-4680-bcb3-213355497133 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:15.798870 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-4b215b49-014d-4bd3-ae0e-0c3763493af7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:23:15.798870 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:15.798870 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:15.798870 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:15.798870 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:15.798870 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:15.798870 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:15.798870 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:15.798870 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:15.798870 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:15.798870 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:15.798870 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:15.798870 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:23:15.798870 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:23:15.798870 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:23:15.798870 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:23:15.799739 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:23:15.799739 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:23:15.799739 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:23:15.799739 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:23:15.799739 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:15.799739 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:15.799739 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:15.799739 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:15.799739 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:15.799739 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:15.799739 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:15.799739 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:15.799739 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:15.799739 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:15.799739 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:15.799739 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:15.800547 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:15.800547 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:15.800547 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:15.800547 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:15.800547 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:23:15.800547 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:23:15.800547 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:23:15.800547 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:23:15.800547 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:23:15.800547 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:23:15.800547 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:23:15.800547 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:15.802308 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 271/548] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jul 18 10:23:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:15.802837 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:15.805610 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8def8988-7e12-4680-bcb3-213355497133 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:15.807169 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8def8988-7e12-4680-bcb3-213355497133 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:15.815636 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b215b49-014d-4bd3-ae0e-0c3763493af7 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:15.849592 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-8def8988-7e12-4680-bcb3-213355497133 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:15.849592 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:15.849592 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:15.849592 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:15.849592 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:15.849592 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:15.849592 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:15.849592 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:15.849592 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:15.849592 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:15.849592 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:15.849592 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:15.849592 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:15.849592 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:15.849592 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:15.850527 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:15.850527 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:15.850527 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:15.850527 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:15.850527 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:15.850527 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:15.850527 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:15.850527 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:15.850527 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:15.850527 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:15.850527 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:15.850527 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:15.850527 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:15.850527 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:15.850527 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:15.850527 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:15.850527 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:15.851381 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:15.851381 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:15.851381 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:15.851381 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:15.851381 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 278/549] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:23:15.856580 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def8988-7e12-4680-bcb3-213355497133 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:15.865431 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:15.936946 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b215b49-014d-4bd3-ae0e-0c3763493af7 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:15.974736 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d87b6f9-69cf-4b83-b227-239e5a8d0491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:15.975404 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87b6f9-69cf-4b83-b227-239e5a8d0491 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:15.975685 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87b6f9-69cf-4b83-b227-239e5a8d0491 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:15.975975 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87b6f9-69cf-4b83-b227-239e5a8d0491 None admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:15.976815 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d87b6f9-69cf-4b83-b227-239e5a8d0491 None admin] RBAC: Adding query filter params (name=service) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:15.977148 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d87b6f9-69cf-4b83-b227-239e5a8d0491 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:15.978539 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d87b6f9-69cf-4b83-b227-239e5a8d0491 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:15.989387 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 272/550] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Jul 18 10:23:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:23:16.002098 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d87b6f9-69cf-4b83-b227-239e5a8d0491 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:16.059157 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def8988-7e12-4680-bcb3-213355497133 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:16.122333 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6b1bf-e481-4792-8670-9fb303f4520c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:16.123031 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6b1bf-e481-4792-8670-9fb303f4520c None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:16.123318 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6b1bf-e481-4792-8670-9fb303f4520c None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:16.123597 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6b1bf-e481-4792-8670-9fb303f4520c None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:16.124868 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a6b1bf-e481-4792-8670-9fb303f4520c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:16.125211 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a6b1bf-e481-4792-8670-9fb303f4520c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:16.126583 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a6b1bf-e481-4792-8670-9fb303f4520c None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:16.151177 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d87b6f9-69cf-4b83-b227-239e5a8d0491 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:16.156229 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 279/551] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:23:16.161808 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6b1bf-e481-4792-8670-9fb303f4520c None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:16.162518 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:16.187307 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5f668f-8544-44ae-b8c4-d91b19920cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:16.188011 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5f668f-8544-44ae-b8c4-d91b19920cfb None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:16.188293 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5f668f-8544-44ae-b8c4-d91b19920cfb None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:16.188568 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5f668f-8544-44ae-b8c4-d91b19920cfb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:16.199914 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5f668f-8544-44ae-b8c4-d91b19920cfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:16.201482 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5f668f-8544-44ae-b8c4-d91b19920cfb None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:16.219697 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:16.231209 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-5c5f668f-8544-44ae-b8c4-d91b19920cfb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:16.231209 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:16.231209 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:16.231209 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:16.231209 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:16.231209 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:16.231209 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:16.231209 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:16.231209 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:16.231209 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:16.231209 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:16.231209 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:16.231209 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:16.231209 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:16.231209 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:16.232112 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:16.232112 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:16.232112 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:16.232112 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:16.232112 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:16.232112 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:16.232112 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:16.232112 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:16.232112 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:16.232112 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:16.232112 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:16.232112 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:16.232112 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:16.232112 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:16.232112 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:16.232112 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:16.232112 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:16.232991 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:16.232991 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:16.232991 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:16.232991 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:16.232991 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 273/552] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:16.240843 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5f668f-8544-44ae-b8c4-d91b19920cfb None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:16.277517 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6b1bf-e481-4792-8670-9fb303f4520c None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:16.313496 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa95ee75-adba-4b59-8e22-4e9c4413a7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:16.314488 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95ee75-adba-4b59-8e22-4e9c4413a7ea None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:16.314880 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95ee75-adba-4b59-8e22-4e9c4413a7ea None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:16.315265 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95ee75-adba-4b59-8e22-4e9c4413a7ea None admin] PATH_INFO: `/v3/users/swift` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:16.323524 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa95ee75-adba-4b59-8e22-4e9c4413a7ea None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:16.325123 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa95ee75-adba-4b59-8e22-4e9c4413a7ea None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:16.340025 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-fa95ee75-adba-4b59-8e22-4e9c4413a7ea None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 18 10:23:16.340025 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:16.340025 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:16.340025 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:16.340025 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:16.340025 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:16.340025 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:16.340025 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:16.340025 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:16.340025 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:16.340025 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:16.340025 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:16.340025 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:23:16.340025 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:23:16.340025 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:23:16.340025 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:23:16.340998 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:16.340998 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:16.340998 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:23:16.340998 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:23:16.340998 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:23:16.340998 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:23:16.340998 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:16.340998 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:16.340998 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:16.340998 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:16.340998 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:16.340998 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:16.340998 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:16.340998 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:16.340998 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:16.340998 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:16.340998 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:16.340998 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:16.341975 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:16.341975 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:16.341975 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:23:16.341975 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:23:16.341975 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:23:16.341975 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:23:16.341975 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:23:16.341975 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:23:16.341975 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 18 10:23:16.341975 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:16.341975 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 280/553] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 10:23:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:23:16.347285 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa95ee75-adba-4b59-8e22-4e9c4413a7ea None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:16.400408 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5f668f-8544-44ae-b8c4-d91b19920cfb None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:16.434981 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d868836-4b5f-4521-8358-7f83ab660331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:16.435650 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d868836-4b5f-4521-8358-7f83ab660331 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:16.435989 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d868836-4b5f-4521-8358-7f83ab660331 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:16.436301 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d868836-4b5f-4521-8358-7f83ab660331 None admin] PATH_INFO: `/v3/domains` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:16.437920 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d868836-4b5f-4521-8358-7f83ab660331 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:16.438179 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d868836-4b5f-4521-8358-7f83ab660331 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:16.439648 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d868836-4b5f-4521-8358-7f83ab660331 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:16.451972 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 274/554] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:23:16.459964 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d868836-4b5f-4521-8358-7f83ab660331 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:16.485413 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:16.523729 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa95ee75-adba-4b59-8e22-4e9c4413a7ea None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:16.540897 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:16.570693 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d868836-4b5f-4521-8358-7f83ab660331 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:16.571005 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf44b481-1915-4d83-9f57-16edf19f0a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:16.571671 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44b481-1915-4d83-9f57-16edf19f0a30 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:16.571983 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44b481-1915-4d83-9f57-16edf19f0a30 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:16.572335 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf44b481-1915-4d83-9f57-16edf19f0a30 None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:16.573388 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf44b481-1915-4d83-9f57-16edf19f0a30 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:16.573706 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf44b481-1915-4d83-9f57-16edf19f0a30 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:16.575160 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf44b481-1915-4d83-9f57-16edf19f0a30 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:16.599114 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 281/555] 10.222.0.39 () {56 vars in 1135 bytes} [Mon Jul 18 10:23:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:23:16.600806 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96394ab6-aed3-4ebe-aa77-133b8ee39283 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:16.601121 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96394ab6-aed3-4ebe-aa77-133b8ee39283 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:16.601504 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96394ab6-aed3-4ebe-aa77-133b8ee39283 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:16.603066 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 282/556] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:23:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:23:16.603880 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96394ab6-aed3-4ebe-aa77-133b8ee39283 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:16.615437 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba67e0-c65c-407e-a6f7-3097873ebf0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:16.617202 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba67e0-c65c-407e-a6f7-3097873ebf0f None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:16.617702 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba67e0-c65c-407e-a6f7-3097873ebf0f None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:16.618632 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba67e0-c65c-407e-a6f7-3097873ebf0f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:16.629489 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ba67e0-c65c-407e-a6f7-3097873ebf0f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:16.631806 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ba67e0-c65c-407e-a6f7-3097873ebf0f None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:16.652369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-a3ba67e0-c65c-407e-a6f7-3097873ebf0f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 10:23:16.652369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:16.652369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:16.652369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:16.652369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:16.652369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:16.652369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:16.652369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:16.652369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:16.652369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:16.652369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:16.652369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:16.652369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:23:16.652369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:23:16.652369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:23:16.652369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:23:16.653963 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:16.653963 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:16.653963 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:23:16.653963 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:23:16.653963 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:23:16.653963 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:23:16.653963 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:16.653963 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:16.653963 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:16.653963 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:16.653963 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:16.653963 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:16.653963 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:16.653963 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:16.653963 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:16.653963 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:16.653963 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:16.653963 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:16.655917 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:16.655917 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:16.655917 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:23:16.655917 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:23:16.655917 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:23:16.655917 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:23:16.655917 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:23:16.655917 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:23:16.655917 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 10:23:16.655917 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:16.663431 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 275/557] 10.222.0.39 () {56 vars in 1093 bytes} [Mon Jul 18 10:23:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:16.663431 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b5bbec-0aba-41bd-b205-384042133666 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:16.663431 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b5bbec-0aba-41bd-b205-384042133666 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:16.663431 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b5bbec-0aba-41bd-b205-384042133666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:16.681696 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-32b5bbec-0aba-41bd-b205-384042133666 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:23:16.682971 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-32b5bbec-0aba-41bd-b205-384042133666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:23:16.727977 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96394ab6-aed3-4ebe-aa77-133b8ee39283 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:16.744751 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:16.754501 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 276/558] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:23:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:23:16.755328 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b5bbec-0aba-41bd-b205-384042133666 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:16.767951 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1ba06-f055-4a1b-9778-0aa0f24d8913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:16.769035 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1ba06-f055-4a1b-9778-0aa0f24d8913 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:16.769602 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1ba06-f055-4a1b-9778-0aa0f24d8913 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:16.770080 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1ba06-f055-4a1b-9778-0aa0f24d8913 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:16.813859 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:16.849455 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae1ba06-f055-4a1b-9778-0aa0f24d8913 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:16.852096 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae1ba06-f055-4a1b-9778-0aa0f24d8913 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:16.892635 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b5bbec-0aba-41bd-b205-384042133666 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:16.935944 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aebd57-2aa8-4f55-909d-809653dd9e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:16.937264 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aebd57-2aa8-4f55-909d-809653dd9e8a None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:16.937597 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aebd57-2aa8-4f55-909d-809653dd9e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:16.937903 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aebd57-2aa8-4f55-909d-809653dd9e8a None admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:16.938753 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aebd57-2aa8-4f55-909d-809653dd9e8a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:16.939063 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aebd57-2aa8-4f55-909d-809653dd9e8a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:16.940738 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aebd57-2aa8-4f55-909d-809653dd9e8a None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:16.970324 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 277/559] 10.222.0.39 () {56 vars in 1133 bytes} [Mon Jul 18 10:23:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:16.971627 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aebd57-2aa8-4f55-909d-809653dd9e8a None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:16.985144 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 283/560] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 10:23:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:23:16.985144 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1ba06-f055-4a1b-9778-0aa0f24d8913 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:17.082293 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:17.096379 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:17.128859 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1ba06-f055-4a1b-9778-0aa0f24d8913 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:17.141197 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aebd57-2aa8-4f55-909d-809653dd9e8a None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:17.164734 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b9024-c8ca-4c1b-9714-06e9c9ad3cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:17.165240 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b9024-c8ca-4c1b-9714-06e9c9ad3cdd None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:17.165522 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b9024-c8ca-4c1b-9714-06e9c9ad3cdd None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:17.165796 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b9024-c8ca-4c1b-9714-06e9c9ad3cdd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:17.176892 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195b9024-c8ca-4c1b-9714-06e9c9ad3cdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:17.178558 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195b9024-c8ca-4c1b-9714-06e9c9ad3cdd None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:17.182449 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4245e070-f80c-4f94-8975-d73f310e6bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:17.183552 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245e070-f80c-4f94-8975-d73f310e6bc2 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:17.184043 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245e070-f80c-4f94-8975-d73f310e6bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:17.184521 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245e070-f80c-4f94-8975-d73f310e6bc2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:17.197060 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4245e070-f80c-4f94-8975-d73f310e6bc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:23:17.197999 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-195b9024-c8ca-4c1b-9714-06e9c9ad3cdd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:17.197999 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:17.197999 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:17.197999 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:17.197999 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:17.197999 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:17.197999 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:17.197999 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:17.197999 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:17.197999 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:17.197999 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:17.197999 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:17.197999 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:17.197999 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:17.197999 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:17.198859 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:17.198859 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:17.198859 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:17.198859 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:17.198859 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:17.198859 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:17.198859 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:17.198859 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:17.198859 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:17.198859 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:17.198859 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:17.198859 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:17.198859 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:17.198859 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:17.198859 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:17.198859 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:17.198859 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:17.200071 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:17.200071 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:17.200071 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:17.200071 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:17.204079 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 284/561] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:17.204972 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b9024-c8ca-4c1b-9714-06e9c9ad3cdd None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:17.209141 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-4245e070-f80c-4f94-8975-d73f310e6bc2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:23:17.209141 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:17.209141 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:17.209141 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:17.209141 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:17.209141 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:17.209141 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:17.209141 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:17.209141 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:17.209141 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:17.209141 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:17.209141 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:17.209141 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:23:17.209141 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:23:17.209141 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:23:17.209141 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:23:17.210175 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:23:17.210175 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:23:17.210175 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:23:17.210175 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:23:17.210175 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:17.210175 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:17.210175 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:17.210175 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:17.210175 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:17.210175 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:17.210175 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:17.210175 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:17.210175 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:17.210175 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:17.210175 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:17.210175 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:17.211008 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:17.211008 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:17.211008 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:17.211008 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:17.211008 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:23:17.211008 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:23:17.211008 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:23:17.211008 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:23:17.211008 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:23:17.211008 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:23:17.211008 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:23:17.211008 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:17.213113 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 278/562] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jul 18 10:23:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:17.214077 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4245e070-f80c-4f94-8975-d73f310e6bc2 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:17.314530 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b9024-c8ca-4c1b-9714-06e9c9ad3cdd None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:17.320723 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4245e070-f80c-4f94-8975-d73f310e6bc2 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:17.335270 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:17.339950 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:17.352938 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd9229-d22f-4d50-a2e7-de682c459d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:17.353780 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd9229-d22f-4d50-a2e7-de682c459d65 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:17.354066 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd9229-d22f-4d50-a2e7-de682c459d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:17.354342 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd9229-d22f-4d50-a2e7-de682c459d65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:17.357657 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3cf7c2-afe7-4177-aef8-63153a92ae9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:17.358835 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3cf7c2-afe7-4177-aef8-63153a92ae9e None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:17.359171 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3cf7c2-afe7-4177-aef8-63153a92ae9e None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:17.359474 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3cf7c2-afe7-4177-aef8-63153a92ae9e None admin] PATH_INFO: `/v3/domains` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:17.360216 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3cf7c2-afe7-4177-aef8-63153a92ae9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:17.360525 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3cf7c2-afe7-4177-aef8-63153a92ae9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:17.361961 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3cf7c2-afe7-4177-aef8-63153a92ae9e None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:17.365895 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bd9229-d22f-4d50-a2e7-de682c459d65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:17.367344 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bd9229-d22f-4d50-a2e7-de682c459d65 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:17.380469 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 279/563] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:17.387534 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d20eff-ffa2-4d1e-b412-4c3daafbfdcd None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:17.387534 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d20eff-ffa2-4d1e-b412-4c3daafbfdcd None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:17.387534 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d20eff-ffa2-4d1e-b412-4c3daafbfdcd None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:17.387534 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 280/564] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:23:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:23:17.387534 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d20eff-ffa2-4d1e-b412-4c3daafbfdcd None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:17.387862 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-33bd9229-d22f-4d50-a2e7-de682c459d65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:17.387862 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:17.387862 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:17.387862 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:17.387862 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:17.387862 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:17.387862 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:17.387862 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:17.387862 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:17.387862 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:17.387862 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:17.387862 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:17.387862 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:17.387862 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:17.387862 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:17.388633 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:17.388633 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:17.388633 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:17.388633 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:17.388633 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:17.388633 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:17.388633 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:17.388633 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:17.388633 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:17.388633 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:17.388633 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:17.388633 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:17.388633 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:17.388633 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:17.388633 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:17.388633 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:17.388633 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:17.389646 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:17.389646 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:17.389646 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:17.389646 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:17.389646 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 285/565] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:17.390505 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd9229-d22f-4d50-a2e7-de682c459d65 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:17.500419 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d20eff-ffa2-4d1e-b412-4c3daafbfdcd None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:17.501627 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd9229-d22f-4d50-a2e7-de682c459d65 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:17.535067 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f7e92-9ee6-4116-ba8f-249023b37763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:17.535737 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f7e92-9ee6-4116-ba8f-249023b37763 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:17.536021 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f7e92-9ee6-4116-ba8f-249023b37763 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:17.536298 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f7e92-9ee6-4116-ba8f-249023b37763 None admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:17.536610 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee05bc2-4818-42eb-b3f5-1c8a3e59f438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:17.537061 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24f7e92-9ee6-4116-ba8f-249023b37763 None admin] RBAC: Adding query filter params (name=service) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:17.537384 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24f7e92-9ee6-4116-ba8f-249023b37763 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:17.537474 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee05bc2-4818-42eb-b3f5-1c8a3e59f438 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:17.537706 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee05bc2-4818-42eb-b3f5-1c8a3e59f438 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:17.537978 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee05bc2-4818-42eb-b3f5-1c8a3e59f438 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:17.538751 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24f7e92-9ee6-4116-ba8f-249023b37763 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:17.544439 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee05bc2-4818-42eb-b3f5-1c8a3e59f438 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:17.545975 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee05bc2-4818-42eb-b3f5-1c8a3e59f438 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:17.546557 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 281/566] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Jul 18 10:23:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:17.547733 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb164054-4925-447f-84b0-ee6f5efe4202 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:17.548022 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb164054-4925-447f-84b0-ee6f5efe4202 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:17.548544 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb164054-4925-447f-84b0-ee6f5efe4202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:17.560248 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-2ee05bc2-4818-42eb-b3f5-1c8a3e59f438 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:23:17.560248 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:17.560248 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:17.560248 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:17.560248 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:17.560248 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:17.560248 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:17.560248 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:17.560248 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:17.560248 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:17.560248 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:17.560248 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:17.560248 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:23:17.560248 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:23:17.560248 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:23:17.561878 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:23:17.561878 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:17.561878 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:17.561878 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:17.561878 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:17.561878 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:17.561878 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:17.561878 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:17.561878 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:17.561878 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:17.561878 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:17.561878 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:17.561878 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:17.561878 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:17.561878 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:17.561878 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:17.561878 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:17.567485 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:23:17.567485 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:23:17.567485 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:23:17.567485 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:23:17.567485 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:23:17.567485 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:23:17.567485 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:23:17.567485 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:17.567485 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 286/567] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 10:23:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:17.567485 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee05bc2-4818-42eb-b3f5-1c8a3e59f438 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:17.568469 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-eb164054-4925-447f-84b0-ee6f5efe4202 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:23:17.569753 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-eb164054-4925-447f-84b0-ee6f5efe4202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:23:17.596649 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:17.600126 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:17.636020 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 282/568] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:23:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:23:17.637492 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8196e1e7-0f56-4411-b6ce-aa004b210a23 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:17.637787 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8196e1e7-0f56-4411-b6ce-aa004b210a23 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:17.638061 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8196e1e7-0f56-4411-b6ce-aa004b210a23 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:17.641070 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 283/569] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:23:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:23:17.641070 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8196e1e7-0f56-4411-b6ce-aa004b210a23 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:17.667332 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee05bc2-4818-42eb-b3f5-1c8a3e59f438 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:17.702345 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a7522b-4ad2-4125-a150-d79997069feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:17.703010 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a7522b-4ad2-4125-a150-d79997069feb None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:17.703287 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a7522b-4ad2-4125-a150-d79997069feb None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:17.703557 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a7522b-4ad2-4125-a150-d79997069feb None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:17.704265 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a7522b-4ad2-4125-a150-d79997069feb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:17.704569 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a7522b-4ad2-4125-a150-d79997069feb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:17.705934 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a7522b-4ad2-4125-a150-d79997069feb None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:17.716958 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 287/570] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:17.718462 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a7522b-4ad2-4125-a150-d79997069feb None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:17.745810 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8196e1e7-0f56-4411-b6ce-aa004b210a23 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:17.779214 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05ebf97-8632-4b55-946d-0d1d4f39c276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:17.780085 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05ebf97-8632-4b55-946d-0d1d4f39c276 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:17.780934 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05ebf97-8632-4b55-946d-0d1d4f39c276 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:17.781317 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05ebf97-8632-4b55-946d-0d1d4f39c276 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:17.791039 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05ebf97-8632-4b55-946d-0d1d4f39c276 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:17.792474 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05ebf97-8632-4b55-946d-0d1d4f39c276 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:17.809717 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-d05ebf97-8632-4b55-946d-0d1d4f39c276 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:17.809717 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:17.809717 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:17.809717 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:17.809717 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:17.809717 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:17.809717 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:17.809717 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:17.809717 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:17.809717 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:17.809717 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:17.809717 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:17.809717 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:17.809717 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:17.809717 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:17.810638 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:17.810638 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:17.810638 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:17.810638 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:17.810638 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:17.810638 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:17.810638 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:17.810638 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:17.810638 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:17.810638 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:17.810638 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:17.810638 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:17.810638 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:17.810638 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:17.810638 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:17.810638 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:17.810638 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:17.812115 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:17.812115 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:17.812115 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:17.812115 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:17.812115 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 284/571] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:17.812402 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa704b0-aafd-4599-9420-b428b49b5d59 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:17.812624 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa704b0-aafd-4599-9420-b428b49b5d59 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:17.812874 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa704b0-aafd-4599-9420-b428b49b5d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:17.819232 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:17.825668 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a7522b-4ad2-4125-a150-d79997069feb None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:17.833608 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-baa704b0-aafd-4599-9420-b428b49b5d59 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:23:17.833608 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-baa704b0-aafd-4599-9420-b428b49b5d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:23:17.841121 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:17.862293 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c256ce-836f-4044-a79e-9553d75d1577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:17.862955 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c256ce-836f-4044-a79e-9553d75d1577 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:17.863236 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c256ce-836f-4044-a79e-9553d75d1577 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:17.863510 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c256ce-836f-4044-a79e-9553d75d1577 None admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:17.864541 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c256ce-836f-4044-a79e-9553d75d1577 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:17.864846 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c256ce-836f-4044-a79e-9553d75d1577 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:17.866285 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c256ce-836f-4044-a79e-9553d75d1577 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:17.878346 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 288/572] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 10:23:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:17.879337 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c256ce-836f-4044-a79e-9553d75d1577 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:17.902947 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 285/573] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:23:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:23:17.903775 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa704b0-aafd-4599-9420-b428b49b5d59 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:17.982254 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c256ce-836f-4044-a79e-9553d75d1577 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:18.004556 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa704b0-aafd-4599-9420-b428b49b5d59 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:18.017327 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b73b8fa-f343-42c8-bde2-0169d85b4cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:18.018154 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b73b8fa-f343-42c8-bde2-0169d85b4cba None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:18.018442 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b73b8fa-f343-42c8-bde2-0169d85b4cba None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:18.018715 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b73b8fa-f343-42c8-bde2-0169d85b4cba None admin] PATH_INFO: `/v3/roles/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:18.028695 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b73b8fa-f343-42c8-bde2-0169d85b4cba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:23:18.036520 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-9b73b8fa-f343-42c8-bde2-0169d85b4cba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:23:18.036520 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:18.036520 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:18.036520 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:18.036520 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:18.036520 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:18.036520 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:18.036520 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:18.036520 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:18.036520 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:18.036520 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:18.036520 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:18.036520 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:23:18.036520 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:23:18.036520 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:23:18.036520 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:23:18.037625 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:23:18.037625 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:23:18.037625 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:23:18.037625 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:23:18.037625 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:18.037625 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:18.037625 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:18.037625 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:18.037625 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:18.037625 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:18.037625 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:18.037625 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:18.037625 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:18.037625 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:18.037625 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:18.037625 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:18.038600 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:18.038600 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:18.038600 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:18.038600 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:18.038600 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:23:18.038600 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:23:18.038600 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:23:18.038600 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:23:18.038600 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:23:18.038600 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:23:18.038600 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:23:18.038600 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:18.038600 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 289/574] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jul 18 10:23:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:18.038600 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b73b8fa-f343-42c8-bde2-0169d85b4cba None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:18.041517 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e382fe36-11aa-415e-b4e8-16b480126d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:18.042383 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382fe36-11aa-415e-b4e8-16b480126d7e None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:18.042676 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382fe36-11aa-415e-b4e8-16b480126d7e None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:18.042954 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382fe36-11aa-415e-b4e8-16b480126d7e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:18.050577 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e382fe36-11aa-415e-b4e8-16b480126d7e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:18.052040 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e382fe36-11aa-415e-b4e8-16b480126d7e None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:18.055858 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:18.067500 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-e382fe36-11aa-415e-b4e8-16b480126d7e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:23:18.067500 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:18.067500 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:18.067500 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:18.067500 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:18.067500 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:18.067500 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:18.067500 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:18.067500 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:18.067500 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:18.067500 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:18.067500 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:18.067500 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:23:18.067500 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:23:18.067500 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:23:18.068581 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:23:18.068581 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:18.068581 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:18.068581 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:18.068581 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:18.068581 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:18.068581 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:18.068581 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:18.068581 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:18.068581 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:18.068581 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:18.068581 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:18.068581 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:18.068581 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:18.068581 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:18.068581 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:18.068581 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:18.069543 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:23:18.069543 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:23:18.069543 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:23:18.069543 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:23:18.069543 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:23:18.069543 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:23:18.069543 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:23:18.069543 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:18.069543 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 286/575] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 10:23:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:18.070549 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e382fe36-11aa-415e-b4e8-16b480126d7e None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:18.078751 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:18.149886 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b73b8fa-f343-42c8-bde2-0169d85b4cba None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:18.172826 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e382fe36-11aa-415e-b4e8-16b480126d7e None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:18.184897 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104015c0-58eb-4b0f-9ad1-c458f7900aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:18.185583 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104015c0-58eb-4b0f-9ad1-c458f7900aa9 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:18.185864 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104015c0-58eb-4b0f-9ad1-c458f7900aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:18.186134 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104015c0-58eb-4b0f-9ad1-c458f7900aa9 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:18.187087 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104015c0-58eb-4b0f-9ad1-c458f7900aa9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:18.187423 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104015c0-58eb-4b0f-9ad1-c458f7900aa9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:18.188776 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104015c0-58eb-4b0f-9ad1-c458f7900aa9 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:18.200618 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 290/576] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:18.201534 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104015c0-58eb-4b0f-9ad1-c458f7900aa9 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:18.206746 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f99f18-0c6b-4b27-8ae1-334769c77027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:18.207641 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f99f18-0c6b-4b27-8ae1-334769c77027 None admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:18.207922 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f99f18-0c6b-4b27-8ae1-334769c77027 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:18.208193 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f99f18-0c6b-4b27-8ae1-334769c77027 None admin] PATH_INFO: `/v3/projects/a6098fe56d304980aa14bd95b4b92c17/users/8bbebf16219943879df84bdc9a900516/roles/d151ec157a524341b7194453e46b6b25` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:18.223044 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f99f18-0c6b-4b27-8ae1-334769c77027 None admin] RBAC: Authorizing `identity:create_grant(project_id=a6098fe56d304980aa14bd95b4b92c17, user_id=8bbebf16219943879df84bdc9a900516, role_id=d151ec157a524341b7194453e46b6b25)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:18.224483 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f99f18-0c6b-4b27-8ae1-334769c77027 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:18.282057 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:18.306007 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104015c0-58eb-4b0f-9ad1-c458f7900aa9 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:18.315127 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 287/577] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jul 18 10:23:18 2022] PUT /identity/v3/projects/a6098fe56d304980aa14bd95b4b92c17/users/8bbebf16219943879df84bdc9a900516/roles/d151ec157a524341b7194453e46b6b25 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:23:18.315958 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f99f18-0c6b-4b27-8ae1-334769c77027 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:18.347441 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8a28a0-b22a-4d74-99b6-5d706578ea4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:18.348182 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a28a0-b22a-4d74-99b6-5d706578ea4c None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:18.348464 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a28a0-b22a-4d74-99b6-5d706578ea4c None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:18.348739 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a28a0-b22a-4d74-99b6-5d706578ea4c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:18.361840 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8a28a0-b22a-4d74-99b6-5d706578ea4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:23:18.370181 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-df8a28a0-b22a-4d74-99b6-5d706578ea4c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:23:18.370181 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:18.370181 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:18.370181 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:18.370181 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:18.370181 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:18.370181 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:18.370181 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:18.370181 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:18.370181 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:18.370181 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:18.370181 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:18.370181 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:23:18.370181 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:23:18.370181 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:23:18.370181 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:23:18.371216 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:23:18.371216 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:23:18.371216 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:23:18.371216 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:23:18.371216 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:18.371216 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:18.371216 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:18.371216 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:18.371216 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:18.371216 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:18.371216 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:18.371216 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:18.371216 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:18.371216 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:18.371216 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:18.371216 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:18.372074 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:18.372074 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:18.372074 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:18.372074 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:18.372074 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:23:18.372074 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:23:18.372074 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:23:18.372074 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:23:18.372074 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:23:18.372074 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:23:18.372074 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:23:18.372074 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:18.376528 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 291/578] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jul 18 10:23:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:18.377518 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8a28a0-b22a-4d74-99b6-5d706578ea4c None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:18.395351 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:18.445128 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f99f18-0c6b-4b27-8ae1-334769c77027 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:18.489441 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f301c6a-ddb9-40a4-b8de-328153179384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:18.490110 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f301c6a-ddb9-40a4-b8de-328153179384 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:18.490395 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f301c6a-ddb9-40a4-b8de-328153179384 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:18.490668 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f301c6a-ddb9-40a4-b8de-328153179384 None admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:18.491418 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f301c6a-ddb9-40a4-b8de-328153179384 None admin] RBAC: Adding query filter params (name=service) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:18.491718 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f301c6a-ddb9-40a4-b8de-328153179384 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:18.493094 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f301c6a-ddb9-40a4-b8de-328153179384 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:18.501919 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8a28a0-b22a-4d74-99b6-5d706578ea4c None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:18.502227 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 288/579] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Jul 18 10:23:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:18.503204 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f301c6a-ddb9-40a4-b8de-328153179384 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:18.546655 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d700d-e3a3-40fc-baf2-dc7dcc0d9c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:18.547315 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d700d-e3a3-40fc-baf2-dc7dcc0d9c74 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:18.548024 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d700d-e3a3-40fc-baf2-dc7dcc0d9c74 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:18.548302 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d700d-e3a3-40fc-baf2-dc7dcc0d9c74 None admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:18.549122 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712d700d-e3a3-40fc-baf2-dc7dcc0d9c74 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:18.549779 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712d700d-e3a3-40fc-baf2-dc7dcc0d9c74 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:18.551529 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712d700d-e3a3-40fc-baf2-dc7dcc0d9c74 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:18.553521 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:18.564585 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 292/580] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 10:23:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:18.565380 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d700d-e3a3-40fc-baf2-dc7dcc0d9c74 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:18.613947 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f301c6a-ddb9-40a4-b8de-328153179384 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:18.633074 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:18.652826 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99db52c-7887-4dde-aa8c-35f70ee85553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:18.653663 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99db52c-7887-4dde-aa8c-35f70ee85553 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:18.654645 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99db52c-7887-4dde-aa8c-35f70ee85553 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:18.654645 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99db52c-7887-4dde-aa8c-35f70ee85553 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:18.662865 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99db52c-7887-4dde-aa8c-35f70ee85553 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:18.664310 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99db52c-7887-4dde-aa8c-35f70ee85553 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:18.678619 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-c99db52c-7887-4dde-aa8c-35f70ee85553 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 18 10:23:18.678619 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:18.678619 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:18.678619 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:18.678619 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:18.678619 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:18.678619 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:18.678619 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:18.678619 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:18.678619 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:18.678619 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:18.678619 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:18.678619 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:23:18.678619 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:23:18.678619 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:23:18.678619 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:23:18.679762 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:18.679762 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:18.679762 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:23:18.679762 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:23:18.679762 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:23:18.679762 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:23:18.679762 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:18.679762 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:18.679762 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:18.679762 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:18.679762 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:18.679762 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:18.679762 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:18.679762 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:18.679762 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:18.679762 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:18.679762 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:18.679762 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:18.681072 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:18.681072 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:18.681072 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:23:18.681072 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:23:18.681072 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:23:18.681072 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:23:18.681072 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:23:18.681072 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:23:18.681072 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 18 10:23:18.681072 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:18.684433 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 289/581] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 10:23:18 2022] GET /identity/v3/users/glance => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:18.685287 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99db52c-7887-4dde-aa8c-35f70ee85553 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:18.686482 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d700d-e3a3-40fc-baf2-dc7dcc0d9c74 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:18.723861 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdd23ef-9f7c-443f-b120-a670cf4caa26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:18.724536 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd23ef-9f7c-443f-b120-a670cf4caa26 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:18.724825 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd23ef-9f7c-443f-b120-a670cf4caa26 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:18.725127 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd23ef-9f7c-443f-b120-a670cf4caa26 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:18.725876 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdd23ef-9f7c-443f-b120-a670cf4caa26 None admin] RBAC: Adding query filter params (name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:18.726184 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdd23ef-9f7c-443f-b120-a670cf4caa26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:18.727540 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdd23ef-9f7c-443f-b120-a670cf4caa26 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:18.743366 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 293/582] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Jul 18 10:23:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:18.744050 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdd23ef-9f7c-443f-b120-a670cf4caa26 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:18.790251 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99db52c-7887-4dde-aa8c-35f70ee85553 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:18.810735 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:18.827947 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e8e79-0814-4aaf-9e33-f8815e48f777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:18.828754 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e8e79-0814-4aaf-9e33-f8815e48f777 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:18.829062 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e8e79-0814-4aaf-9e33-f8815e48f777 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:18.829346 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e8e79-0814-4aaf-9e33-f8815e48f777 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:18.840760 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3e8e79-0814-4aaf-9e33-f8815e48f777 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:18.842232 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3e8e79-0814-4aaf-9e33-f8815e48f777 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:18.860909 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-2c3e8e79-0814-4aaf-9e33-f8815e48f777 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:18.860909 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:18.860909 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:18.860909 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:18.860909 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:18.860909 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:18.860909 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:18.860909 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:18.860909 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:18.860909 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:18.860909 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:18.860909 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:18.860909 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:18.860909 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:18.860909 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:18.861863 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:18.861863 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:18.861863 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:18.861863 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:18.861863 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:18.861863 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:18.861863 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:18.861863 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:18.861863 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:18.861863 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:18.861863 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:18.861863 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:18.861863 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:18.861863 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:18.861863 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:18.861863 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:18.861863 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:18.862736 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:18.862736 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:18.862736 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:18.862736 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:18.862736 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 290/583] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:18.863012 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdd23ef-9f7c-443f-b120-a670cf4caa26 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:18.863087 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e8e79-0814-4aaf-9e33-f8815e48f777 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:18.899538 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:18.906171 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ca7e2-5867-4170-bf25-9fc3b3b40663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:18.907199 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ca7e2-5867-4170-bf25-9fc3b3b40663 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:18.910503 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ca7e2-5867-4170-bf25-9fc3b3b40663 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:18.910503 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ca7e2-5867-4170-bf25-9fc3b3b40663 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:18.910503 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7ca7e2-5867-4170-bf25-9fc3b3b40663 None admin] RBAC: Adding query filter params (role.id=d151ec157a524341b7194453e46b6b25, scope.project.id=a6098fe56d304980aa14bd95b4b92c17, user.id=2c548474a8d94591ba58dd40e40a28d2) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:18.910503 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7ca7e2-5867-4170-bf25-9fc3b3b40663 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:18.910503 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7ca7e2-5867-4170-bf25-9fc3b3b40663 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:18.916209 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 294/584] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 10:23:18 2022] GET /identity/v3/role_assignments?user.id=2c548474a8d94591ba58dd40e40a28d2&scope.project.id=a6098fe56d304980aa14bd95b4b92c17&role.id=d151ec157a524341b7194453e46b6b25 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:18.916920 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ca7e2-5867-4170-bf25-9fc3b3b40663 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:19.018957 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e8e79-0814-4aaf-9e33-f8815e48f777 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:19.088429 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3486a93d-3469-49e0-9687-72ed007a85f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:19.088636 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ca7e2-5867-4170-bf25-9fc3b3b40663 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:19.089586 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3486a93d-3469-49e0-9687-72ed007a85f6 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:19.090048 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3486a93d-3469-49e0-9687-72ed007a85f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:19.090521 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3486a93d-3469-49e0-9687-72ed007a85f6 None admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:19.091562 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3486a93d-3469-49e0-9687-72ed007a85f6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:19.092070 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3486a93d-3469-49e0-9687-72ed007a85f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:19.094944 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3486a93d-3469-49e0-9687-72ed007a85f6 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:19.124764 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:19.124981 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 291/585] 10.222.0.39 () {56 vars in 1137 bytes} [Mon Jul 18 10:23:18 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:19.124981 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3486a93d-3469-49e0-9687-72ed007a85f6 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:19.145497 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef4792-cdf9-40d4-acfc-85c2fab4a9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:19.147788 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef4792-cdf9-40d4-acfc-85c2fab4a9af None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:19.147788 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef4792-cdf9-40d4-acfc-85c2fab4a9af None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:19.147788 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef4792-cdf9-40d4-acfc-85c2fab4a9af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:19.163939 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef4792-cdf9-40d4-acfc-85c2fab4a9af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:19.166845 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef4792-cdf9-40d4-acfc-85c2fab4a9af None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:19.191943 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-f8ef4792-cdf9-40d4-acfc-85c2fab4a9af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:19.191943 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:19.191943 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:19.191943 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:19.191943 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:19.191943 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:19.191943 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:19.191943 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:19.191943 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:19.191943 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:19.191943 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:19.191943 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:19.191943 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:19.191943 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:19.191943 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:19.193022 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:19.193022 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:19.193022 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:19.193022 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:19.193022 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:19.193022 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:19.193022 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:19.193022 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:19.193022 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:19.193022 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:19.193022 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:19.193022 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:19.193022 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:19.193022 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:19.193022 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:19.193022 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:19.193022 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:19.194116 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:19.194116 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:19.194116 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:19.194116 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:19.200727 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 295/586] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:19.202946 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef4792-cdf9-40d4-acfc-85c2fab4a9af None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:19.226540 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:19.240270 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3486a93d-3469-49e0-9687-72ed007a85f6 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:19.282146 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac76ee05-f280-4c11-bbd6-16803f2007c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:19.283079 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76ee05-f280-4c11-bbd6-16803f2007c5 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:19.283355 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76ee05-f280-4c11-bbd6-16803f2007c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:19.283816 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76ee05-f280-4c11-bbd6-16803f2007c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:19.284648 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac76ee05-f280-4c11-bbd6-16803f2007c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:19.285063 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac76ee05-f280-4c11-bbd6-16803f2007c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:19.286523 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac76ee05-f280-4c11-bbd6-16803f2007c5 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:19.303413 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 292/587] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:19.304437 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac76ee05-f280-4c11-bbd6-16803f2007c5 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:19.336092 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef4792-cdf9-40d4-acfc-85c2fab4a9af None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:19.374765 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4d29cf-3377-44a5-9571-235e384f1e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:19.375743 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d29cf-3377-44a5-9571-235e384f1e5f None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:19.376669 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d29cf-3377-44a5-9571-235e384f1e5f None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:19.377065 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d29cf-3377-44a5-9571-235e384f1e5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:19.396101 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4d29cf-3377-44a5-9571-235e384f1e5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:19.397685 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4d29cf-3377-44a5-9571-235e384f1e5f None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:19.417934 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-ba4d29cf-3377-44a5-9571-235e384f1e5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:19.417934 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:19.417934 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:19.417934 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:19.417934 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:19.417934 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:19.417934 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:19.417934 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:19.417934 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:19.417934 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:19.417934 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:19.417934 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:19.417934 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:19.417934 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:19.417934 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:19.418831 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:19.418831 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:19.418831 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:19.418831 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:19.418831 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:19.418831 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:19.418831 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:19.418831 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:19.418831 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:19.418831 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:19.418831 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:19.418831 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:19.418831 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:19.418831 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:19.418831 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:19.418831 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:19.418831 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:19.419711 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:19.419711 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:19.419711 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:19.419711 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:19.424285 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 296/588] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:19.425256 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4d29cf-3377-44a5-9571-235e384f1e5f None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:19.430327 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac76ee05-f280-4c11-bbd6-16803f2007c5 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:19.453894 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:19.471667 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732aa339-3ce0-4a12-ab74-e4a9c8f29fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:19.472677 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732aa339-3ce0-4a12-ab74-e4a9c8f29fdd None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:19.473167 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732aa339-3ce0-4a12-ab74-e4a9c8f29fdd None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:19.473604 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732aa339-3ce0-4a12-ab74-e4a9c8f29fdd None admin] PATH_INFO: `/v3/domains` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:19.479508 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732aa339-3ce0-4a12-ab74-e4a9c8f29fdd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:19.479508 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732aa339-3ce0-4a12-ab74-e4a9c8f29fdd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:19.479508 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732aa339-3ce0-4a12-ab74-e4a9c8f29fdd None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:19.493159 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 293/589] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:19.494140 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732aa339-3ce0-4a12-ab74-e4a9c8f29fdd None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:19.507186 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:19.536313 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4d29cf-3377-44a5-9571-235e384f1e5f None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:19.572721 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7be6aa-6d61-4d84-8c49-37eecf2c0281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:19.573597 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7be6aa-6d61-4d84-8c49-37eecf2c0281 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:19.573885 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7be6aa-6d61-4d84-8c49-37eecf2c0281 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:19.574214 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7be6aa-6d61-4d84-8c49-37eecf2c0281 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:19.581927 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7be6aa-6d61-4d84-8c49-37eecf2c0281 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:19.583424 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7be6aa-6d61-4d84-8c49-37eecf2c0281 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:19.598564 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-ee7be6aa-6d61-4d84-8c49-37eecf2c0281 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 10:23:19.598564 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:19.598564 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:19.598564 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:19.598564 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:19.598564 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:19.598564 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:19.598564 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:19.598564 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:19.598564 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:19.598564 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:19.598564 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:19.598564 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:23:19.598564 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:23:19.598564 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:23:19.598564 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:23:19.599589 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:19.599589 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:19.599589 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:23:19.599589 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:23:19.599589 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:23:19.599589 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:23:19.599589 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:19.599589 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:19.599589 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:19.599589 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:19.599589 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:19.599589 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:19.599589 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:19.599589 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:19.599589 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:19.599589 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:19.599589 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:19.599589 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:19.600519 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:19.600519 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:19.600519 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:23:19.600519 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:23:19.600519 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:23:19.600519 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:23:19.600519 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:23:19.600519 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:23:19.600519 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 10:23:19.600519 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:19.600519 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 297/590] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 10:23:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:19.600519 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7be6aa-6d61-4d84-8c49-37eecf2c0281 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:19.605877 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732aa339-3ce0-4a12-ab74-e4a9c8f29fdd None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:19.644748 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a27b3-354b-468c-bde6-b68e96474c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:19.645551 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a27b3-354b-468c-bde6-b68e96474c88 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:19.645833 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a27b3-354b-468c-bde6-b68e96474c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:19.646103 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a27b3-354b-468c-bde6-b68e96474c88 None admin] PATH_INFO: `/v3/domains` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:19.646969 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49a27b3-354b-468c-bde6-b68e96474c88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:19.647281 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49a27b3-354b-468c-bde6-b68e96474c88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:19.648658 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49a27b3-354b-468c-bde6-b68e96474c88 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:19.661918 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 294/591] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:19.662836 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a27b3-354b-468c-bde6-b68e96474c88 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:19.694845 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:19.710949 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7be6aa-6d61-4d84-8c49-37eecf2c0281 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:19.735898 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:19.746754 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a839fdf9-5361-4495-bfc0-89cb7f9048ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:19.747561 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a839fdf9-5361-4495-bfc0-89cb7f9048ed None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:19.747893 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a839fdf9-5361-4495-bfc0-89cb7f9048ed None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:19.748176 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a839fdf9-5361-4495-bfc0-89cb7f9048ed None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:19.756710 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a839fdf9-5361-4495-bfc0-89cb7f9048ed None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:19.758200 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a839fdf9-5361-4495-bfc0-89cb7f9048ed None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:19.774701 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-a839fdf9-5361-4495-bfc0-89cb7f9048ed None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 18 10:23:19.774701 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:19.774701 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:19.774701 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:19.774701 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:19.774701 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:19.774701 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:19.774701 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:19.774701 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:19.774701 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:19.774701 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:19.774701 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:19.774701 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:23:19.774701 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:23:19.774701 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:23:19.774701 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:23:19.775836 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:19.775836 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:19.775836 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:23:19.775836 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:23:19.775836 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:23:19.775836 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:23:19.775836 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:19.775836 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:19.775836 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:19.775836 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:19.775836 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:19.775836 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:19.775836 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:19.775836 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:19.775836 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:19.775836 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:19.775836 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:19.775836 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:19.776969 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:19.776969 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:19.776969 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:23:19.776969 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:23:19.776969 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:23:19.776969 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:23:19.776969 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:23:19.776969 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:23:19.776969 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 18 10:23:19.776969 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:19.777907 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a27b3-354b-468c-bde6-b68e96474c88 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:19.781134 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 298/592] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jul 18 10:23:19 2022] GET /identity/v3/users/neutron => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:19.782178 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a839fdf9-5361-4495-bfc0-89cb7f9048ed None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:19.816486 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0975f98f-cc8c-4605-8cda-701a84ad594e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:19.818039 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975f98f-cc8c-4605-8cda-701a84ad594e None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:19.818470 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975f98f-cc8c-4605-8cda-701a84ad594e None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:19.818890 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975f98f-cc8c-4605-8cda-701a84ad594e None admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:19.819866 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0975f98f-cc8c-4605-8cda-701a84ad594e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:19.820331 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0975f98f-cc8c-4605-8cda-701a84ad594e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:19.821923 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0975f98f-cc8c-4605-8cda-701a84ad594e None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:19.841188 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 295/593] 10.222.0.39 () {56 vars in 1137 bytes} [Mon Jul 18 10:23:19 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:19.842901 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0975f98f-cc8c-4605-8cda-701a84ad594e None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:19.886128 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a839fdf9-5361-4495-bfc0-89cb7f9048ed None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:19.922734 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5248e2-8fda-446f-93ae-065c81b6fd9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:19.923593 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5248e2-8fda-446f-93ae-065c81b6fd9c None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:19.923877 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5248e2-8fda-446f-93ae-065c81b6fd9c None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:19.924156 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5248e2-8fda-446f-93ae-065c81b6fd9c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:19.931391 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5248e2-8fda-446f-93ae-065c81b6fd9c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:19.932847 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5248e2-8fda-446f-93ae-065c81b6fd9c None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:19.947996 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-0e5248e2-8fda-446f-93ae-065c81b6fd9c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:23:19.947996 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:19.947996 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:19.947996 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:19.947996 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:19.947996 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:19.947996 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:19.947996 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:19.947996 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:19.947996 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:19.947996 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:19.947996 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:19.947996 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:23:19.947996 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:23:19.947996 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:23:19.949088 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:23:19.949088 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:19.949088 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:19.949088 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:19.949088 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:19.949088 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:19.949088 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:19.949088 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:19.949088 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:19.949088 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:19.949088 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:19.949088 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:19.949088 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:19.949088 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:19.949088 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:19.949088 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:19.949088 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:19.962741 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:23:19.962741 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:23:19.962741 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:23:19.962741 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:23:19.962741 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:23:19.962741 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:23:19.962741 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:23:19.962741 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:19.962741 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 299/594] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 10:23:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:19.962741 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5248e2-8fda-446f-93ae-065c81b6fd9c None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:19.963346 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0975f98f-cc8c-4605-8cda-701a84ad594e None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:19.963419 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:19.989186 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:19.998350 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfbce99-96c9-4f7d-88c7-356c76a5314b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:19.999310 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfbce99-96c9-4f7d-88c7-356c76a5314b None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:19.999742 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfbce99-96c9-4f7d-88c7-356c76a5314b None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:20.000168 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfbce99-96c9-4f7d-88c7-356c76a5314b None admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:20.001191 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfbce99-96c9-4f7d-88c7-356c76a5314b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:20.001644 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfbce99-96c9-4f7d-88c7-356c76a5314b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:20.003242 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfbce99-96c9-4f7d-88c7-356c76a5314b None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:20.028509 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 296/595] 10.222.0.39 () {56 vars in 1139 bytes} [Mon Jul 18 10:23:19 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:20.029538 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfbce99-96c9-4f7d-88c7-356c76a5314b None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:20.068623 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5248e2-8fda-446f-93ae-065c81b6fd9c None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:20.108577 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f581d5d9-478f-452b-b352-a8e9e7fb1937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:20.109713 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581d5d9-478f-452b-b352-a8e9e7fb1937 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:20.110151 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581d5d9-478f-452b-b352-a8e9e7fb1937 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:20.110629 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581d5d9-478f-452b-b352-a8e9e7fb1937 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:20.125585 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f581d5d9-478f-452b-b352-a8e9e7fb1937 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:20.128047 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f581d5d9-478f-452b-b352-a8e9e7fb1937 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:20.145267 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfbce99-96c9-4f7d-88c7-356c76a5314b None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:20.150641 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-f581d5d9-478f-452b-b352-a8e9e7fb1937 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:20.150641 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:20.150641 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:20.150641 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:20.150641 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:20.150641 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:20.150641 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:20.150641 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:20.150641 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:20.150641 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:20.150641 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:20.150641 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:20.150641 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:20.150641 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:20.150641 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:20.151605 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:20.151605 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:20.151605 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:20.151605 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:20.151605 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:20.151605 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:20.151605 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:20.151605 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:20.151605 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:20.151605 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:20.151605 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:20.151605 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:20.151605 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:20.151605 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:20.151605 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:20.151605 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:20.151605 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:20.152708 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:20.152708 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:20.152708 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:20.152708 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:20.154639 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 300/596] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:20.156119 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f581d5d9-478f-452b-b352-a8e9e7fb1937 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:20.187131 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fb9910-377a-46d1-9354-9459c1ba33a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:20.187838 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb9910-377a-46d1-9354-9459c1ba33a3 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:20.188230 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb9910-377a-46d1-9354-9459c1ba33a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:20.188616 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb9910-377a-46d1-9354-9459c1ba33a3 None admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:20.189566 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fb9910-377a-46d1-9354-9459c1ba33a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:20.189988 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fb9910-377a-46d1-9354-9459c1ba33a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:20.191750 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fb9910-377a-46d1-9354-9459c1ba33a3 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:20.208630 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 297/597] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 10:23:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:20.209632 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fb9910-377a-46d1-9354-9459c1ba33a3 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:20.229702 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:20.268217 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:20.280814 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f581d5d9-478f-452b-b352-a8e9e7fb1937 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:20.320456 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877e3234-13c7-40ed-b648-5c8147e5f775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:20.321678 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e3234-13c7-40ed-b648-5c8147e5f775 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:20.321969 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e3234-13c7-40ed-b648-5c8147e5f775 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:20.322273 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e3234-13c7-40ed-b648-5c8147e5f775 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:20.335667 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877e3234-13c7-40ed-b648-5c8147e5f775 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:20.337131 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877e3234-13c7-40ed-b648-5c8147e5f775 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:20.343141 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fb9910-377a-46d1-9354-9459c1ba33a3 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:20.355753 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-877e3234-13c7-40ed-b648-5c8147e5f775 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:20.355753 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:20.355753 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:20.355753 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:20.355753 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:20.355753 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:20.355753 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:20.355753 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:20.355753 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:20.355753 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:20.355753 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:20.355753 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:20.355753 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:20.355753 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:20.355753 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:20.356647 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:20.356647 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:20.356647 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:20.356647 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:20.356647 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:20.356647 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:20.356647 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:20.356647 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:20.356647 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:20.356647 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:20.356647 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:20.356647 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:20.356647 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:20.356647 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:20.356647 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:20.356647 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:20.356647 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:20.357556 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:20.357556 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:20.357556 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:20.357556 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:20.361901 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 301/598] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:20.362724 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877e3234-13c7-40ed-b648-5c8147e5f775 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:20.390893 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc077b-42d3-47a2-b472-677a5f88e429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:20.392591 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc077b-42d3-47a2-b472-677a5f88e429 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:20.393126 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc077b-42d3-47a2-b472-677a5f88e429 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:20.393824 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc077b-42d3-47a2-b472-677a5f88e429 None admin] PATH_INFO: `/v3/domains` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:20.395437 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bc077b-42d3-47a2-b472-677a5f88e429 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:20.395991 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bc077b-42d3-47a2-b472-677a5f88e429 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:20.398538 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bc077b-42d3-47a2-b472-677a5f88e429 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:20.414396 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 298/599] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:20.415256 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc077b-42d3-47a2-b472-677a5f88e429 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:20.479007 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877e3234-13c7-40ed-b648-5c8147e5f775 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:20.489707 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:20.514800 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f012c3-7ac5-4fa8-861c-2f88104cc948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:20.515700 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f012c3-7ac5-4fa8-861c-2f88104cc948 None admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:20.515986 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f012c3-7ac5-4fa8-861c-2f88104cc948 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:20.516266 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f012c3-7ac5-4fa8-861c-2f88104cc948 None admin] PATH_INFO: `/v3/projects/a6098fe56d304980aa14bd95b4b92c17/users/48d1f7d0286745a396905aee50c9410b/roles/d151ec157a524341b7194453e46b6b25` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:20.521212 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc077b-42d3-47a2-b472-677a5f88e429 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:20.524302 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:20.532533 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f012c3-7ac5-4fa8-861c-2f88104cc948 None admin] RBAC: Authorizing `identity:create_grant(project_id=a6098fe56d304980aa14bd95b4b92c17, user_id=48d1f7d0286745a396905aee50c9410b, role_id=d151ec157a524341b7194453e46b6b25)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:20.534113 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f012c3-7ac5-4fa8-861c-2f88104cc948 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:20.559247 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ac0a8a-5483-4332-8465-c6bb8a09ab6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:20.559931 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac0a8a-5483-4332-8465-c6bb8a09ab6b None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:20.560364 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac0a8a-5483-4332-8465-c6bb8a09ab6b None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:20.560927 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac0a8a-5483-4332-8465-c6bb8a09ab6b None admin] PATH_INFO: `/v3/domains` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:20.562035 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ac0a8a-5483-4332-8465-c6bb8a09ab6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:20.562355 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ac0a8a-5483-4332-8465-c6bb8a09ab6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:20.563876 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ac0a8a-5483-4332-8465-c6bb8a09ab6b None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:20.575925 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 299/600] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:20.577251 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d657f-1ea5-41ce-b836-711c109dbf48 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:20.577543 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d657f-1ea5-41ce-b836-711c109dbf48 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:20.577821 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d657f-1ea5-41ce-b836-711c109dbf48 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:20.579200 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 300/601] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:23:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:23:20.581106 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d657f-1ea5-41ce-b836-711c109dbf48 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:20.633074 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 302/602] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jul 18 10:23:20 2022] PUT /identity/v3/projects/a6098fe56d304980aa14bd95b4b92c17/users/48d1f7d0286745a396905aee50c9410b/roles/d151ec157a524341b7194453e46b6b25 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:23:20.633074 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f012c3-7ac5-4fa8-861c-2f88104cc948 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:20.710082 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d657f-1ea5-41ce-b836-711c109dbf48 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:20.752250 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a80dd08-67ab-4b06-9cb9-d70ba6af471c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:20.753092 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80dd08-67ab-4b06-9cb9-d70ba6af471c None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:20.753452 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80dd08-67ab-4b06-9cb9-d70ba6af471c None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:20.753796 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80dd08-67ab-4b06-9cb9-d70ba6af471c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:20.761610 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f012c3-7ac5-4fa8-861c-2f88104cc948 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:20.761806 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a80dd08-67ab-4b06-9cb9-d70ba6af471c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:20.763263 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a80dd08-67ab-4b06-9cb9-d70ba6af471c None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:20.781240 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-3a80dd08-67ab-4b06-9cb9-d70ba6af471c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:23:20.781240 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:20.781240 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:20.781240 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:20.781240 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:20.781240 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:20.781240 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:20.781240 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:20.781240 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:20.781240 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:20.781240 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:20.781240 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:20.781240 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:23:20.781240 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:23:20.781240 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:23:20.782176 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:23:20.782176 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:20.782176 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:20.782176 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:20.782176 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:20.782176 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:20.782176 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:20.782176 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:20.782176 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:20.782176 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:20.782176 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:20.782176 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:20.782176 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:20.782176 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:20.782176 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:20.782176 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:20.782176 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:20.783051 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:23:20.783051 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:23:20.783051 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:23:20.783051 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:23:20.783051 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:23:20.783051 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:23:20.783051 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:23:20.783051 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:20.783474 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 301/603] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 10:23:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:20.784801 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99556579-47c8-4145-92b4-ab5a4330971e None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:20.785344 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99556579-47c8-4145-92b4-ab5a4330971e None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:20.785768 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99556579-47c8-4145-92b4-ab5a4330971e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:20.805032 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-99556579-47c8-4145-92b4-ab5a4330971e None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:23:20.805911 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48840af0-e8ba-4e76-86d2-c7a805784951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:20.806434 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-99556579-47c8-4145-92b4-ab5a4330971e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:23:20.806712 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48840af0-e8ba-4e76-86d2-c7a805784951 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:20.806990 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48840af0-e8ba-4e76-86d2-c7a805784951 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:20.807259 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48840af0-e8ba-4e76-86d2-c7a805784951 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:20.817522 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48840af0-e8ba-4e76-86d2-c7a805784951 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:20.819340 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48840af0-e8ba-4e76-86d2-c7a805784951 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:20.829706 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:20.835489 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-48840af0-e8ba-4e76-86d2-c7a805784951 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:23:20.835489 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:20.835489 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:20.835489 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:20.835489 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:20.835489 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:20.835489 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:20.835489 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:20.835489 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:20.835489 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:20.835489 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:20.835489 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:20.835489 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:23:20.835489 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:23:20.835489 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:23:20.837639 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:23:20.837639 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:20.837639 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:20.837639 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:20.837639 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:20.837639 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:20.837639 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:20.837639 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:20.837639 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:20.837639 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:20.837639 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:20.837639 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:20.837639 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:20.837639 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:20.837639 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:20.837639 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:20.837639 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:20.839998 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:23:20.839998 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:23:20.839998 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:23:20.839998 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:23:20.839998 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:23:20.839998 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:23:20.839998 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:23:20.839998 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:20.839998 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 303/604] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 10:23:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:20.839998 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48840af0-e8ba-4e76-86d2-c7a805784951 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:20.865918 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:20.894893 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 302/605] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:23:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:23:20.895976 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99556579-47c8-4145-92b4-ab5a4330971e None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:20.981588 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48840af0-e8ba-4e76-86d2-c7a805784951 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:21.030607 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99556579-47c8-4145-92b4-ab5a4330971e None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:21.031513 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b93b0c-df4c-460b-b81a-034a08e2950b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:21.032199 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b93b0c-df4c-460b-b81a-034a08e2950b None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:21.032585 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b93b0c-df4c-460b-b81a-034a08e2950b None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:21.032870 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b93b0c-df4c-460b-b81a-034a08e2950b None admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:21.033739 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b93b0c-df4c-460b-b81a-034a08e2950b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:21.034076 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b93b0c-df4c-460b-b81a-034a08e2950b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:21.035580 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b93b0c-df4c-460b-b81a-034a08e2950b None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:21.049183 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 304/606] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 10:23:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:21.050030 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b93b0c-df4c-460b-b81a-034a08e2950b None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:21.071898 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84b8f53-1f9b-4605-a967-bf25cf50c3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:21.072574 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b8f53-1f9b-4605-a967-bf25cf50c3cb None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:21.072857 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b8f53-1f9b-4605-a967-bf25cf50c3cb None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:21.073209 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b8f53-1f9b-4605-a967-bf25cf50c3cb None admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:21.073998 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84b8f53-1f9b-4605-a967-bf25cf50c3cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:21.074307 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84b8f53-1f9b-4605-a967-bf25cf50c3cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:21.075732 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84b8f53-1f9b-4605-a967-bf25cf50c3cb None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:21.090732 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 303/607] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 10:23:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:21.092047 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f485f-e079-4533-ba20-279837ed55e2 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:21.093068 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f485f-e079-4533-ba20-279837ed55e2 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:21.093256 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f485f-e079-4533-ba20-279837ed55e2 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:21.094947 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 304/608] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:23:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:23:21.096288 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40f485f-e079-4533-ba20-279837ed55e2 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:21.118865 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:21.145630 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:21.171713 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b93b0c-df4c-460b-b81a-034a08e2950b None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:21.207516 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b03589-3b43-45ae-80ea-229d269d9338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:21.208316 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b03589-3b43-45ae-80ea-229d269d9338 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:21.208596 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b03589-3b43-45ae-80ea-229d269d9338 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:21.208865 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b03589-3b43-45ae-80ea-229d269d9338 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:21.209483 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40f485f-e079-4533-ba20-279837ed55e2 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:21.219967 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b03589-3b43-45ae-80ea-229d269d9338 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:23:21.227852 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-44b03589-3b43-45ae-80ea-229d269d9338 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:23:21.227852 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:21.227852 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:21.227852 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:21.227852 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:21.227852 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:21.227852 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:21.227852 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:21.227852 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:21.227852 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:21.227852 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:21.227852 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:21.227852 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:23:21.227852 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:23:21.227852 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:23:21.227852 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:23:21.228789 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:23:21.228789 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:23:21.228789 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:23:21.228789 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:23:21.228789 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:21.228789 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:21.228789 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:21.228789 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:21.228789 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:21.228789 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:21.228789 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:21.228789 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:21.228789 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:21.228789 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:21.228789 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:21.228789 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:21.230477 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:21.230477 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:21.230477 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:21.230477 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:21.230477 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:23:21.230477 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:23:21.230477 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:23:21.230477 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:23:21.230477 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:23:21.230477 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:23:21.230477 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:23:21.230477 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:21.230477 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 305/609] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jul 18 10:23:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:21.230477 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b03589-3b43-45ae-80ea-229d269d9338 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:21.253120 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f49022-2221-452b-9a7e-bfc3d8416634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:21.254013 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f49022-2221-452b-9a7e-bfc3d8416634 None admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:21.254292 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f49022-2221-452b-9a7e-bfc3d8416634 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:21.254568 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f49022-2221-452b-9a7e-bfc3d8416634 None admin] PATH_INFO: `/v3/projects/a6098fe56d304980aa14bd95b4b92c17/users/7cc4f041a5b242138a92a54633dcece6/roles/d151ec157a524341b7194453e46b6b25` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:21.270986 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f49022-2221-452b-9a7e-bfc3d8416634 None admin] RBAC: Authorizing `identity:create_grant(project_id=a6098fe56d304980aa14bd95b4b92c17, user_id=7cc4f041a5b242138a92a54633dcece6, role_id=d151ec157a524341b7194453e46b6b25)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:21.272408 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f49022-2221-452b-9a7e-bfc3d8416634 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:21.334797 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b03589-3b43-45ae-80ea-229d269d9338 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:21.369771 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfb75e8-59e4-49a8-8df1-f4295f718b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:21.370902 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb75e8-59e4-49a8-8df1-f4295f718b6b None admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:21.370902 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb75e8-59e4-49a8-8df1-f4295f718b6b None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:21.371197 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfb75e8-59e4-49a8-8df1-f4295f718b6b None admin] PATH_INFO: `/v3/projects/a6098fe56d304980aa14bd95b4b92c17/users/2f88e3a2b95e477bae1cc98e9e18dc24/roles/d151ec157a524341b7194453e46b6b25` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:21.387465 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 305/610] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jul 18 10:23:21 2022] PUT /identity/v3/projects/a6098fe56d304980aa14bd95b4b92c17/users/7cc4f041a5b242138a92a54633dcece6/roles/d151ec157a524341b7194453e46b6b25 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:23:21.387465 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99e647-a6c0-4900-a0c7-4fc4155a565a None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:21.387465 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99e647-a6c0-4900-a0c7-4fc4155a565a None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:21.387465 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99e647-a6c0-4900-a0c7-4fc4155a565a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:21.389000 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:21.390890 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfb75e8-59e4-49a8-8df1-f4295f718b6b None admin] RBAC: Authorizing `identity:create_grant(project_id=a6098fe56d304980aa14bd95b4b92c17, user_id=2f88e3a2b95e477bae1cc98e9e18dc24, role_id=d151ec157a524341b7194453e46b6b25)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:21.392566 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfb75e8-59e4-49a8-8df1-f4295f718b6b None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:21.407440 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-0f99e647-a6c0-4900-a0c7-4fc4155a565a None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:23:21.408820 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-0f99e647-a6c0-4900-a0c7-4fc4155a565a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:23:21.466047 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 306/611] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jul 18 10:23:21 2022] PUT /identity/v3/projects/a6098fe56d304980aa14bd95b4b92c17/users/2f88e3a2b95e477bae1cc98e9e18dc24/roles/d151ec157a524341b7194453e46b6b25 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:23:21.467997 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfb75e8-59e4-49a8-8df1-f4295f718b6b None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:21.506782 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:21.525653 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 306/612] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:23:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:23:21.579416 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f99e647-a6c0-4900-a0c7-4fc4155a565a None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:21.662347 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfb75e8-59e4-49a8-8df1-f4295f718b6b None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:21.714406 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f99e647-a6c0-4900-a0c7-4fc4155a565a None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:21.719754 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bdaf79-794a-49d6-ac37-51cdee387be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:21.720444 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bdaf79-794a-49d6-ac37-51cdee387be2 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:21.720725 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bdaf79-794a-49d6-ac37-51cdee387be2 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:21.720999 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bdaf79-794a-49d6-ac37-51cdee387be2 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:21.721842 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bdaf79-794a-49d6-ac37-51cdee387be2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:21.722192 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bdaf79-794a-49d6-ac37-51cdee387be2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:21.723567 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bdaf79-794a-49d6-ac37-51cdee387be2 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:21.734908 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 307/613] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Jul 18 10:23:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:21.741741 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bdaf79-794a-49d6-ac37-51cdee387be2 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:21.779326 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0d700a-7bdb-40b0-bdf5-5d4c72e25ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:21.781815 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d700a-7bdb-40b0-bdf5-5d4c72e25ef9 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:21.783291 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d700a-7bdb-40b0-bdf5-5d4c72e25ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:21.783954 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d700a-7bdb-40b0-bdf5-5d4c72e25ef9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:21.802368 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0d700a-7bdb-40b0-bdf5-5d4c72e25ef9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:23:21.813180 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-0e0d700a-7bdb-40b0-bdf5-5d4c72e25ef9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:23:21.813180 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:21.813180 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:21.813180 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:21.813180 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:21.813180 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:21.813180 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:21.813180 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:21.813180 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:21.813180 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:21.813180 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:21.813180 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:21.813180 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:23:21.813180 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:23:21.813180 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:23:21.813180 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:23:21.814125 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:23:21.814125 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:23:21.814125 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:23:21.814125 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:23:21.814125 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:21.814125 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:21.814125 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:21.814125 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:21.814125 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:21.814125 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:21.814125 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:21.814125 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:21.814125 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:21.814125 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:21.814125 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:21.814125 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:21.814973 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:21.814973 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:21.814973 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:21.814973 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:21.814973 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:23:21.814973 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:23:21.814973 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:23:21.814973 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:23:21.814973 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:23:21.814973 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:23:21.814973 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:23:21.814973 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:21.817887 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 307/614] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jul 18 10:23:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:23:21.828582 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0d700a-7bdb-40b0-bdf5-5d4c72e25ef9 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:21.841478 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:21.930972 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bdaf79-794a-49d6-ac37-51cdee387be2 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:21.941007 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:21.990096 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0d700a-7bdb-40b0-bdf5-5d4c72e25ef9 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:21.996480 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24352ee-4baa-4017-8527-55b855353689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:21.997419 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24352ee-4baa-4017-8527-55b855353689 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:21.997701 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24352ee-4baa-4017-8527-55b855353689 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:21.997975 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24352ee-4baa-4017-8527-55b855353689 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:22.019909 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24352ee-4baa-4017-8527-55b855353689 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:22.021912 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24352ee-4baa-4017-8527-55b855353689 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:22.033829 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3626d-35b6-4b62-82bf-fe8051fa3664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:22.034833 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3626d-35b6-4b62-82bf-fe8051fa3664 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:22.035317 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3626d-35b6-4b62-82bf-fe8051fa3664 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:22.035808 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3626d-35b6-4b62-82bf-fe8051fa3664 None admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:22.036814 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d3626d-35b6-4b62-82bf-fe8051fa3664 None admin] RBAC: Adding query filter params (name=service) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:22.037517 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d3626d-35b6-4b62-82bf-fe8051fa3664 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:22.042487 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d3626d-35b6-4b62-82bf-fe8051fa3664 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:22.051093 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-b24352ee-4baa-4017-8527-55b855353689 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:22.051093 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:22.051093 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:22.051093 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:22.051093 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:22.051093 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:22.051093 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:22.051093 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:22.051093 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:22.051093 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:22.051093 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:22.051093 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:22.051093 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:22.051093 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:22.051093 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:22.051975 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:22.051975 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:22.051975 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:22.051975 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:22.051975 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:22.051975 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:22.051975 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:22.051975 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:22.051975 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:22.051975 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:22.051975 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:22.051975 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:22.051975 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:22.051975 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:22.051975 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:22.051975 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:22.051975 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:22.052880 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:22.052880 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:22.052880 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:22.052880 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:22.057511 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 308/615] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:22.066509 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 308/616] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Jul 18 10:23:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:22.067527 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24352ee-4baa-4017-8527-55b855353689 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:22.071470 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3626d-35b6-4b62-82bf-fe8051fa3664 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:22.220909 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3626d-35b6-4b62-82bf-fe8051fa3664 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:22.241395 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:22.253022 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24352ee-4baa-4017-8527-55b855353689 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:22.254770 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:22.264621 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903df607-8690-44e7-9d14-7ec926ef2bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:22.266416 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903df607-8690-44e7-9d14-7ec926ef2bd1 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:22.267345 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903df607-8690-44e7-9d14-7ec926ef2bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:22.267834 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903df607-8690-44e7-9d14-7ec926ef2bd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:22.282512 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903df607-8690-44e7-9d14-7ec926ef2bd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:22.284379 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903df607-8690-44e7-9d14-7ec926ef2bd1 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:22.304804 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-903df607-8690-44e7-9d14-7ec926ef2bd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:22.304804 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:22.304804 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:22.304804 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:22.304804 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:22.304804 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:22.304804 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:22.304804 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:22.304804 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:22.304804 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:22.304804 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:22.304804 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:22.304804 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:22.304804 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:22.304804 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:22.305791 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:22.305791 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:22.305791 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:22.305791 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:22.305791 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:22.305791 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:22.305791 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:22.305791 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:22.305791 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:22.305791 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:22.305791 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:22.305791 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:22.305791 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:22.305791 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:22.305791 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:22.305791 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:22.305791 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:22.306647 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:22.306647 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:22.306647 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:22.306647 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:22.310632 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 309/617] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:23:22.315406 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903df607-8690-44e7-9d14-7ec926ef2bd1 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:22.334632 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8884d17-356d-4626-837b-051af3d8e9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:22.335648 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8884d17-356d-4626-837b-051af3d8e9b9 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:22.336157 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8884d17-356d-4626-837b-051af3d8e9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:22.336634 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8884d17-356d-4626-837b-051af3d8e9b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:22.337601 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8884d17-356d-4626-837b-051af3d8e9b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:22.339186 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8884d17-356d-4626-837b-051af3d8e9b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:22.340775 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8884d17-356d-4626-837b-051af3d8e9b9 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:22.369110 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 309/618] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:22.373429 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8884d17-356d-4626-837b-051af3d8e9b9 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:22.493688 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903df607-8690-44e7-9d14-7ec926ef2bd1 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:22.530653 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8884d17-356d-4626-837b-051af3d8e9b9 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:22.555839 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a560c75-d2b0-48ab-9e9e-92119d198555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:22.556506 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a560c75-d2b0-48ab-9e9e-92119d198555 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:22.556787 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a560c75-d2b0-48ab-9e9e-92119d198555 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:22.557074 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a560c75-d2b0-48ab-9e9e-92119d198555 None admin] PATH_INFO: `/v3/domains` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:22.557805 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a560c75-d2b0-48ab-9e9e-92119d198555 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:22.558107 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a560c75-d2b0-48ab-9e9e-92119d198555 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:22.559470 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a560c75-d2b0-48ab-9e9e-92119d198555 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:22.579710 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20d87f-5775-422b-bfc9-ecee874e612f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:22.580509 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20d87f-5775-422b-bfc9-ecee874e612f None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:22.580789 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20d87f-5775-422b-bfc9-ecee874e612f None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:22.581080 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20d87f-5775-422b-bfc9-ecee874e612f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:22.585249 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 310/619] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:23:22.589280 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a20d87f-5775-422b-bfc9-ecee874e612f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:22.590209 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a560c75-d2b0-48ab-9e9e-92119d198555 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:22.590858 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a20d87f-5775-422b-bfc9-ecee874e612f None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:22.605833 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-4a20d87f-5775-422b-bfc9-ecee874e612f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 10:23:22.605833 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:22.605833 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:22.605833 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:22.605833 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:22.605833 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:22.605833 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:22.605833 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:22.605833 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:22.605833 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:22.605833 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:22.605833 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:22.605833 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:23:22.605833 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:23:22.605833 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:23:22.605833 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:23:22.606813 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:22.606813 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:22.606813 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:23:22.606813 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:23:22.606813 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:23:22.606813 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:23:22.606813 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:22.606813 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:22.606813 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:22.606813 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:22.606813 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:22.606813 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:22.606813 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:22.606813 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:22.606813 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:22.606813 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:22.606813 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:22.606813 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:22.608264 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:22.608264 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:22.608264 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:23:22.608264 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:23:22.608264 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:23:22.608264 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:23:22.608264 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:23:22.608264 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:23:22.608264 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 10:23:22.608264 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:22.612359 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 310/620] 10.222.0.39 () {56 vars in 1093 bytes} [Mon Jul 18 10:23:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:22.613814 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20d87f-5775-422b-bfc9-ecee874e612f None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:22.639566 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:22.670123 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:22.764181 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20d87f-5775-422b-bfc9-ecee874e612f None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:22.776953 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a560c75-d2b0-48ab-9e9e-92119d198555 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:22.800511 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a073bd-24fb-4b71-965f-79aa48127c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:22.801558 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a073bd-24fb-4b71-965f-79aa48127c9f None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:22.801558 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a073bd-24fb-4b71-965f-79aa48127c9f None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:22.801884 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a073bd-24fb-4b71-965f-79aa48127c9f None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:22.802911 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a073bd-24fb-4b71-965f-79aa48127c9f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:22.803224 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a073bd-24fb-4b71-965f-79aa48127c9f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:22.804637 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a073bd-24fb-4b71-965f-79aa48127c9f None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:22.818462 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6743269e-fa33-4b69-9490-53dbc32e651b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:22.819595 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6743269e-fa33-4b69-9490-53dbc32e651b None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:22.820103 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6743269e-fa33-4b69-9490-53dbc32e651b None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:22.820570 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6743269e-fa33-4b69-9490-53dbc32e651b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:22.829086 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6743269e-fa33-4b69-9490-53dbc32e651b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:22.829246 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 311/621] 10.222.0.39 () {56 vars in 1133 bytes} [Mon Jul 18 10:23:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:22.830573 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d18f33-145a-4aea-b0f8-f48c5af131bb None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:22.830861 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d18f33-145a-4aea-b0f8-f48c5af131bb None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:22.831131 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d18f33-145a-4aea-b0f8-f48c5af131bb None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:22.831540 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6743269e-fa33-4b69-9490-53dbc32e651b None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:22.832568 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 312/622] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:23:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:23:22.836165 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d18f33-145a-4aea-b0f8-f48c5af131bb None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:22.847473 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-6743269e-fa33-4b69-9490-53dbc32e651b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 18 10:23:22.847473 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:22.847473 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:22.847473 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:22.847473 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:22.847473 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:22.847473 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:22.847473 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:22.847473 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:22.847473 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:22.847473 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:22.847473 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:22.847473 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:23:22.847473 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:23:22.847473 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:23:22.847473 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:23:22.848405 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:22.848405 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:22.848405 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:23:22.848405 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:23:22.848405 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:23:22.848405 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:23:22.848405 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:22.848405 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:22.848405 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:22.848405 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:22.848405 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:22.848405 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:22.848405 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:22.848405 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:22.848405 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:22.848405 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:22.848405 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:22.848405 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:22.849360 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:22.849360 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:22.849360 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:23:22.849360 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:23:22.849360 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:23:22.849360 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:23:22.849360 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:23:22.849360 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:23:22.849360 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 18 10:23:22.849360 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:22.851884 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 311/623] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 10:23:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:22.853313 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa222eac-1f69-461b-97d4-22ebdccca728 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:22.853795 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa222eac-1f69-461b-97d4-22ebdccca728 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:22.854276 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa222eac-1f69-461b-97d4-22ebdccca728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:22.871498 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-aa222eac-1f69-461b-97d4-22ebdccca728 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:23:22.872993 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-aa222eac-1f69-461b-97d4-22ebdccca728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:23:22.926263 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:22.949453 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d18f33-145a-4aea-b0f8-f48c5af131bb None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:22.955928 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 312/624] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:23:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:23:22.956887 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa222eac-1f69-461b-97d4-22ebdccca728 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:22.989922 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37042708-f47f-49eb-906e-1508b6bd6872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:22.990886 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37042708-f47f-49eb-906e-1508b6bd6872 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:22.991312 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37042708-f47f-49eb-906e-1508b6bd6872 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:22.991763 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37042708-f47f-49eb-906e-1508b6bd6872 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:22.993440 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:23.067266 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37042708-f47f-49eb-906e-1508b6bd6872 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:23.068925 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37042708-f47f-49eb-906e-1508b6bd6872 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:23.091933 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa222eac-1f69-461b-97d4-22ebdccca728 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:23.133550 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a90317-ade6-489f-a36e-b5ca379760bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:23.134236 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a90317-ade6-489f-a36e-b5ca379760bb None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:23.134499 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a90317-ade6-489f-a36e-b5ca379760bb None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:23.134777 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a90317-ade6-489f-a36e-b5ca379760bb None admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:23.135609 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a90317-ade6-489f-a36e-b5ca379760bb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:23.135914 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a90317-ade6-489f-a36e-b5ca379760bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:23.137355 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a90317-ade6-489f-a36e-b5ca379760bb None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:23.156630 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:23.157465 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 313/625] 10.222.0.39 () {56 vars in 1135 bytes} [Mon Jul 18 10:23:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:23.158165 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a90317-ade6-489f-a36e-b5ca379760bb None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:23.182565 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 313/626] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 10:23:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:23:23.183716 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37042708-f47f-49eb-906e-1508b6bd6872 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:23.244062 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:23.271674 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a90317-ade6-489f-a36e-b5ca379760bb None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:23.288192 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37042708-f47f-49eb-906e-1508b6bd6872 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:23.314679 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25253a2f-4014-4be5-a791-e1a1fe5b3c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:23.315411 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25253a2f-4014-4be5-a791-e1a1fe5b3c5d None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:23.315702 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25253a2f-4014-4be5-a791-e1a1fe5b3c5d None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:23.315975 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25253a2f-4014-4be5-a791-e1a1fe5b3c5d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:23.325256 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a34eb3f-5cae-4310-b498-6c909983324a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:23.326274 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34eb3f-5cae-4310-b498-6c909983324a None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:23.327245 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34eb3f-5cae-4310-b498-6c909983324a None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:23.327664 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34eb3f-5cae-4310-b498-6c909983324a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:23.328620 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25253a2f-4014-4be5-a791-e1a1fe5b3c5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:23:23.336830 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-25253a2f-4014-4be5-a791-e1a1fe5b3c5d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:23:23.336830 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:23.336830 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:23.336830 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:23.336830 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:23.336830 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:23.336830 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:23.336830 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:23.336830 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:23.336830 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:23.336830 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:23.336830 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:23.336830 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:23:23.336830 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:23:23.336830 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:23:23.336830 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:23:23.337974 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:23:23.337974 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:23:23.337974 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:23:23.337974 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:23:23.337974 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:23.337974 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:23.337974 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:23.337974 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:23.337974 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:23.337974 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:23.337974 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:23.337974 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:23.337974 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:23.337974 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:23.337974 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:23.337974 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:23.338974 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:23.338974 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:23.338974 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:23.338974 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:23.338974 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:23:23.338974 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:23:23.338974 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:23:23.338974 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:23:23.338974 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:23:23.338974 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:23:23.338974 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:23:23.338974 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:23.339795 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 314/627] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jul 18 10:23:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:23.340190 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25253a2f-4014-4be5-a791-e1a1fe5b3c5d None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:23.342743 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a34eb3f-5cae-4310-b498-6c909983324a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:23.344340 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a34eb3f-5cae-4310-b498-6c909983324a None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:23.363938 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-0a34eb3f-5cae-4310-b498-6c909983324a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:23.363938 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:23.363938 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:23.363938 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:23.363938 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:23.363938 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:23.363938 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:23.363938 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:23.363938 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:23.363938 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:23.363938 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:23.363938 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:23.363938 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:23.363938 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:23.363938 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:23.365092 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:23.365092 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:23.365092 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:23.365092 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:23.365092 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:23.365092 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:23.365092 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:23.365092 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:23.365092 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:23.365092 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:23.365092 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:23.365092 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:23.365092 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:23.365092 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:23.365092 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:23.365092 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:23.365092 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:23.366159 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:23.366159 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:23.366159 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:23.366159 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:23.367693 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 314/628] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:23.368682 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a34eb3f-5cae-4310-b498-6c909983324a None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:23.401237 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:23.462083 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25253a2f-4014-4be5-a791-e1a1fe5b3c5d None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:23.475278 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a34eb3f-5cae-4310-b498-6c909983324a None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:23.502833 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f59c887-ecd9-458a-9931-f0d6bb8d7357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:23.504004 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f59c887-ecd9-458a-9931-f0d6bb8d7357 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:23.504299 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f59c887-ecd9-458a-9931-f0d6bb8d7357 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:23.504738 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f59c887-ecd9-458a-9931-f0d6bb8d7357 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:23.508692 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:23.518279 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a55f2c-45e0-42d6-912e-4f5925b14570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:23.518519 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f59c887-ecd9-458a-9931-f0d6bb8d7357 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:23.519324 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a55f2c-45e0-42d6-912e-4f5925b14570 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:23.519756 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a55f2c-45e0-42d6-912e-4f5925b14570 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:23.520754 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f59c887-ecd9-458a-9931-f0d6bb8d7357 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:23.520861 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a55f2c-45e0-42d6-912e-4f5925b14570 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:23.521276 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a55f2c-45e0-42d6-912e-4f5925b14570 None admin] RBAC: Adding query filter params (name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:23.521724 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a55f2c-45e0-42d6-912e-4f5925b14570 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:23.523782 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a55f2c-45e0-42d6-912e-4f5925b14570 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:23.535614 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 315/629] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Jul 18 10:23:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:23.536647 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a55f2c-45e0-42d6-912e-4f5925b14570 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:23.542181 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-0f59c887-ecd9-458a-9931-f0d6bb8d7357 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:23.542181 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:23.542181 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:23.542181 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:23.542181 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:23.542181 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:23.542181 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:23.542181 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:23.542181 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:23.542181 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:23.542181 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:23.542181 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:23.542181 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:23.542181 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:23.542181 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:23.543111 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:23.543111 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:23.543111 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:23.543111 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:23.543111 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:23.543111 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:23.543111 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:23.543111 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:23.543111 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:23.543111 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:23.543111 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:23.543111 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:23.543111 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:23.543111 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:23.543111 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:23.543111 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:23.543111 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:23.544002 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:23.544002 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:23.544002 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:23.544002 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:23.544002 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 315/630] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:23.544285 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f59c887-ecd9-458a-9931-f0d6bb8d7357 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:23.651436 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:23.659821 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a55f2c-45e0-42d6-912e-4f5925b14570 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:23.663385 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f59c887-ecd9-458a-9931-f0d6bb8d7357 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:23.703712 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01d2c1-ceb6-44b7-ad91-9496fa49275e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:23.704544 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01d2c1-ceb6-44b7-ad91-9496fa49275e None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:23.704826 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01d2c1-ceb6-44b7-ad91-9496fa49275e None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:23.705150 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01d2c1-ceb6-44b7-ad91-9496fa49275e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:23.707314 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3bb788-eaf6-4d0d-a155-bb0037366546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:23.708294 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3bb788-eaf6-4d0d-a155-bb0037366546 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:23.708754 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3bb788-eaf6-4d0d-a155-bb0037366546 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:23.709235 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3bb788-eaf6-4d0d-a155-bb0037366546 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:23.710135 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3bb788-eaf6-4d0d-a155-bb0037366546 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:23.710619 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3bb788-eaf6-4d0d-a155-bb0037366546 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:23.712299 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3bb788-eaf6-4d0d-a155-bb0037366546 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:23.716528 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc01d2c1-ceb6-44b7-ad91-9496fa49275e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:23.718760 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc01d2c1-ceb6-44b7-ad91-9496fa49275e None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:23.731245 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 316/631] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:23.732403 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3bb788-eaf6-4d0d-a155-bb0037366546 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:23.739163 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-fc01d2c1-ceb6-44b7-ad91-9496fa49275e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:23.739163 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:23.739163 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:23.739163 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:23.739163 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:23.739163 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:23.739163 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:23.739163 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:23.739163 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:23.739163 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:23.739163 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:23.739163 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:23.739163 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:23.739163 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:23.739163 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:23.740080 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:23.740080 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:23.740080 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:23.740080 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:23.740080 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:23.740080 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:23.740080 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:23.740080 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:23.740080 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:23.740080 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:23.740080 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:23.740080 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:23.740080 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:23.740080 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:23.740080 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:23.740080 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:23.740080 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:23.740980 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:23.740980 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:23.740980 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:23.740980 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:23.740980 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 316/632] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:23.741539 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01d2c1-ceb6-44b7-ad91-9496fa49275e None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:23.793156 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:23.846989 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3bb788-eaf6-4d0d-a155-bb0037366546 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:23.862272 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01d2c1-ceb6-44b7-ad91-9496fa49275e None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:23.886709 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a484c7-595b-4e45-9879-2dd16126152c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:23.887378 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a484c7-595b-4e45-9879-2dd16126152c None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:23.887659 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a484c7-595b-4e45-9879-2dd16126152c None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:23.888012 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a484c7-595b-4e45-9879-2dd16126152c None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:23.888734 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a484c7-595b-4e45-9879-2dd16126152c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:23.889242 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a484c7-595b-4e45-9879-2dd16126152c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:23.891101 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a484c7-595b-4e45-9879-2dd16126152c None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:23.897441 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8952c686-1b5d-4440-969e-7fd162304af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:23.898350 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952c686-1b5d-4440-969e-7fd162304af7 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:23.898632 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952c686-1b5d-4440-969e-7fd162304af7 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:23.898899 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952c686-1b5d-4440-969e-7fd162304af7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:23.902720 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 317/633] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:23.903554 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a484c7-595b-4e45-9879-2dd16126152c None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:23.906531 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8952c686-1b5d-4440-969e-7fd162304af7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:23.907974 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8952c686-1b5d-4440-969e-7fd162304af7 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:23.921524 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:23.922603 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-8952c686-1b5d-4440-969e-7fd162304af7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:23:23.922603 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:23.922603 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:23.922603 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:23.922603 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:23.922603 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:23.922603 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:23.922603 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:23.922603 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:23.922603 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:23.922603 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:23.922603 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:23.922603 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:23:23.922603 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:23:23.922603 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:23:23.923566 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:23:23.923566 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:23.923566 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:23.923566 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:23.923566 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:23.923566 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:23.923566 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:23.923566 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:23.923566 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:23.923566 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:23.923566 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:23.923566 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:23.923566 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:23.923566 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:23.923566 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:23.923566 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:23.923566 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:23.924651 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:23:23.924651 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:23:23.924651 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:23:23.924651 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:23:23.924651 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:23:23.924651 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:23:23.924651 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:23:23.924651 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:23.924651 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 317/634] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 10:23:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:23.925356 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c01c6f-ad7f-4f60-9736-b1601cb32ee5 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:23.925540 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c01c6f-ad7f-4f60-9736-b1601cb32ee5 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:23.925814 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c01c6f-ad7f-4f60-9736-b1601cb32ee5 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:23.929027 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 318/635] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:23:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:23:23.929027 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd82cf-7750-4a0f-92dd-09a66fae151b None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:23.929027 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd82cf-7750-4a0f-92dd-09a66fae151b None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:23.929027 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd82cf-7750-4a0f-92dd-09a66fae151b None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:23.935847 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 319/636] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:23:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:23:23.935847 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd82cf-7750-4a0f-92dd-09a66fae151b None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:24.012242 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a484c7-595b-4e45-9879-2dd16126152c None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:24.026872 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:24.030948 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd82cf-7750-4a0f-92dd-09a66fae151b None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:24.051045 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d679c3c-e88a-4e6b-8be4-a9a32526844b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:24.052065 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d679c3c-e88a-4e6b-8be4-a9a32526844b None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:24.052459 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d679c3c-e88a-4e6b-8be4-a9a32526844b None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:24.052780 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d679c3c-e88a-4e6b-8be4-a9a32526844b None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:24.053548 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d679c3c-e88a-4e6b-8be4-a9a32526844b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:24.053856 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d679c3c-e88a-4e6b-8be4-a9a32526844b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:24.055401 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d679c3c-e88a-4e6b-8be4-a9a32526844b None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:24.069626 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c63ce6-c924-4abe-b6df-3ddcaa8bb379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:24.070321 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 318/637] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:24.070545 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c63ce6-c924-4abe-b6df-3ddcaa8bb379 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:24.070969 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c63ce6-c924-4abe-b6df-3ddcaa8bb379 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:24.071242 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c63ce6-c924-4abe-b6df-3ddcaa8bb379 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:24.071499 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d679c3c-e88a-4e6b-8be4-a9a32526844b None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:24.079831 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c63ce6-c924-4abe-b6df-3ddcaa8bb379 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:24.081657 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c63ce6-c924-4abe-b6df-3ddcaa8bb379 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:24.097307 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-a4c63ce6-c924-4abe-b6df-3ddcaa8bb379 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:23:24.097307 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:24.097307 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:24.097307 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:24.097307 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:24.097307 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:24.097307 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:24.097307 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:24.097307 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:24.097307 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:24.097307 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:24.097307 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:24.097307 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:23:24.097307 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:23:24.097307 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:23:24.098359 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:23:24.098359 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:24.098359 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:24.098359 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:24.098359 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:24.098359 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:24.098359 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:24.098359 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:24.098359 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:24.098359 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:24.098359 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:24.098359 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:24.098359 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:24.098359 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:24.098359 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:24.098359 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:24.098359 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:24.099322 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:23:24.099322 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:23:24.099322 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:23:24.099322 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:23:24.099322 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:23:24.099322 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:23:24.099322 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:23:24.099322 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:24.099322 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 320/638] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 10:23:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:24.100194 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c5ba3-4035-40c5-bfd3-9ce03ab8fed4 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:24.100194 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c5ba3-4035-40c5-bfd3-9ce03ab8fed4 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:24.100194 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198c5ba3-4035-40c5-bfd3-9ce03ab8fed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:24.117586 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-198c5ba3-4035-40c5-bfd3-9ce03ab8fed4 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:23:24.118785 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-198c5ba3-4035-40c5-bfd3-9ce03ab8fed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:23:24.152317 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:24.177299 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d679c3c-e88a-4e6b-8be4-a9a32526844b None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:24.187701 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 321/639] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:23:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:23:24.189146 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f8fb99-fc31-463c-9ef1-a744fe4e14eb None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:24.189437 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f8fb99-fc31-463c-9ef1-a744fe4e14eb None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:24.189721 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f8fb99-fc31-463c-9ef1-a744fe4e14eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:24.212725 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-e0f8fb99-fc31-463c-9ef1-a744fe4e14eb None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:23:24.213950 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-e0f8fb99-fc31-463c-9ef1-a744fe4e14eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:23:24.215719 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24707d45-1c99-47bf-8950-36a29a44000f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:24.216403 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24707d45-1c99-47bf-8950-36a29a44000f None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:24.216668 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24707d45-1c99-47bf-8950-36a29a44000f None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:24.216943 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24707d45-1c99-47bf-8950-36a29a44000f None admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:24.218324 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24707d45-1c99-47bf-8950-36a29a44000f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:24.218645 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24707d45-1c99-47bf-8950-36a29a44000f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:24.220055 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24707d45-1c99-47bf-8950-36a29a44000f None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:24.231526 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 319/640] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 10:23:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:24.232324 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24707d45-1c99-47bf-8950-36a29a44000f None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:24.286330 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 322/641] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:23:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:23:24.287158 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f8fb99-fc31-463c-9ef1-a744fe4e14eb None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:24.308553 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:24.330938 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24707d45-1c99-47bf-8950-36a29a44000f None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:24.363257 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9006cf5a-b1a1-4886-9f63-14795492f923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:24.364303 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006cf5a-b1a1-4886-9f63-14795492f923 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:24.364584 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006cf5a-b1a1-4886-9f63-14795492f923 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:24.364857 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006cf5a-b1a1-4886-9f63-14795492f923 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:24.367121 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:24.372933 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9006cf5a-b1a1-4886-9f63-14795492f923 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:24.375921 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9006cf5a-b1a1-4886-9f63-14795492f923 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:24.388681 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f8fb99-fc31-463c-9ef1-a744fe4e14eb None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:24.388847 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-9006cf5a-b1a1-4886-9f63-14795492f923 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 18 10:23:24.388847 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:24.388847 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:24.388847 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:24.388847 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:24.388847 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:24.388847 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:24.388847 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:24.388847 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:24.388847 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:24.388847 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:24.388847 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:24.388847 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:23:24.388847 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:23:24.388847 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:23:24.388847 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:23:24.395756 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:24.395756 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:24.395756 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:23:24.395756 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:23:24.395756 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:23:24.395756 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:23:24.395756 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:24.395756 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:24.395756 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:24.395756 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:24.395756 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:24.395756 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:24.395756 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:24.395756 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:24.395756 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:24.395756 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:24.395756 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:24.395756 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:24.396760 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:24.396760 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:24.396760 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:23:24.396760 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:23:24.396760 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:23:24.396760 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:23:24.396760 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:23:24.396760 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:23:24.396760 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 18 10:23:24.396760 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:24.396760 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 320/642] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 10:23:24 2022] GET /identity/v3/users/glance => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:24.396760 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9006cf5a-b1a1-4886-9f63-14795492f923 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:24.422841 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92375d7b-ce8d-45c6-b7ec-20818693157f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:24.423503 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92375d7b-ce8d-45c6-b7ec-20818693157f None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:24.423788 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92375d7b-ce8d-45c6-b7ec-20818693157f None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:24.424068 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92375d7b-ce8d-45c6-b7ec-20818693157f None admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:24.424849 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92375d7b-ce8d-45c6-b7ec-20818693157f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:24.425187 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92375d7b-ce8d-45c6-b7ec-20818693157f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:24.426629 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92375d7b-ce8d-45c6-b7ec-20818693157f None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:24.438908 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 323/643] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 10:23:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:24.439726 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92375d7b-ce8d-45c6-b7ec-20818693157f None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:24.496920 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9006cf5a-b1a1-4886-9f63-14795492f923 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:24.518448 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:24.531248 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c324c-f3bc-4828-b213-c346be521ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:24.532046 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c324c-f3bc-4828-b213-c346be521ca5 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:24.536023 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c324c-f3bc-4828-b213-c346be521ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:24.536023 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c324c-f3bc-4828-b213-c346be521ca5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:24.537003 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92375d7b-ce8d-45c6-b7ec-20818693157f None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:24.542750 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34c324c-f3bc-4828-b213-c346be521ca5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:23:24.551278 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-c34c324c-f3bc-4828-b213-c346be521ca5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:23:24.551278 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:24.551278 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:24.551278 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:24.551278 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:24.551278 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:24.551278 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:24.551278 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:24.551278 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:24.551278 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:24.551278 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:24.551278 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:24.551278 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:23:24.551278 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:23:24.551278 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:23:24.551278 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:23:24.552341 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:23:24.552341 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:23:24.552341 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:23:24.552341 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:23:24.552341 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:24.552341 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:24.552341 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:24.552341 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:24.552341 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:24.552341 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:24.552341 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:24.552341 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:24.552341 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:24.552341 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:24.552341 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:24.552341 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:24.558632 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:24.558632 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:24.558632 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:24.558632 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:24.558632 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:23:24.558632 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:23:24.558632 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:23:24.558632 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:23:24.558632 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:23:24.558632 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:23:24.558632 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:23:24.558632 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:24.558632 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 321/644] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jul 18 10:23:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:24.558632 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c324c-f3bc-4828-b213-c346be521ca5 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:24.571785 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32ca936-16b2-4b0e-96c0-52881574d366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:24.572673 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ca936-16b2-4b0e-96c0-52881574d366 None admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:24.572956 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ca936-16b2-4b0e-96c0-52881574d366 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:24.573265 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ca936-16b2-4b0e-96c0-52881574d366 None admin] PATH_INFO: `/v3/projects/a6098fe56d304980aa14bd95b4b92c17/users/2c548474a8d94591ba58dd40e40a28d2/roles/d151ec157a524341b7194453e46b6b25` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:24.586972 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32ca936-16b2-4b0e-96c0-52881574d366 None admin] RBAC: Authorizing `identity:create_grant(project_id=a6098fe56d304980aa14bd95b4b92c17, user_id=2c548474a8d94591ba58dd40e40a28d2, role_id=d151ec157a524341b7194453e46b6b25)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:24.588387 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32ca936-16b2-4b0e-96c0-52881574d366 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:24.611447 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:24.654885 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c324c-f3bc-4828-b213-c346be521ca5 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:24.688050 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2d8ca-a24d-4530-afca-9ab4dcd07d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:24.688845 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2d8ca-a24d-4530-afca-9ab4dcd07d5a None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:24.689203 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2d8ca-a24d-4530-afca-9ab4dcd07d5a None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:24.689431 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2d8ca-a24d-4530-afca-9ab4dcd07d5a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:24.699187 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b2d8ca-a24d-4530-afca-9ab4dcd07d5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:23:24.707130 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-11b2d8ca-a24d-4530-afca-9ab4dcd07d5a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:23:24.707130 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:24.707130 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:24.707130 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:24.707130 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:24.707130 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:24.707130 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:24.707130 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:24.707130 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:24.707130 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:24.707130 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:24.707130 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:24.707130 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:23:24.707130 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:23:24.707130 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:23:24.707130 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:23:24.708777 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:23:24.708777 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:23:24.708777 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:23:24.708777 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:23:24.708777 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:24.708777 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:24.708777 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:24.708777 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:24.708777 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:24.708777 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:24.708777 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:24.708777 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:24.708777 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:24.708777 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:24.708777 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:24.708777 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:24.710308 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:24.710308 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:24.710308 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:24.710308 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:24.710308 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:23:24.710308 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:23:24.710308 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:23:24.710308 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:23:24.710308 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:23:24.710308 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:23:24.710308 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:23:24.710308 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:24.710308 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 322/645] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jul 18 10:23:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:24.710308 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2d8ca-a24d-4530-afca-9ab4dcd07d5a None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:24.737642 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 324/646] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jul 18 10:23:24 2022] PUT /identity/v3/projects/a6098fe56d304980aa14bd95b4b92c17/users/2c548474a8d94591ba58dd40e40a28d2/roles/d151ec157a524341b7194453e46b6b25 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:23:24.738822 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32ca936-16b2-4b0e-96c0-52881574d366 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:24.831745 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2d8ca-a24d-4530-afca-9ab4dcd07d5a None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:24.846443 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:24.865949 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32ca936-16b2-4b0e-96c0-52881574d366 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:24.869183 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf3e058-0158-46f0-b9af-fd8fd027c884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:24.869871 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3e058-0158-46f0-b9af-fd8fd027c884 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:24.870177 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3e058-0158-46f0-b9af-fd8fd027c884 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:24.870476 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf3e058-0158-46f0-b9af-fd8fd027c884 None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:24.871329 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf3e058-0158-46f0-b9af-fd8fd027c884 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:24.871633 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf3e058-0158-46f0-b9af-fd8fd027c884 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:24.873128 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf3e058-0158-46f0-b9af-fd8fd027c884 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:24.899935 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 323/647] 10.222.0.39 () {56 vars in 1137 bytes} [Mon Jul 18 10:23:24 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:24.900618 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf3e058-0158-46f0-b9af-fd8fd027c884 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:24.905598 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:24.914571 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8adf0b-51d7-460a-a5f2-b12df17ea226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:24.915248 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8adf0b-51d7-460a-a5f2-b12df17ea226 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:24.921477 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8adf0b-51d7-460a-a5f2-b12df17ea226 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:24.921477 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8adf0b-51d7-460a-a5f2-b12df17ea226 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:24.921477 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8adf0b-51d7-460a-a5f2-b12df17ea226 None admin] RBAC: Adding query filter params (role.id=d151ec157a524341b7194453e46b6b25, scope.project.id=a6098fe56d304980aa14bd95b4b92c17, user.id=8bbebf16219943879df84bdc9a900516) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:24.921477 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8adf0b-51d7-460a-a5f2-b12df17ea226 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:24.921477 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8adf0b-51d7-460a-a5f2-b12df17ea226 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:24.926099 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 325/648] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 10:23:24 2022] GET /identity/v3/role_assignments?user.id=8bbebf16219943879df84bdc9a900516&scope.project.id=a6098fe56d304980aa14bd95b4b92c17&role.id=d151ec157a524341b7194453e46b6b25 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:24.926099 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8adf0b-51d7-460a-a5f2-b12df17ea226 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:25.033525 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf3e058-0158-46f0-b9af-fd8fd027c884 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:25.056263 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8adf0b-51d7-460a-a5f2-b12df17ea226 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:25.074204 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce66a72-7e5e-436e-8631-a07a7f2428a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:25.074985 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce66a72-7e5e-436e-8631-a07a7f2428a2 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:25.075339 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce66a72-7e5e-436e-8631-a07a7f2428a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:25.075685 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce66a72-7e5e-436e-8631-a07a7f2428a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:25.077354 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce66a72-7e5e-436e-8631-a07a7f2428a2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:25.078132 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce66a72-7e5e-436e-8631-a07a7f2428a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:25.079604 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce66a72-7e5e-436e-8631-a07a7f2428a2 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:25.090215 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 324/649] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Jul 18 10:23:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:25.091280 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce66a72-7e5e-436e-8631-a07a7f2428a2 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:25.097147 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e481a3-692a-4ccf-8f26-f9f2ffb89fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:25.097921 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e481a3-692a-4ccf-8f26-f9f2ffb89fe4 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:25.098301 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e481a3-692a-4ccf-8f26-f9f2ffb89fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:25.098704 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e481a3-692a-4ccf-8f26-f9f2ffb89fe4 None admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:25.099549 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e481a3-692a-4ccf-8f26-f9f2ffb89fe4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:25.099981 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e481a3-692a-4ccf-8f26-f9f2ffb89fe4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:25.101588 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e481a3-692a-4ccf-8f26-f9f2ffb89fe4 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:25.113090 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 326/650] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Jul 18 10:23:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:25.117960 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e481a3-692a-4ccf-8f26-f9f2ffb89fe4 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:25.135584 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:25.198716 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:25.224448 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce66a72-7e5e-436e-8631-a07a7f2428a2 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:25.250644 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e481a3-692a-4ccf-8f26-f9f2ffb89fe4 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:25.271326 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf92624a-a7cf-49a4-83a3-2d7cefaac6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:25.271987 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92624a-a7cf-49a4-83a3-2d7cefaac6ea None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:25.272273 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92624a-a7cf-49a4-83a3-2d7cefaac6ea None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:25.272551 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92624a-a7cf-49a4-83a3-2d7cefaac6ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:25.289403 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce86b80-614d-4987-8494-261ae7097178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:25.290523 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce86b80-614d-4987-8494-261ae7097178 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:25.291021 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce86b80-614d-4987-8494-261ae7097178 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:25.291479 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce86b80-614d-4987-8494-261ae7097178 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:25.308485 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce86b80-614d-4987-8494-261ae7097178 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:25.310611 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce86b80-614d-4987-8494-261ae7097178 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:25.340612 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-8ce86b80-614d-4987-8494-261ae7097178 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:25.340612 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:25.340612 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:25.340612 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:25.340612 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:25.340612 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:25.340612 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:25.340612 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:25.340612 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:25.340612 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:25.340612 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:25.340612 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:25.340612 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:25.340612 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:25.340612 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:25.341617 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:25.341617 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:25.341617 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:25.341617 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:25.341617 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:25.341617 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:25.341617 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:25.341617 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:25.341617 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:25.341617 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:25.341617 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:25.341617 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:25.341617 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:25.341617 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:25.341617 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:25.341617 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:25.341617 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:25.343082 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:25.343082 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:25.343082 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:25.343082 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:25.343756 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 327/651] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:25.344370 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce86b80-614d-4987-8494-261ae7097178 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:25.359105 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf92624a-a7cf-49a4-83a3-2d7cefaac6ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:25.361246 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf92624a-a7cf-49a4-83a3-2d7cefaac6ea None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:25.396614 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:25.463295 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce86b80-614d-4987-8494-261ae7097178 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:25.466661 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 325/652] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 10:23:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:23:25.467496 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf92624a-a7cf-49a4-83a3-2d7cefaac6ea None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:25.473899 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:25.504915 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30937fe-cbba-49c4-80f7-da0bb02cde6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:25.506104 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30937fe-cbba-49c4-80f7-da0bb02cde6c None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:25.506587 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30937fe-cbba-49c4-80f7-da0bb02cde6c None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:25.507037 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30937fe-cbba-49c4-80f7-da0bb02cde6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:25.519347 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30937fe-cbba-49c4-80f7-da0bb02cde6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:25.521274 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30937fe-cbba-49c4-80f7-da0bb02cde6c None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:25.540098 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-e30937fe-cbba-49c4-80f7-da0bb02cde6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:25.540098 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:25.540098 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:25.540098 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:25.540098 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:25.540098 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:25.540098 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:25.540098 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:25.540098 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:25.540098 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:25.540098 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:25.540098 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:25.540098 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:25.540098 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:25.540098 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:25.541229 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:25.541229 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:25.541229 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:25.541229 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:25.541229 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:25.541229 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:25.541229 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:25.541229 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:25.541229 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:25.541229 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:25.541229 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:25.541229 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:25.541229 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:25.541229 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:25.541229 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:25.541229 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:25.541229 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:25.542257 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:25.542257 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:25.542257 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:25.542257 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:25.542257 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 328/653] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:25.542544 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30937fe-cbba-49c4-80f7-da0bb02cde6c None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:25.575803 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf92624a-a7cf-49a4-83a3-2d7cefaac6ea None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:25.610408 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b5f139-897c-475a-bf94-ba35d1167e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:25.611191 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b5f139-897c-475a-bf94-ba35d1167e4d None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:25.611540 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b5f139-897c-475a-bf94-ba35d1167e4d None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:25.611915 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b5f139-897c-475a-bf94-ba35d1167e4d None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:25.612715 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b5f139-897c-475a-bf94-ba35d1167e4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:25.613137 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b5f139-897c-475a-bf94-ba35d1167e4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:25.614834 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b5f139-897c-475a-bf94-ba35d1167e4d None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:25.627845 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 326/654] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:25.628762 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b5f139-897c-475a-bf94-ba35d1167e4d None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:25.633333 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:25.681347 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30937fe-cbba-49c4-80f7-da0bb02cde6c None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:25.716358 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1570269-b053-4743-8774-7b7661572d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:25.717920 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1570269-b053-4743-8774-7b7661572d02 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:25.718305 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1570269-b053-4743-8774-7b7661572d02 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:25.718668 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1570269-b053-4743-8774-7b7661572d02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:25.729803 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1570269-b053-4743-8774-7b7661572d02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:25.731388 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1570269-b053-4743-8774-7b7661572d02 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:25.740376 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b5f139-897c-475a-bf94-ba35d1167e4d None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:25.750795 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-f1570269-b053-4743-8774-7b7661572d02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:25.750795 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:25.750795 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:25.750795 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:25.750795 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:25.750795 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:25.750795 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:25.750795 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:25.750795 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:25.750795 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:25.750795 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:25.750795 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:25.750795 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:25.750795 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:25.750795 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:25.751901 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:25.751901 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:25.751901 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:25.751901 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:25.751901 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:25.751901 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:25.751901 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:25.751901 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:25.751901 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:25.751901 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:25.751901 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:25.751901 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:25.751901 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:25.751901 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:25.751901 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:25.751901 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:25.751901 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:25.752990 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:25.752990 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:25.752990 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:25.752990 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:25.754243 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 329/655] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:25.755097 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1570269-b053-4743-8774-7b7661572d02 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:25.771209 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:25.778471 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be81eb-984a-4bb9-88ee-79f01db9ab76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:25.779154 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be81eb-984a-4bb9-88ee-79f01db9ab76 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:25.779956 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be81eb-984a-4bb9-88ee-79f01db9ab76 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:25.780312 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be81eb-984a-4bb9-88ee-79f01db9ab76 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:25.781231 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88be81eb-984a-4bb9-88ee-79f01db9ab76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:25.781544 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88be81eb-984a-4bb9-88ee-79f01db9ab76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:25.782979 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88be81eb-984a-4bb9-88ee-79f01db9ab76 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:25.800791 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 327/656] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:25.800791 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be81eb-984a-4bb9-88ee-79f01db9ab76 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:25.861487 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:25.869213 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1570269-b053-4743-8774-7b7661572d02 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:25.901855 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be81eb-984a-4bb9-88ee-79f01db9ab76 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:25.906750 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac918e5a-9e5f-42e1-b7b9-e0db67ee1ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:25.907837 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac918e5a-9e5f-42e1-b7b9-e0db67ee1ad2 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:25.908328 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac918e5a-9e5f-42e1-b7b9-e0db67ee1ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:25.908796 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac918e5a-9e5f-42e1-b7b9-e0db67ee1ad2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:25.916651 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac918e5a-9e5f-42e1-b7b9-e0db67ee1ad2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:25.918360 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac918e5a-9e5f-42e1-b7b9-e0db67ee1ad2 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:25.934264 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-ac918e5a-9e5f-42e1-b7b9-e0db67ee1ad2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 10:23:25.934264 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:25.934264 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:25.934264 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:25.934264 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:25.934264 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:25.934264 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:25.934264 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:25.934264 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:25.934264 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:25.934264 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:25.934264 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:25.934264 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:23:25.934264 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:23:25.934264 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:23:25.934264 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:23:25.935292 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:25.935292 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:25.935292 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:23:25.935292 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:23:25.935292 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:23:25.935292 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:23:25.935292 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:25.935292 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:25.935292 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:25.935292 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:25.935292 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:25.935292 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:25.935292 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:25.935292 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:25.935292 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:25.935292 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:25.935292 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:25.935292 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:25.936772 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:25.936772 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:25.936772 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:23:25.936772 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:23:25.936772 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:23:25.936772 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:23:25.936772 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:23:25.936772 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:23:25.936772 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 10:23:25.936772 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:25.939550 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 330/657] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 10:23:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:25.940641 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac918e5a-9e5f-42e1-b7b9-e0db67ee1ad2 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:25.945486 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb0a17-042b-4e21-b2f4-36c5364283ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:25.946245 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb0a17-042b-4e21-b2f4-36c5364283ab None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:25.946565 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb0a17-042b-4e21-b2f4-36c5364283ab None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:25.946861 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cb0a17-042b-4e21-b2f4-36c5364283ab None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:25.947592 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cb0a17-042b-4e21-b2f4-36c5364283ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:25.947960 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cb0a17-042b-4e21-b2f4-36c5364283ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:25.950234 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cb0a17-042b-4e21-b2f4-36c5364283ab None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:25.964036 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 328/658] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:25.964840 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb0a17-042b-4e21-b2f4-36c5364283ab None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:26.025019 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:26.057343 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac918e5a-9e5f-42e1-b7b9-e0db67ee1ad2 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:26.098057 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cb0a17-042b-4e21-b2f4-36c5364283ab None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:26.100006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb02d184-5aa2-4378-a4f4-b21cd75fba8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:26.101070 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb02d184-5aa2-4378-a4f4-b21cd75fba8f None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:26.103579 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb02d184-5aa2-4378-a4f4-b21cd75fba8f None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:26.104080 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb02d184-5aa2-4378-a4f4-b21cd75fba8f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:26.112969 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb02d184-5aa2-4378-a4f4-b21cd75fba8f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:26.114976 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb02d184-5aa2-4378-a4f4-b21cd75fba8f None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:26.119424 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:26.136401 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-fb02d184-5aa2-4378-a4f4-b21cd75fba8f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 18 10:23:26.136401 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:26.136401 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:26.136401 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:26.136401 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:26.136401 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:26.136401 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:26.136401 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:26.136401 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:26.136401 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:26.136401 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:26.136401 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:26.136401 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:23:26.136401 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:23:26.136401 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:23:26.136401 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:23:26.137370 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:26.137370 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:26.137370 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:23:26.137370 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:23:26.137370 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:23:26.137370 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:23:26.137370 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:26.137370 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:26.137370 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:26.137370 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:26.137370 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:26.137370 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:26.137370 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:26.137370 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:26.137370 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:26.137370 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:26.137370 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:26.137370 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:26.138411 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:26.138411 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:26.138411 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:23:26.138411 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:23:26.138411 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:23:26.138411 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:23:26.138411 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:23:26.138411 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:23:26.138411 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 18 10:23:26.138411 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:26.139020 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 331/659] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jul 18 10:23:25 2022] GET /identity/v3/users/neutron => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:26.144307 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb02d184-5aa2-4378-a4f4-b21cd75fba8f None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:26.151298 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea10713-180f-4172-861c-34b3b4c0dcce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:26.151981 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea10713-180f-4172-861c-34b3b4c0dcce None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:26.152264 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea10713-180f-4172-861c-34b3b4c0dcce None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:26.152541 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea10713-180f-4172-861c-34b3b4c0dcce None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:26.153420 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea10713-180f-4172-861c-34b3b4c0dcce None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:26.153731 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea10713-180f-4172-861c-34b3b4c0dcce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:26.155835 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea10713-180f-4172-861c-34b3b4c0dcce None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:26.178710 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 329/660] 10.222.0.39 () {56 vars in 1137 bytes} [Mon Jul 18 10:23:25 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:26.179777 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea10713-180f-4172-861c-34b3b4c0dcce None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:26.276635 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb02d184-5aa2-4378-a4f4-b21cd75fba8f None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:26.312660 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea10713-180f-4172-861c-34b3b4c0dcce None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:26.317077 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:26.324053 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46133b6-6399-4a0c-aa0f-4a2bfe80887c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:26.325542 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46133b6-6399-4a0c-aa0f-4a2bfe80887c None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:26.326018 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46133b6-6399-4a0c-aa0f-4a2bfe80887c None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:26.335654 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46133b6-6399-4a0c-aa0f-4a2bfe80887c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:26.336639 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46133b6-6399-4a0c-aa0f-4a2bfe80887c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:26.339210 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46133b6-6399-4a0c-aa0f-4a2bfe80887c None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:26.349623 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9825c0-d253-4c58-8768-004696cbc75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:26.350420 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9825c0-d253-4c58-8768-004696cbc75a None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:26.350806 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9825c0-d253-4c58-8768-004696cbc75a None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:26.351184 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9825c0-d253-4c58-8768-004696cbc75a None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:26.352124 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9825c0-d253-4c58-8768-004696cbc75a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:26.352539 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9825c0-d253-4c58-8768-004696cbc75a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:26.354211 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9825c0-d253-4c58-8768-004696cbc75a None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:26.360492 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-b46133b6-6399-4a0c-aa0f-4a2bfe80887c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:23:26.360492 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:26.360492 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:26.360492 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:26.360492 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:26.360492 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:26.360492 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:26.360492 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:26.360492 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:26.360492 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:26.360492 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:26.360492 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:26.360492 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:23:26.360492 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:23:26.360492 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:23:26.361639 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:23:26.361639 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:26.361639 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:26.361639 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:26.361639 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:26.361639 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:26.361639 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:26.361639 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:26.361639 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:26.361639 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:26.361639 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:26.361639 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:26.361639 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:26.361639 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:26.361639 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:26.361639 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:26.361639 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:26.362685 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:23:26.362685 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:23:26.362685 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:23:26.362685 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:23:26.362685 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:23:26.362685 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:23:26.362685 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:23:26.362685 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:26.365297 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 332/661] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 10:23:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:26.366054 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46133b6-6399-4a0c-aa0f-4a2bfe80887c None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:26.383370 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 330/662] 10.222.0.39 () {56 vars in 1139 bytes} [Mon Jul 18 10:23:26 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:26.383370 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9825c0-d253-4c58-8768-004696cbc75a None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:26.416839 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:26.490830 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9825c0-d253-4c58-8768-004696cbc75a None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:26.502915 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46133b6-6399-4a0c-aa0f-4a2bfe80887c None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:26.534878 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f87a4-f02c-4e39-a672-08bd39d09afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:26.536146 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f87a4-f02c-4e39-a672-08bd39d09afb None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:26.536630 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f87a4-f02c-4e39-a672-08bd39d09afb None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:26.537164 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f87a4-f02c-4e39-a672-08bd39d09afb None admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:26.538277 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883f87a4-f02c-4e39-a672-08bd39d09afb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:26.538788 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883f87a4-f02c-4e39-a672-08bd39d09afb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:26.539695 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cec673-394d-457e-91ad-bcd96ff91f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:26.540459 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cec673-394d-457e-91ad-bcd96ff91f7f None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:26.540779 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883f87a4-f02c-4e39-a672-08bd39d09afb None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:26.540891 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cec673-394d-457e-91ad-bcd96ff91f7f None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:26.541318 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cec673-394d-457e-91ad-bcd96ff91f7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:26.556038 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 331/663] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 10:23:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:26.557277 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f87a4-f02c-4e39-a672-08bd39d09afb None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:26.606555 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:26.618258 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cec673-394d-457e-91ad-bcd96ff91f7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:26.619982 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cec673-394d-457e-91ad-bcd96ff91f7f None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:26.674469 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:26.687043 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f87a4-f02c-4e39-a672-08bd39d09afb None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:26.730333 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638a9c5f-fa55-40cb-9304-3164b9fc46c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:26.731283 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a9c5f-fa55-40cb-9304-3164b9fc46c5 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:26.731772 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a9c5f-fa55-40cb-9304-3164b9fc46c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:26.732191 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a9c5f-fa55-40cb-9304-3164b9fc46c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:26.736004 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 333/664] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 10:23:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:23:26.737734 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cec673-394d-457e-91ad-bcd96ff91f7f None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:26.833015 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638a9c5f-fa55-40cb-9304-3164b9fc46c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:26.835120 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638a9c5f-fa55-40cb-9304-3164b9fc46c5 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:26.841489 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:26.851703 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cec673-394d-457e-91ad-bcd96ff91f7f None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:26.891057 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d5c075-2403-4531-8865-e167b960edc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:26.892111 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5c075-2403-4531-8865-e167b960edc4 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:26.892636 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5c075-2403-4531-8865-e167b960edc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:26.893150 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5c075-2403-4531-8865-e167b960edc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:26.894214 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d5c075-2403-4531-8865-e167b960edc4 None admin] RBAC: Adding query filter params (role.id=d151ec157a524341b7194453e46b6b25, scope.project.id=a6098fe56d304980aa14bd95b4b92c17, user.id=48d1f7d0286745a396905aee50c9410b) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:26.894789 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d5c075-2403-4531-8865-e167b960edc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:26.896428 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d5c075-2403-4531-8865-e167b960edc4 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:26.903101 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 334/665] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 10:23:26 2022] GET /identity/v3/role_assignments?user.id=48d1f7d0286745a396905aee50c9410b&scope.project.id=a6098fe56d304980aa14bd95b4b92c17&role.id=d151ec157a524341b7194453e46b6b25 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:26.904447 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d5c075-2403-4531-8865-e167b960edc4 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:26.957436 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:26.973582 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 332/666] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 10:23:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:23:26.977509 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3726c13-f0b6-4d56-abf8-d1a2cd2cde27 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:26.978123 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3726c13-f0b6-4d56-abf8-d1a2cd2cde27 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:26.978571 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3726c13-f0b6-4d56-abf8-d1a2cd2cde27 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:26.980291 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 333/667] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:23:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:23:26.983844 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3726c13-f0b6-4d56-abf8-d1a2cd2cde27 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:27.056700 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d5c075-2403-4531-8865-e167b960edc4 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:27.117104 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e35e9e-aae3-498b-a872-c36e8cc28c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:27.117929 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e35e9e-aae3-498b-a872-c36e8cc28c9c None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:27.118214 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e35e9e-aae3-498b-a872-c36e8cc28c9c None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:27.118486 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e35e9e-aae3-498b-a872-c36e8cc28c9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:27.122667 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3726c13-f0b6-4d56-abf8-d1a2cd2cde27 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:27.131576 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e35e9e-aae3-498b-a872-c36e8cc28c9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:27.133196 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e35e9e-aae3-498b-a872-c36e8cc28c9c None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:27.157980 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-81e35e9e-aae3-498b-a872-c36e8cc28c9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:27.157980 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:27.157980 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:27.157980 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:27.157980 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:27.157980 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:27.157980 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:27.157980 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:27.157980 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:27.157980 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:27.157980 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:27.157980 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:27.157980 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:27.157980 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:27.157980 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:27.158884 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:27.158884 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:27.158884 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:27.158884 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:27.158884 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:27.158884 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:27.158884 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:27.158884 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:27.158884 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:27.158884 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:27.158884 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:27.158884 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:27.158884 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:27.158884 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:27.158884 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:27.158884 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:27.158884 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:27.160437 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:27.160437 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:27.160437 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:27.160437 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:27.160437 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 335/668] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:27.160709 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd996279-d1d0-434b-8f58-abf91a2f61b2 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:27.161264 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd996279-d1d0-434b-8f58-abf91a2f61b2 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:27.161264 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd996279-d1d0-434b-8f58-abf91a2f61b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:27.171890 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5039e43-3957-40e5-aae7-16e0d09407b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:27.172841 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5039e43-3957-40e5-aae7-16e0d09407b1 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:27.173032 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5039e43-3957-40e5-aae7-16e0d09407b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:27.173280 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5039e43-3957-40e5-aae7-16e0d09407b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:27.180049 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-fd996279-d1d0-434b-8f58-abf91a2f61b2 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:23:27.181400 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-fd996279-d1d0-434b-8f58-abf91a2f61b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:23:27.183453 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:27.184292 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5039e43-3957-40e5-aae7-16e0d09407b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:27.185988 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5039e43-3957-40e5-aae7-16e0d09407b1 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:27.205238 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-f5039e43-3957-40e5-aae7-16e0d09407b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:27.205238 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:27.205238 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:27.205238 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:27.205238 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:27.205238 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:27.205238 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:27.205238 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:27.205238 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:27.205238 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:27.205238 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:27.205238 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:27.205238 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:27.205238 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:27.205238 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:27.206401 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:27.206401 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:27.206401 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:27.206401 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:27.206401 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:27.206401 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:27.206401 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:27.206401 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:27.206401 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:27.206401 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:27.206401 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:27.206401 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:27.206401 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:27.206401 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:27.206401 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:27.206401 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:27.206401 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:27.207325 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:27.207325 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:27.207325 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:27.207325 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:27.207325 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 334/669] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:27.207325 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5039e43-3957-40e5-aae7-16e0d09407b1 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:27.254711 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:27.268169 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 336/670] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:23:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:23:27.268169 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147400a-5aa8-4c36-991c-222e37d58958 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:27.268169 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147400a-5aa8-4c36-991c-222e37d58958 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:27.268169 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147400a-5aa8-4c36-991c-222e37d58958 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:27.268169 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 337/671] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:23:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:23:27.269474 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8147400a-5aa8-4c36-991c-222e37d58958 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:27.323065 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5039e43-3957-40e5-aae7-16e0d09407b1 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:27.359866 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec07387-69f0-43b4-84b4-59c91a039762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:27.360548 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec07387-69f0-43b4-84b4-59c91a039762 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:27.360830 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec07387-69f0-43b4-84b4-59c91a039762 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:27.361139 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec07387-69f0-43b4-84b4-59c91a039762 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:27.361873 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec07387-69f0-43b4-84b4-59c91a039762 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:27.362184 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec07387-69f0-43b4-84b4-59c91a039762 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:27.363787 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec07387-69f0-43b4-84b4-59c91a039762 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:27.376943 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 335/672] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:27.378326 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f693c-1fe5-4c7c-98b6-53dab8b3cb1e None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:27.378704 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f693c-1fe5-4c7c-98b6-53dab8b3cb1e None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:27.379050 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f693c-1fe5-4c7c-98b6-53dab8b3cb1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:27.393693 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8147400a-5aa8-4c36-991c-222e37d58958 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:27.396557 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-af1f693c-1fe5-4c7c-98b6-53dab8b3cb1e None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:23:27.397790 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-af1f693c-1fe5-4c7c-98b6-53dab8b3cb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:23:27.429951 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c59af-c620-474b-baee-b15b6fde0e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:27.430592 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c59af-c620-474b-baee-b15b6fde0e12 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:27.430814 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c59af-c620-474b-baee-b15b6fde0e12 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:27.431086 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c59af-c620-474b-baee-b15b6fde0e12 None admin] PATH_INFO: `/v3/domains` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:27.431805 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c59af-c620-474b-baee-b15b6fde0e12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:27.432107 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c59af-c620-474b-baee-b15b6fde0e12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:27.433512 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c59af-c620-474b-baee-b15b6fde0e12 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:27.440652 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:27.450491 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 338/673] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:27.450491 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c59af-c620-474b-baee-b15b6fde0e12 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:27.489108 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 336/674] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:23:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:23:27.489108 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f693c-1fe5-4c7c-98b6-53dab8b3cb1e None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:27.523516 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:27.563839 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c59af-c620-474b-baee-b15b6fde0e12 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:27.598627 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f693c-1fe5-4c7c-98b6-53dab8b3cb1e None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:27.603941 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde175ea-5327-455e-b91e-1294a62bddfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:27.604923 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde175ea-5327-455e-b91e-1294a62bddfa None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:27.605405 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde175ea-5327-455e-b91e-1294a62bddfa None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:27.605846 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde175ea-5327-455e-b91e-1294a62bddfa None admin] PATH_INFO: `/v3/roles/service` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:27.618690 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde175ea-5327-455e-b91e-1294a62bddfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:23:27.627175 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-bde175ea-5327-455e-b91e-1294a62bddfa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:23:27.627175 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:27.627175 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:27.627175 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:27.627175 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:27.627175 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:27.627175 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:27.627175 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:27.627175 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:27.627175 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:27.627175 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:27.627175 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:27.627175 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:23:27.627175 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:23:27.627175 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:23:27.627175 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:23:27.628232 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:23:27.628232 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:23:27.628232 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:23:27.628232 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:23:27.628232 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:27.628232 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:27.628232 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:27.628232 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:27.628232 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:27.628232 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:27.628232 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:27.628232 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:27.628232 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:27.628232 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:27.628232 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:27.628232 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:27.629250 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:27.629250 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:27.629250 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:27.629250 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:27.629250 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:23:27.629250 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:23:27.629250 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:23:27.629250 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:23:27.629250 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:23:27.629250 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:23:27.629250 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:23:27.629250 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:27.635922 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 339/675] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jul 18 10:23:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:27.635922 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde175ea-5327-455e-b91e-1294a62bddfa None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:27.637740 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e5a944-3b5b-4124-acf2-9c48143e2af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:27.638773 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5a944-3b5b-4124-acf2-9c48143e2af2 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:27.639755 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5a944-3b5b-4124-acf2-9c48143e2af2 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:27.640033 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5a944-3b5b-4124-acf2-9c48143e2af2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:27.647034 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e5a944-3b5b-4124-acf2-9c48143e2af2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:27.648470 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e5a944-3b5b-4124-acf2-9c48143e2af2 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:27.663220 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-70e5a944-3b5b-4124-acf2-9c48143e2af2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:23:27.663220 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:27.663220 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:27.663220 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:27.663220 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:27.663220 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:27.663220 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:27.663220 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:27.663220 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:27.663220 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:27.663220 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:27.663220 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:27.663220 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:23:27.663220 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:23:27.663220 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:23:27.664302 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:23:27.664302 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:27.664302 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:27.664302 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:27.664302 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:27.664302 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:27.664302 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:27.664302 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:27.664302 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:27.664302 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:27.664302 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:27.664302 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:27.664302 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:27.664302 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:27.664302 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:27.664302 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:27.664302 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:27.665439 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:23:27.665439 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:23:27.665439 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:23:27.665439 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:23:27.665439 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:23:27.665439 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:23:27.665439 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:23:27.665439 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:27.669192 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 337/676] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 10:23:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:27.669941 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e5a944-3b5b-4124-acf2-9c48143e2af2 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:27.702098 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:27.745718 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde175ea-5327-455e-b91e-1294a62bddfa None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:27.770800 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:27.780191 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e5a944-3b5b-4124-acf2-9c48143e2af2 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:27.781728 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5155d6d3-5c18-45a8-acce-a907fcbd4dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:27.782537 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5155d6d3-5c18-45a8-acce-a907fcbd4dd7 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:27.782822 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5155d6d3-5c18-45a8-acce-a907fcbd4dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:27.783088 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5155d6d3-5c18-45a8-acce-a907fcbd4dd7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:27.790110 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5155d6d3-5c18-45a8-acce-a907fcbd4dd7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:27.791545 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5155d6d3-5c18-45a8-acce-a907fcbd4dd7 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:27.806921 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-5155d6d3-5c18-45a8-acce-a907fcbd4dd7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:23:27.806921 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:27.806921 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:27.806921 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:27.806921 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:27.806921 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:27.806921 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:27.806921 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:27.806921 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:27.806921 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:27.806921 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:27.806921 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:27.806921 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:23:27.806921 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:23:27.806921 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:23:27.808016 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:23:27.808016 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:27.808016 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:27.808016 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:27.808016 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:27.808016 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:27.808016 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:27.808016 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:27.808016 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:27.808016 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:27.808016 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:27.808016 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:27.808016 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:27.808016 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:27.808016 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:27.808016 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:27.808016 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:27.808924 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:23:27.808924 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:23:27.808924 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:23:27.808924 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:23:27.808924 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:23:27.808924 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:23:27.808924 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:23:27.808924 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:27.808924 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 340/677] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 10:23:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:27.808924 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5155d6d3-5c18-45a8-acce-a907fcbd4dd7 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:27.822107 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82aef76-1b45-4aee-8623-fe7e4437202f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:27.822910 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82aef76-1b45-4aee-8623-fe7e4437202f None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:27.823197 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82aef76-1b45-4aee-8623-fe7e4437202f None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:27.823469 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82aef76-1b45-4aee-8623-fe7e4437202f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:27.834601 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82aef76-1b45-4aee-8623-fe7e4437202f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:23:27.843137 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-e82aef76-1b45-4aee-8623-fe7e4437202f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:23:27.843137 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:27.843137 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:27.843137 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:27.843137 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:27.843137 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:27.843137 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:27.843137 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:27.843137 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:27.843137 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:27.843137 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:27.843137 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:27.843137 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:23:27.843137 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:23:27.843137 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:23:27.843137 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:23:27.844054 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:23:27.844054 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:23:27.844054 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:23:27.844054 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:23:27.844054 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:27.844054 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:27.844054 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:27.844054 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:27.844054 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:27.844054 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:27.844054 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:27.844054 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:27.844054 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:27.844054 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:27.844054 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:27.844054 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:27.844880 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:27.844880 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:27.844880 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:27.844880 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:27.844880 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:23:27.844880 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:23:27.844880 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:23:27.844880 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:23:27.844880 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:23:27.844880 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:23:27.844880 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:23:27.844880 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:27.844880 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 338/678] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 10:23:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:27.845607 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82aef76-1b45-4aee-8623-fe7e4437202f None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:27.924220 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5155d6d3-5c18-45a8-acce-a907fcbd4dd7 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:27.943764 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:27.959524 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82aef76-1b45-4aee-8623-fe7e4437202f None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:27.964882 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b90af76-255e-4d32-90df-3d3de835d09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:27.965584 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b90af76-255e-4d32-90df-3d3de835d09b None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:27.965869 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b90af76-255e-4d32-90df-3d3de835d09b None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:27.966145 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b90af76-255e-4d32-90df-3d3de835d09b None admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:27.967672 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b90af76-255e-4d32-90df-3d3de835d09b None admin] RBAC: Adding query filter params (name=service) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:27.967979 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b90af76-255e-4d32-90df-3d3de835d09b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:27.970152 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b90af76-255e-4d32-90df-3d3de835d09b None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:27.985442 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 341/679] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Jul 18 10:23:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:27.985442 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b90af76-255e-4d32-90df-3d3de835d09b None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:27.994906 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273dcf4-22f2-401c-b40f-8b33ff82ef98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:27.995580 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273dcf4-22f2-401c-b40f-8b33ff82ef98 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:27.996375 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273dcf4-22f2-401c-b40f-8b33ff82ef98 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:27.996657 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273dcf4-22f2-401c-b40f-8b33ff82ef98 None admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:27.997470 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1273dcf4-22f2-401c-b40f-8b33ff82ef98 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:27.997800 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1273dcf4-22f2-401c-b40f-8b33ff82ef98 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:28.000730 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1273dcf4-22f2-401c-b40f-8b33ff82ef98 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:28.014642 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 339/680] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 10:23:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:28.018093 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273dcf4-22f2-401c-b40f-8b33ff82ef98 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:28.035124 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:28.099387 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b90af76-255e-4d32-90df-3d3de835d09b None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:28.145000 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5bb315-56c8-4cf9-bbc2-c206c5cb5463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:28.145679 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5bb315-56c8-4cf9-bbc2-c206c5cb5463 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:28.145965 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273dcf4-22f2-401c-b40f-8b33ff82ef98 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:28.146073 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5bb315-56c8-4cf9-bbc2-c206c5cb5463 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:28.146227 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5bb315-56c8-4cf9-bbc2-c206c5cb5463 None admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:28.147012 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5bb315-56c8-4cf9-bbc2-c206c5cb5463 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:28.147468 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5bb315-56c8-4cf9-bbc2-c206c5cb5463 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:28.149719 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5bb315-56c8-4cf9-bbc2-c206c5cb5463 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:28.169109 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 342/681] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 10:23:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:28.170444 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5bb315-56c8-4cf9-bbc2-c206c5cb5463 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:28.186961 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d64cc-9c22-4e78-90a3-1e5991e30984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:28.187732 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d64cc-9c22-4e78-90a3-1e5991e30984 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:28.188106 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d64cc-9c22-4e78-90a3-1e5991e30984 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:28.188347 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8d64cc-9c22-4e78-90a3-1e5991e30984 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:28.189173 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8d64cc-9c22-4e78-90a3-1e5991e30984 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:28.189479 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8d64cc-9c22-4e78-90a3-1e5991e30984 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:28.190827 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8d64cc-9c22-4e78-90a3-1e5991e30984 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:28.204597 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 340/682] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 10:23:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:28.204597 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d64cc-9c22-4e78-90a3-1e5991e30984 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:28.219950 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:28.279054 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5bb315-56c8-4cf9-bbc2-c206c5cb5463 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:28.285839 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:28.311450 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8d64cc-9c22-4e78-90a3-1e5991e30984 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:28.316013 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf1acf2-5fd2-421f-827d-54a6fd58731d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:28.316810 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf1acf2-5fd2-421f-827d-54a6fd58731d None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:28.317120 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf1acf2-5fd2-421f-827d-54a6fd58731d None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:28.317467 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf1acf2-5fd2-421f-827d-54a6fd58731d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:28.327991 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf1acf2-5fd2-421f-827d-54a6fd58731d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:28.329944 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf1acf2-5fd2-421f-827d-54a6fd58731d None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:28.347149 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa57a6f-cd87-4055-95da-e8266636a441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:28.347806 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa57a6f-cd87-4055-95da-e8266636a441 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:28.348085 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa57a6f-cd87-4055-95da-e8266636a441 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:28.348358 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa57a6f-cd87-4055-95da-e8266636a441 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:28.348651 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-cbf1acf2-5fd2-421f-827d-54a6fd58731d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:28.348651 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:28.348651 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:28.348651 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:28.348651 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:28.348651 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:28.348651 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:28.348651 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:28.348651 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:28.348651 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:28.348651 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:28.348651 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:28.348651 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:28.348651 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:28.348651 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:28.349652 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:28.349652 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:28.349652 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:28.349652 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:28.349652 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:28.349652 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:28.349652 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:28.349652 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:28.349652 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:28.349652 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:28.349652 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:28.349652 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:28.349652 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:28.349652 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:28.349652 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:28.349652 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:28.349652 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:28.355318 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:28.355318 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:28.355318 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:28.355318 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:28.355538 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa57a6f-cd87-4055-95da-e8266636a441 None admin] RBAC: Adding query filter params (role.id=d151ec157a524341b7194453e46b6b25, scope.project.id=a6098fe56d304980aa14bd95b4b92c17, user.id=7cc4f041a5b242138a92a54633dcece6) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:28.355538 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa57a6f-cd87-4055-95da-e8266636a441 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:28.355677 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 343/683] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:28.355745 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa57a6f-cd87-4055-95da-e8266636a441 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:28.355811 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf1acf2-5fd2-421f-827d-54a6fd58731d None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:28.370047 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 341/684] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 10:23:28 2022] GET /identity/v3/role_assignments?user.id=7cc4f041a5b242138a92a54633dcece6&scope.project.id=a6098fe56d304980aa14bd95b4b92c17&role.id=d151ec157a524341b7194453e46b6b25 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:28.370047 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa57a6f-cd87-4055-95da-e8266636a441 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:28.487338 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa57a6f-cd87-4055-95da-e8266636a441 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:28.491754 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:28.503070 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf1acf2-5fd2-421f-827d-54a6fd58731d None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:28.527779 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aab7d6-0049-493b-b58f-cba547b43652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:28.528780 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aab7d6-0049-493b-b58f-cba547b43652 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:28.528893 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aab7d6-0049-493b-b58f-cba547b43652 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:28.529142 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aab7d6-0049-493b-b58f-cba547b43652 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:28.539054 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:28.544725 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aab7d6-0049-493b-b58f-cba547b43652 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:28.547713 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aab7d6-0049-493b-b58f-cba547b43652 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:28.547947 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef46203-8d9b-477c-b349-f6348eb76dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:28.548806 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef46203-8d9b-477c-b349-f6348eb76dae None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:28.549133 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef46203-8d9b-477c-b349-f6348eb76dae None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:28.549414 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef46203-8d9b-477c-b349-f6348eb76dae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:28.550256 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef46203-8d9b-477c-b349-f6348eb76dae None admin] RBAC: Adding query filter params (role.id=d151ec157a524341b7194453e46b6b25, scope.project.id=a6098fe56d304980aa14bd95b4b92c17, user.id=2f88e3a2b95e477bae1cc98e9e18dc24) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:28.550783 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef46203-8d9b-477c-b349-f6348eb76dae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:28.551979 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef46203-8d9b-477c-b349-f6348eb76dae None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:28.558953 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 344/685] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 10:23:28 2022] GET /identity/v3/role_assignments?user.id=2f88e3a2b95e477bae1cc98e9e18dc24&scope.project.id=a6098fe56d304980aa14bd95b4b92c17&role.id=d151ec157a524341b7194453e46b6b25 => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:28.559862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef46203-8d9b-477c-b349-f6348eb76dae None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:28.567750 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-83aab7d6-0049-493b-b58f-cba547b43652 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:28.567750 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:28.567750 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:28.567750 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:28.567750 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:28.567750 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:28.567750 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:28.567750 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:28.567750 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:28.567750 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:28.567750 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:28.567750 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:28.567750 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:28.567750 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:28.567750 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:28.568696 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:28.568696 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:28.568696 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:28.568696 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:28.568696 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:28.568696 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:28.568696 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:28.568696 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:28.568696 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:28.568696 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:28.568696 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:28.568696 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:28.568696 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:28.568696 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:28.568696 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:28.568696 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:28.568696 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:28.569689 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:28.569689 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:28.569689 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:28.569689 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:28.569689 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 342/686] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:28.579126 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aab7d6-0049-493b-b58f-cba547b43652 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:28.690500 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef46203-8d9b-477c-b349-f6348eb76dae None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:28.705387 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aab7d6-0049-493b-b58f-cba547b43652 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:28.734388 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb093fc2-fdf6-4f0a-8e44-26caa344aa4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:28.735197 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb093fc2-fdf6-4f0a-8e44-26caa344aa4d None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:28.735468 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb093fc2-fdf6-4f0a-8e44-26caa344aa4d None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:28.735759 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb093fc2-fdf6-4f0a-8e44-26caa344aa4d None admin] PATH_INFO: `/v3/domains` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:28.736808 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb093fc2-fdf6-4f0a-8e44-26caa344aa4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:28.736927 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb093fc2-fdf6-4f0a-8e44-26caa344aa4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:28.738614 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb093fc2-fdf6-4f0a-8e44-26caa344aa4d None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:28.746143 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa4f2c0-6ae5-430a-b009-c034959a894f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:28.747149 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4f2c0-6ae5-430a-b009-c034959a894f None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:28.747643 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4f2c0-6ae5-430a-b009-c034959a894f None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:28.748740 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4f2c0-6ae5-430a-b009-c034959a894f None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:28.749708 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa4f2c0-6ae5-430a-b009-c034959a894f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:28.750234 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa4f2c0-6ae5-430a-b009-c034959a894f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:28.751969 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa4f2c0-6ae5-430a-b009-c034959a894f None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:28.752707 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 345/687] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:28.758093 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb093fc2-fdf6-4f0a-8e44-26caa344aa4d None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:28.767427 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 343/688] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:28.772967 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa4f2c0-6ae5-430a-b009-c034959a894f None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:28.783556 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:28.828585 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:28.887979 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb093fc2-fdf6-4f0a-8e44-26caa344aa4d None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:28.888450 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa4f2c0-6ae5-430a-b009-c034959a894f None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:28.930705 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e647b-6655-44bd-ae1b-0bb7e2551618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:28.931643 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e647b-6655-44bd-ae1b-0bb7e2551618 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:28.931968 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e647b-6655-44bd-ae1b-0bb7e2551618 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:28.932187 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e647b-6655-44bd-ae1b-0bb7e2551618 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:28.934671 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ccbb32-5789-4327-adf2-68b2e25345ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:28.937250 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ccbb32-5789-4327-adf2-68b2e25345ec None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:28.937537 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ccbb32-5789-4327-adf2-68b2e25345ec None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:28.937813 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ccbb32-5789-4327-adf2-68b2e25345ec None admin] PATH_INFO: `/v3/users/nova` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:28.941162 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2e647b-6655-44bd-ae1b-0bb7e2551618 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:28.942616 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2e647b-6655-44bd-ae1b-0bb7e2551618 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:28.946290 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ccbb32-5789-4327-adf2-68b2e25345ec None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:28.952089 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ccbb32-5789-4327-adf2-68b2e25345ec None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:28.960184 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-2c2e647b-6655-44bd-ae1b-0bb7e2551618 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 18 10:23:28.960184 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:28.960184 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:28.960184 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:28.960184 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:28.960184 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:28.960184 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:28.960184 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:28.960184 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:28.960184 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:28.960184 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:28.960184 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:28.960184 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:23:28.960184 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:23:28.960184 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:23:28.960184 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:23:28.961106 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:28.961106 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:28.961106 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:23:28.961106 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:23:28.961106 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:23:28.961106 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:23:28.961106 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:28.961106 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:28.961106 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:28.961106 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:28.961106 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:28.961106 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:28.961106 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:28.961106 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:28.961106 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:28.961106 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:28.961106 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:28.961106 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:28.962612 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:28.962612 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:28.962612 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:23:28.962612 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:23:28.962612 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:23:28.962612 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:23:28.962612 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:23:28.962612 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:23:28.962612 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 18 10:23:28.962612 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:28.962612 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 346/689] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 10:23:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:23:28.964729 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-24ccbb32-5789-4327-adf2-68b2e25345ec None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 10:23:28.964729 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:28.964729 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:28.964729 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:28.964729 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:28.964729 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:28.964729 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:28.964729 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:28.964729 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:28.964729 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:28.964729 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:28.964729 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:28.964729 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:23:28.964729 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:23:28.964729 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:23:28.964729 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:23:28.967806 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:28.967806 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:28.967806 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:23:28.967806 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:23:28.967806 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:23:28.967806 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:23:28.967806 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:28.967806 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:28.967806 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:28.967806 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:28.967806 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:28.967806 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:28.967806 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:28.967806 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:28.967806 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:28.967806 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:28.967806 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:28.967806 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:28.970231 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:28.970231 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:28.970231 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:23:28.970231 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:23:28.970231 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:23:28.970231 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:23:28.970231 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:23:28.970231 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:23:28.970231 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 10:23:28.970231 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:28.970231 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 344/690] 10.222.0.39 () {56 vars in 1093 bytes} [Mon Jul 18 10:23:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:23:28.977264 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e647b-6655-44bd-ae1b-0bb7e2551618 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:28.978317 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ccbb32-5789-4327-adf2-68b2e25345ec None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:29.130764 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:29.153541 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ccbb32-5789-4327-adf2-68b2e25345ec None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:29.175981 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e647b-6655-44bd-ae1b-0bb7e2551618 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:29.176948 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:29.200869 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1207c9-863a-45a5-a342-cb7c14586e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:29.202536 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1207c9-863a-45a5-a342-cb7c14586e46 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:29.202820 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1207c9-863a-45a5-a342-cb7c14586e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:29.203370 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1207c9-863a-45a5-a342-cb7c14586e46 None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:29.204375 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1207c9-863a-45a5-a342-cb7c14586e46 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:29.204850 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1207c9-863a-45a5-a342-cb7c14586e46 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:29.206972 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1207c9-863a-45a5-a342-cb7c14586e46 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:29.217848 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b8874-2b92-4953-baca-c919ef183930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:29.219413 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b8874-2b92-4953-baca-c919ef183930 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:29.219755 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b8874-2b92-4953-baca-c919ef183930 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:29.220089 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b8874-2b92-4953-baca-c919ef183930 None admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:29.221010 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b8874-2b92-4953-baca-c919ef183930 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:29.221429 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b8874-2b92-4953-baca-c919ef183930 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:29.222932 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b8874-2b92-4953-baca-c919ef183930 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:29.228694 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 345/691] 10.222.0.39 () {56 vars in 1133 bytes} [Mon Jul 18 10:23:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:29.230185 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd6b292-7762-4e7d-adea-aabda4ad566d None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:29.230840 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd6b292-7762-4e7d-adea-aabda4ad566d None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:29.231194 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd6b292-7762-4e7d-adea-aabda4ad566d None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:29.237128 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 346/692] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:23:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:23:29.237937 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd6b292-7762-4e7d-adea-aabda4ad566d None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:29.247863 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 347/693] 10.222.0.39 () {56 vars in 1135 bytes} [Mon Jul 18 10:23:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:23:29.250047 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a56f67-5a1b-4e67-9180-29bb683f92be None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:29.250332 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a56f67-5a1b-4e67-9180-29bb683f92be None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:29.250602 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a56f67-5a1b-4e67-9180-29bb683f92be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:29.272314 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-78a56f67-5a1b-4e67-9180-29bb683f92be None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:23:29.274190 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-78a56f67-5a1b-4e67-9180-29bb683f92be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:23:29.359066 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 348/694] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:23:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:23:29.359866 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a56f67-5a1b-4e67-9180-29bb683f92be None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:29.384095 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd6b292-7762-4e7d-adea-aabda4ad566d None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:29.421428 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51af4ecd-f39c-4dce-8130-8e9e720a76dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:29.422083 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af4ecd-f39c-4dce-8130-8e9e720a76dd None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:29.422380 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af4ecd-f39c-4dce-8130-8e9e720a76dd None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:29.422618 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51af4ecd-f39c-4dce-8130-8e9e720a76dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:29.460937 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:29.486540 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:29.497761 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51af4ecd-f39c-4dce-8130-8e9e720a76dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:29.500795 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51af4ecd-f39c-4dce-8130-8e9e720a76dd None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:29.556430 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a56f67-5a1b-4e67-9180-29bb683f92be None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:29.609841 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 347/695] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 10:23:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:23:29.610600 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51af4ecd-f39c-4dce-8130-8e9e720a76dd None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:29.617140 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad54305-8d3a-4ac7-b9d6-aa72003155f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:29.618788 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad54305-8d3a-4ac7-b9d6-aa72003155f7 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:29.619358 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad54305-8d3a-4ac7-b9d6-aa72003155f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:29.619915 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad54305-8d3a-4ac7-b9d6-aa72003155f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:29.679781 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:29.715417 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51af4ecd-f39c-4dce-8130-8e9e720a76dd None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:29.750338 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad54305-8d3a-4ac7-b9d6-aa72003155f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:29.752929 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9565a7-8d5d-477f-bb05-dd4b5d0cfed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:29.753225 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad54305-8d3a-4ac7-b9d6-aa72003155f7 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:29.753752 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9565a7-8d5d-477f-bb05-dd4b5d0cfed1 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:29.754029 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9565a7-8d5d-477f-bb05-dd4b5d0cfed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:29.754299 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9565a7-8d5d-477f-bb05-dd4b5d0cfed1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:29.766135 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9565a7-8d5d-477f-bb05-dd4b5d0cfed1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:29.767559 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9565a7-8d5d-477f-bb05-dd4b5d0cfed1 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:29.785194 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-2b9565a7-8d5d-477f-bb05-dd4b5d0cfed1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:29.785194 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:29.785194 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:29.785194 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:29.785194 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:29.785194 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:29.785194 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:29.785194 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:29.785194 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:29.785194 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:29.785194 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:29.785194 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:29.785194 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:29.785194 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:29.785194 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:29.786806 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:29.786806 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:29.786806 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:29.786806 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:29.786806 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:29.786806 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:29.786806 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:29.786806 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:29.786806 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:29.786806 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:29.786806 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:29.786806 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:29.786806 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:29.786806 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:29.786806 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:29.786806 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:29.786806 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:29.788559 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:29.788559 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:29.788559 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:29.788559 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:29.788559 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 348/696] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:29.788559 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9565a7-8d5d-477f-bb05-dd4b5d0cfed1 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:29.866937 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:29.912166 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9565a7-8d5d-477f-bb05-dd4b5d0cfed1 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:29.932546 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 349/697] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 10:23:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:23:29.933315 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad54305-8d3a-4ac7-b9d6-aa72003155f7 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:29.948262 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:29.965269 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b30df82-66f1-4f2d-93b3-e52637d20af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:29.966079 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30df82-66f1-4f2d-93b3-e52637d20af1 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:29.966364 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30df82-66f1-4f2d-93b3-e52637d20af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:29.966633 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30df82-66f1-4f2d-93b3-e52637d20af1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:29.981596 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b30df82-66f1-4f2d-93b3-e52637d20af1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:29.986779 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b30df82-66f1-4f2d-93b3-e52637d20af1 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:30.010559 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-8b30df82-66f1-4f2d-93b3-e52637d20af1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:30.010559 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:30.010559 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:30.010559 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:30.010559 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:30.010559 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:30.010559 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:30.010559 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:30.010559 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:30.010559 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:30.010559 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:30.010559 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:30.010559 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:30.010559 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:30.010559 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:30.011543 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:30.011543 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:30.011543 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:30.011543 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:30.011543 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:30.011543 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:30.011543 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:30.011543 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:30.011543 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:30.011543 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:30.011543 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:30.011543 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:30.011543 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:30.011543 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:30.011543 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:30.011543 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:30.011543 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:30.012439 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:30.012439 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:30.012439 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:30.012439 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:30.020061 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 349/698] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:30.020061 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b30df82-66f1-4f2d-93b3-e52637d20af1 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:30.075514 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad54305-8d3a-4ac7-b9d6-aa72003155f7 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:30.116322 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6f4490-3586-4009-8558-f4e3872aab58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:30.117338 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f4490-3586-4009-8558-f4e3872aab58 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:30.117930 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f4490-3586-4009-8558-f4e3872aab58 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:30.118362 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6f4490-3586-4009-8558-f4e3872aab58 None admin] PATH_INFO: `/v3/domains` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:30.119228 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6f4490-3586-4009-8558-f4e3872aab58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:30.119675 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6f4490-3586-4009-8558-f4e3872aab58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:30.121218 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6f4490-3586-4009-8558-f4e3872aab58 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:30.136388 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 350/699] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:30.137546 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6f4490-3586-4009-8558-f4e3872aab58 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:30.154054 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b30df82-66f1-4f2d-93b3-e52637d20af1 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:30.165785 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:30.202832 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf668c8-eba3-42ba-9acc-b7056a36067f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:30.203957 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf668c8-eba3-42ba-9acc-b7056a36067f None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:30.204363 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf668c8-eba3-42ba-9acc-b7056a36067f None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:30.204753 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf668c8-eba3-42ba-9acc-b7056a36067f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:30.220421 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf668c8-eba3-42ba-9acc-b7056a36067f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:30.222378 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf668c8-eba3-42ba-9acc-b7056a36067f None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:30.245348 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6f4490-3586-4009-8558-f4e3872aab58 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:30.246266 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-cbf668c8-eba3-42ba-9acc-b7056a36067f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:30.246266 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:30.246266 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:30.246266 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:30.246266 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:30.246266 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:30.246266 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:30.246266 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:30.246266 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:30.246266 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:30.246266 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:30.246266 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:30.246266 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:30.246266 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:30.246266 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:30.247183 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:30.247183 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:30.247183 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:30.247183 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:30.247183 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:30.247183 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:30.247183 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:30.247183 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:30.247183 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:30.247183 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:30.247183 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:30.247183 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:30.247183 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:30.247183 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:30.247183 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:30.247183 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:30.247183 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:30.248648 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:30.248648 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:30.248648 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:30.248648 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:30.252870 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 350/700] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:30.255942 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf668c8-eba3-42ba-9acc-b7056a36067f None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:30.288078 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0776e9f-6ab7-4fd6-82e0-65ec0f1eb457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:30.289113 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0776e9f-6ab7-4fd6-82e0-65ec0f1eb457 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:30.289353 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:30.289794 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0776e9f-6ab7-4fd6-82e0-65ec0f1eb457 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:30.290307 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0776e9f-6ab7-4fd6-82e0-65ec0f1eb457 None admin] PATH_INFO: `/v3/domains` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:30.291407 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0776e9f-6ab7-4fd6-82e0-65ec0f1eb457 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:30.291924 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0776e9f-6ab7-4fd6-82e0-65ec0f1eb457 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:30.293576 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0776e9f-6ab7-4fd6-82e0-65ec0f1eb457 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:30.313137 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 351/701] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:30.314261 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0776e9f-6ab7-4fd6-82e0-65ec0f1eb457 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:30.374894 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf668c8-eba3-42ba-9acc-b7056a36067f None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:30.413921 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a11700-1d6d-47fc-8fe5-9adc3ccd23f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:30.414936 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a11700-1d6d-47fc-8fe5-9adc3ccd23f9 None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:30.415489 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a11700-1d6d-47fc-8fe5-9adc3ccd23f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:30.416000 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a11700-1d6d-47fc-8fe5-9adc3ccd23f9 None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:30.416887 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a11700-1d6d-47fc-8fe5-9adc3ccd23f9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:30.419106 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a11700-1d6d-47fc-8fe5-9adc3ccd23f9 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:30.425838 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:30.444559 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0776e9f-6ab7-4fd6-82e0-65ec0f1eb457 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:30.483913 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab255d7-1211-4d01-ba41-6a2079e3c3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:30.484554 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab255d7-1211-4d01-ba41-6a2079e3c3fd None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:30.484878 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab255d7-1211-4d01-ba41-6a2079e3c3fd None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:30.485146 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab255d7-1211-4d01-ba41-6a2079e3c3fd None admin] PATH_INFO: `/v3/domains` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:30.485893 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab255d7-1211-4d01-ba41-6a2079e3c3fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:30.486188 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab255d7-1211-4d01-ba41-6a2079e3c3fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:30.493063 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab255d7-1211-4d01-ba41-6a2079e3c3fd None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:30.493958 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 351/702] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Jul 18 10:23:30 2022] POST /identity/v3/users => generated 254 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:23:30.495298 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a11700-1d6d-47fc-8fe5-9adc3ccd23f9 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:30.501758 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 352/703] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:30.508585 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab255d7-1211-4d01-ba41-6a2079e3c3fd None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:30.638218 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab255d7-1211-4d01-ba41-6a2079e3c3fd None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:30.668022 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:30.682396 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2606bbf-09f4-40aa-917e-29c2bae61896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:30.690914 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2606bbf-09f4-40aa-917e-29c2bae61896 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:30.690914 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2606bbf-09f4-40aa-917e-29c2bae61896 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:30.690914 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2606bbf-09f4-40aa-917e-29c2bae61896 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:30.693834 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2606bbf-09f4-40aa-917e-29c2bae61896 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:30.696004 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2606bbf-09f4-40aa-917e-29c2bae61896 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:30.717097 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-d2606bbf-09f4-40aa-917e-29c2bae61896 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:23:30.717097 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:30.717097 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:30.717097 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:30.717097 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:30.717097 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:30.717097 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:30.717097 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:30.717097 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:30.717097 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:30.717097 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:30.717097 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:30.717097 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:23:30.717097 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:23:30.717097 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:23:30.720450 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:23:30.720450 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:30.720450 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:30.720450 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:30.720450 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:30.720450 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:30.720450 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:30.720450 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:30.720450 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:30.720450 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:30.720450 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:30.720450 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:30.720450 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:30.720450 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:30.720450 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:30.720450 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:30.720450 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:30.721616 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:23:30.721616 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:23:30.721616 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:23:30.721616 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:23:30.721616 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:23:30.721616 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:23:30.721616 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:23:30.721616 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:30.723405 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a11700-1d6d-47fc-8fe5-9adc3ccd23f9 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:30.732903 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 353/704] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 10:23:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:30.739877 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2606bbf-09f4-40aa-917e-29c2bae61896 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:30.745395 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:30.794033 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f62909f-9b21-4e7d-ab1c-c6ac42c3daf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:30.795874 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f62909f-9b21-4e7d-ab1c-c6ac42c3daf2 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:30.796354 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f62909f-9b21-4e7d-ab1c-c6ac42c3daf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:30.796999 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f62909f-9b21-4e7d-ab1c-c6ac42c3daf2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:30.808266 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f62909f-9b21-4e7d-ab1c-c6ac42c3daf2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:30.810250 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f62909f-9b21-4e7d-ab1c-c6ac42c3daf2 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:30.828427 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-7f62909f-9b21-4e7d-ab1c-c6ac42c3daf2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:23:30.828427 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:30.828427 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:30.828427 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:30.828427 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:30.828427 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:30.828427 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:30.828427 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:30.828427 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:30.828427 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:30.828427 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:30.828427 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:30.828427 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:23:30.828427 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:23:30.828427 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:23:30.829399 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:23:30.829399 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:30.829399 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:30.829399 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:30.829399 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:30.829399 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:30.829399 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:30.829399 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:30.829399 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:30.829399 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:30.829399 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:30.829399 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:30.829399 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:30.829399 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:30.829399 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:30.829399 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:30.829399 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:30.830283 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:23:30.830283 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:23:30.830283 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:23:30.830283 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:23:30.830283 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:23:30.830283 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:23:30.830283 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:23:30.830283 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:30.832891 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 352/705] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 10:23:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:30.839537 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f62909f-9b21-4e7d-ab1c-c6ac42c3daf2 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:30.884035 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2606bbf-09f4-40aa-917e-29c2bae61896 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:30.933985 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fb84fd-78f7-444e-a1d2-5bbe15cbf2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:30.935024 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb84fd-78f7-444e-a1d2-5bbe15cbf2f3 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:30.936032 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb84fd-78f7-444e-a1d2-5bbe15cbf2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:30.936504 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb84fd-78f7-444e-a1d2-5bbe15cbf2f3 None admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:30.937514 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fb84fd-78f7-444e-a1d2-5bbe15cbf2f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:30.938075 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fb84fd-78f7-444e-a1d2-5bbe15cbf2f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:30.939771 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fb84fd-78f7-444e-a1d2-5bbe15cbf2f3 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:30.953779 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 354/706] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 10:23:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:23:30.956775 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f62909f-9b21-4e7d-ab1c-c6ac42c3daf2 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:30.962104 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fb84fd-78f7-444e-a1d2-5bbe15cbf2f3 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:31.004213 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d4eb00-a175-4687-becd-e2d7c84f4536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:31.005059 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4eb00-a175-4687-becd-e2d7c84f4536 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:31.005389 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4eb00-a175-4687-becd-e2d7c84f4536 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:31.005666 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4eb00-a175-4687-becd-e2d7c84f4536 None admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:31.006471 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d4eb00-a175-4687-becd-e2d7c84f4536 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:31.006783 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d4eb00-a175-4687-becd-e2d7c84f4536 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:31.008213 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d4eb00-a175-4687-becd-e2d7c84f4536 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:31.018936 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:31.028878 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 353/707] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 10:23:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:23:31.028878 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a28983-2060-4b20-b946-f90782cfeff6 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:31.028878 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a28983-2060-4b20-b946-f90782cfeff6 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:31.028878 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a28983-2060-4b20-b946-f90782cfeff6 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:31.028878 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 354/708] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:23:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:23:31.032460 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a28983-2060-4b20-b946-f90782cfeff6 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:31.049936 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:31.095639 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fb84fd-78f7-444e-a1d2-5bbe15cbf2f3 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:31.131789 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526b116-55ee-48bd-ad3a-c62b0e730045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:31.133245 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526b116-55ee-48bd-ad3a-c62b0e730045 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:31.133533 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526b116-55ee-48bd-ad3a-c62b0e730045 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:31.133809 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526b116-55ee-48bd-ad3a-c62b0e730045 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:31.134644 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c526b116-55ee-48bd-ad3a-c62b0e730045 None admin] RBAC: Adding query filter params (role.id=d151ec157a524341b7194453e46b6b25, scope.project.id=a6098fe56d304980aa14bd95b4b92c17, user.id=2c548474a8d94591ba58dd40e40a28d2) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:31.134957 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c526b116-55ee-48bd-ad3a-c62b0e730045 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:31.136411 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c526b116-55ee-48bd-ad3a-c62b0e730045 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:31.151122 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 355/709] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 10:23:30 2022] GET /identity/v3/role_assignments?user.id=2c548474a8d94591ba58dd40e40a28d2&scope.project.id=a6098fe56d304980aa14bd95b4b92c17&role.id=d151ec157a524341b7194453e46b6b25 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:31.151122 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399b8e9-5e6a-4466-b04c-d1a8832ae7c6 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:31.151122 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399b8e9-5e6a-4466-b04c-d1a8832ae7c6 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:31.151122 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399b8e9-5e6a-4466-b04c-d1a8832ae7c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:31.164820 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-e399b8e9-5e6a-4466-b04c-d1a8832ae7c6 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:23:31.166216 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-e399b8e9-5e6a-4466-b04c-d1a8832ae7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:23:31.178151 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a28983-2060-4b20-b946-f90782cfeff6 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:31.220321 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8658a65-719c-4658-9c57-24255b01d7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:31.221359 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8658a65-719c-4658-9c57-24255b01d7b8 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:31.221752 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8658a65-719c-4658-9c57-24255b01d7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:31.222132 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8658a65-719c-4658-9c57-24255b01d7b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:31.223142 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8658a65-719c-4658-9c57-24255b01d7b8 None admin] RBAC: Adding query filter params (role.id=e7b6a55ecf6c491487955aaefbf9c388, scope.project.id=a6098fe56d304980aa14bd95b4b92c17, user.id=8bbebf16219943879df84bdc9a900516) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:31.223671 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8658a65-719c-4658-9c57-24255b01d7b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:31.225409 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8658a65-719c-4658-9c57-24255b01d7b8 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:31.232675 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 355/710] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 10:23:31 2022] GET /identity/v3/role_assignments?user.id=8bbebf16219943879df84bdc9a900516&scope.project.id=a6098fe56d304980aa14bd95b4b92c17&role.id=e7b6a55ecf6c491487955aaefbf9c388 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:31.234326 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd934c2a-a0cc-48bd-876f-b7cc6cb6a741 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:31.234746 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd934c2a-a0cc-48bd-876f-b7cc6cb6a741 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:31.235125 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd934c2a-a0cc-48bd-876f-b7cc6cb6a741 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:31.241389 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 356/711] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:23:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:23:31.243866 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89beb3b4-cbee-44c0-9400-3eb6dba4dea3 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:31.244170 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89beb3b4-cbee-44c0-9400-3eb6dba4dea3 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:31.244450 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89beb3b4-cbee-44c0-9400-3eb6dba4dea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:31.251823 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 356/712] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:23:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:23:31.275585 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-89beb3b4-cbee-44c0-9400-3eb6dba4dea3 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:23:31.276839 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-89beb3b4-cbee-44c0-9400-3eb6dba4dea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:23:31.296660 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e399b8e9-5e6a-4466-b04c-d1a8832ae7c6 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:31.381333 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:31.395343 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 357/713] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:23:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 10:23:31.413265 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:31.418681 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89beb3b4-cbee-44c0-9400-3eb6dba4dea3 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:31.465558 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e399b8e9-5e6a-4466-b04c-d1a8832ae7c6 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:31.512792 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6208371b-4735-4fb4-94e2-4ba98ccb3418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:31.514490 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208371b-4735-4fb4-94e2-4ba98ccb3418 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:31.514770 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208371b-4735-4fb4-94e2-4ba98ccb3418 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:31.515042 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208371b-4735-4fb4-94e2-4ba98ccb3418 None admin] PATH_INFO: `/v3/services/network` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:31.515979 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6208371b-4735-4fb4-94e2-4ba98ccb3418 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:31.517949 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6208371b-4735-4fb4-94e2-4ba98ccb3418 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:31.537945 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-6208371b-4735-4fb4-94e2-4ba98ccb3418 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 10:23:31.537945 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:31.537945 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 10:23:31.537945 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 10:23:31.537945 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 10:23:31.537945 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 10:23:31.537945 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 10:23:31.537945 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:23:31.537945 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 10:23:31.537945 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:31.537945 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 10:23:31.537945 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:31.537945 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:31.537945 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:31.537945 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:31.537945 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:31.537945 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:31.539006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:31.539006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:31.539006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:31.539006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:31.539006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:31.539006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:31.539006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 10:23:31.539006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 10:23:31.539006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 10:23:31.539006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 10:23:31.539006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:31.539006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:31.539006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:31.539006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:31.539006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:31.539006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:31.539922 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:31.539922 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:31.539922 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:31.539922 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:31.539922 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:31.539922 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:31.539922 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:31.539922 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:31.539922 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:31.539922 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:31.539922 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 10:23:31.539922 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:23:31.539922 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 10:23:31.539922 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:31.540650 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89beb3b4-cbee-44c0-9400-3eb6dba4dea3 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:31.540726 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 357/714] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 10:23:31 2022] GET /identity/v3/services/network => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:23:31.546919 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6208371b-4735-4fb4-94e2-4ba98ccb3418 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:31.579919 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f1779a-ba29-4206-83a3-bd07ac9bd8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:31.580742 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1779a-ba29-4206-83a3-bd07ac9bd8bf None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:31.581021 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1779a-ba29-4206-83a3-bd07ac9bd8bf None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:31.581323 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1779a-ba29-4206-83a3-bd07ac9bd8bf None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:31.582052 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f1779a-ba29-4206-83a3-bd07ac9bd8bf None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:31.583391 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f1779a-ba29-4206-83a3-bd07ac9bd8bf None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:31.602937 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-35f1779a-ba29-4206-83a3-bd07ac9bd8bf None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 10:23:31.602937 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:31.602937 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 10:23:31.602937 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 10:23:31.602937 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 10:23:31.602937 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 10:23:31.602937 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 10:23:31.602937 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:23:31.602937 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 10:23:31.602937 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:31.602937 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 10:23:31.602937 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:31.602937 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:31.602937 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:31.602937 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:31.602937 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:31.603923 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:31.603923 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:31.603923 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:31.603923 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:31.603923 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:31.603923 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:31.603923 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:31.603923 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 10:23:31.603923 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 10:23:31.603923 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 10:23:31.603923 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 10:23:31.603923 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:31.603923 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:31.603923 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:31.603923 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:31.603923 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:31.604763 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:31.604763 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:31.604763 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:31.604763 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:31.604763 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:31.604763 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:31.604763 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:31.604763 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:31.604763 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:31.604763 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:31.604763 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:31.604763 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 10:23:31.604763 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:23:31.604763 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 10:23:31.604763 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:31.609172 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 358/715] 10.222.0.39 () {56 vars in 1129 bytes} [Mon Jul 18 10:23:31 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:23:31.611655 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f1779a-ba29-4206-83a3-bd07ac9bd8bf None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:31.673800 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:31.682332 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6208371b-4735-4fb4-94e2-4ba98ccb3418 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:31.710400 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:31.718592 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f1779a-ba29-4206-83a3-bd07ac9bd8bf None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:31.724533 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef1369f-7841-4771-ba78-ae45c2df510d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:31.725470 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1369f-7841-4771-ba78-ae45c2df510d None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:31.726032 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1369f-7841-4771-ba78-ae45c2df510d None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:31.726507 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1369f-7841-4771-ba78-ae45c2df510d None admin] PATH_INFO: `/v3/services` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:31.727401 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef1369f-7841-4771-ba78-ae45c2df510d None admin] RBAC: Adding query filter params (name=network) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:31.727956 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef1369f-7841-4771-ba78-ae45c2df510d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:31.729705 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef1369f-7841-4771-ba78-ae45c2df510d None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:31.737615 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 358/716] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Jul 18 10:23:31 2022] GET /identity/v3/services?name=network => generated 124 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:23:31.743784 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef1369f-7841-4771-ba78-ae45c2df510d None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:31.754908 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38f76ea-effb-4a1c-9cc9-d0216778d0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:31.755632 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f76ea-effb-4a1c-9cc9-d0216778d0d8 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:31.755913 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f76ea-effb-4a1c-9cc9-d0216778d0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:31.756182 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f76ea-effb-4a1c-9cc9-d0216778d0d8 None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:31.756935 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38f76ea-effb-4a1c-9cc9-d0216778d0d8 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:31.759621 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38f76ea-effb-4a1c-9cc9-d0216778d0d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:31.759621 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38f76ea-effb-4a1c-9cc9-d0216778d0d8 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:31.768910 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 359/717] 10.222.0.39 () {56 vars in 1124 bytes} [Mon Jul 18 10:23:31 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:31.770079 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38f76ea-effb-4a1c-9cc9-d0216778d0d8 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:31.899361 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38f76ea-effb-4a1c-9cc9-d0216778d0d8 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:31.932511 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:31.948398 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef1369f-7841-4771-ba78-ae45c2df510d None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:31.952307 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb8d2e-5597-42be-91fa-273f30a5dd91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:31.953178 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb8d2e-5597-42be-91fa-273f30a5dd91 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:31.953590 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb8d2e-5597-42be-91fa-273f30a5dd91 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:31.953974 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb8d2e-5597-42be-91fa-273f30a5dd91 None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:31.954805 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb8d2e-5597-42be-91fa-273f30a5dd91 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:31.955220 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb8d2e-5597-42be-91fa-273f30a5dd91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:31.956739 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb8d2e-5597-42be-91fa-273f30a5dd91 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:31.973604 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 360/718] 10.222.0.39 () {56 vars in 1124 bytes} [Mon Jul 18 10:23:31 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:23:32.054380 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1df47-d520-4c34-a55d-337c6920464b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:32.054987 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1df47-d520-4c34-a55d-337c6920464b None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:32.055270 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1df47-d520-4c34-a55d-337c6920464b None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:32.055547 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1df47-d520-4c34-a55d-337c6920464b None admin] PATH_INFO: `/v3/services` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:32.056259 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e1df47-d520-4c34-a55d-337c6920464b None admin] RBAC: Adding query filter params (type=network) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:32.056564 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e1df47-d520-4c34-a55d-337c6920464b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:32.062319 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e1df47-d520-4c34-a55d-337c6920464b None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:32.075214 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 359/719] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Jul 18 10:23:31 2022] GET /identity/v3/services?type=network => generated 124 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:33.258330 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a45c27-3496-499a-a4ca-4964e4c99047 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:33.258330 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a45c27-3496-499a-a4ca-4964e4c99047 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:33.258330 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a45c27-3496-499a-a4ca-4964e4c99047 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:33.259226 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 361/720] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:23:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:23:33.265926 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d982b41-19e2-42a2-a0b5-8b80c740362f None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:33.266662 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d982b41-19e2-42a2-a0b5-8b80c740362f None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:33.267108 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d982b41-19e2-42a2-a0b5-8b80c740362f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:33.290069 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-2d982b41-19e2-42a2-a0b5-8b80c740362f None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:23:33.291297 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-2d982b41-19e2-42a2-a0b5-8b80c740362f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:23:33.354988 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:33.381124 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 360/721] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:23:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 10:23:33.412909 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a45c27-3496-499a-a4ca-4964e4c99047 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:33.558280 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a45c27-3496-499a-a4ca-4964e4c99047 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:33.605866 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a800db9a-7312-4f07-bb22-f34f19da0e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:33.606604 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800db9a-7312-4f07-bb22-f34f19da0e2b None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:33.606888 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800db9a-7312-4f07-bb22-f34f19da0e2b None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:33.607741 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800db9a-7312-4f07-bb22-f34f19da0e2b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:33.624956 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a800db9a-7312-4f07-bb22-f34f19da0e2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:23:33.632745 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-a800db9a-7312-4f07-bb22-f34f19da0e2b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:23:33.632745 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:33.632745 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:33.632745 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:33.632745 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:33.632745 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:33.632745 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:33.632745 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:33.632745 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:33.632745 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:33.632745 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:33.632745 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:33.632745 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:23:33.632745 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:23:33.632745 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:23:33.632745 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:23:33.633960 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:23:33.633960 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:23:33.633960 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:23:33.633960 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:23:33.633960 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:33.633960 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:33.633960 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:33.633960 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:33.633960 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:33.633960 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:33.633960 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:33.633960 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:33.633960 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:33.633960 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:33.633960 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:33.633960 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:33.635053 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:33.635053 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:33.635053 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:33.635053 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:33.635053 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:23:33.635053 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:23:33.635053 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:23:33.635053 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:23:33.635053 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:23:33.635053 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:23:33.635053 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:23:33.635053 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:33.635053 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 362/722] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jul 18 10:23:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:33.642308 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d982b41-19e2-42a2-a0b5-8b80c740362f None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:33.802225 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d982b41-19e2-42a2-a0b5-8b80c740362f None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:33.862369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8edf5e-5731-4cfc-9b82-6875bc03c03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:33.863238 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8edf5e-5731-4cfc-9b82-6875bc03c03d None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:33.863522 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8edf5e-5731-4cfc-9b82-6875bc03c03d None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:33.863798 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8edf5e-5731-4cfc-9b82-6875bc03c03d None admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:33.864553 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8edf5e-5731-4cfc-9b82-6875bc03c03d None admin] RBAC: Adding query filter params (name=service) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:33.864861 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8edf5e-5731-4cfc-9b82-6875bc03c03d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:33.866276 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8edf5e-5731-4cfc-9b82-6875bc03c03d None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:33.881026 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 361/723] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Jul 18 10:23:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:33.886339 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a800db9a-7312-4f07-bb22-f34f19da0e2b None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:33.903413 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc8fdf-b5c8-4921-8b98-a16bfb833dc6 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:33.903730 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc8fdf-b5c8-4921-8b98-a16bfb833dc6 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:33.904516 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc8fdf-b5c8-4921-8b98-a16bfb833dc6 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:33.906148 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 362/724] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:23:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:23:33.911085 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f44d92-c12d-4c50-9092-dc2e4e1e9451 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:33.911367 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f44d92-c12d-4c50-9092-dc2e4e1e9451 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:33.911642 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f44d92-c12d-4c50-9092-dc2e4e1e9451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:33.928722 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-d3f44d92-c12d-4c50-9092-dc2e4e1e9451 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:23:33.929948 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-d3f44d92-c12d-4c50-9092-dc2e4e1e9451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:23:33.965782 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:33.977254 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:34.005163 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 363/725] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:23:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 10:23:34.021159 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f44d92-c12d-4c50-9092-dc2e4e1e9451 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:34.123189 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a800db9a-7312-4f07-bb22-f34f19da0e2b None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:34.165625 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd0643-857c-4d50-8921-741ff382ee09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:34.166732 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd0643-857c-4d50-8921-741ff382ee09 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:34.167157 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd0643-857c-4d50-8921-741ff382ee09 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:34.167583 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd0643-857c-4d50-8921-741ff382ee09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:34.194429 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd0643-857c-4d50-8921-741ff382ee09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:34.197476 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd0643-857c-4d50-8921-741ff382ee09 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:34.229330 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-87bd0643-857c-4d50-8921-741ff382ee09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:34.229330 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:34.229330 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:34.229330 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:34.229330 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:34.229330 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:34.229330 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:34.229330 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:34.229330 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:34.229330 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:34.229330 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:34.229330 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:34.229330 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:34.229330 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:34.229330 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:34.230475 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:34.230475 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:34.230475 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:34.230475 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:34.230475 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:34.230475 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:34.230475 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:34.230475 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:34.230475 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:34.230475 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:34.230475 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:34.230475 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:34.230475 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:34.230475 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:34.230475 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:34.230475 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:34.230475 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:34.231457 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:34.231457 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:34.231457 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:34.231457 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:34.234370 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 363/726] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:34.235912 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b80fd3-21b3-409e-91cf-9ba2808b6aa0 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:34.236397 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b80fd3-21b3-409e-91cf-9ba2808b6aa0 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:34.236868 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b80fd3-21b3-409e-91cf-9ba2808b6aa0 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:34.238913 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 364/727] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:23:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:23:34.240318 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b80fd3-21b3-409e-91cf-9ba2808b6aa0 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:34.266157 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f44d92-c12d-4c50-9092-dc2e4e1e9451 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:34.306630 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe26281-21a4-4b22-93bc-427f411c2a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:34.307730 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe26281-21a4-4b22-93bc-427f411c2a76 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:34.308161 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe26281-21a4-4b22-93bc-427f411c2a76 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:34.308610 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe26281-21a4-4b22-93bc-427f411c2a76 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:34.321482 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe26281-21a4-4b22-93bc-427f411c2a76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:23:34.332268 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-efe26281-21a4-4b22-93bc-427f411c2a76 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:23:34.332268 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:34.332268 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:34.332268 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:34.332268 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:34.332268 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:34.332268 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:34.332268 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:34.332268 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:34.332268 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:34.332268 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:34.332268 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:34.332268 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:23:34.332268 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:23:34.332268 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:23:34.332268 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:23:34.333262 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:23:34.333262 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:23:34.333262 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:23:34.333262 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:23:34.333262 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:34.333262 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:34.333262 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:34.333262 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:34.333262 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:34.333262 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:34.333262 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:34.333262 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:34.333262 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:34.333262 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:34.333262 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:34.333262 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:34.334115 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:34.334115 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:34.334115 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:34.334115 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:34.334115 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:23:34.334115 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:23:34.334115 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:23:34.334115 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:23:34.334115 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:23:34.334115 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:23:34.334115 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:23:34.334115 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:34.337036 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 364/728] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 10:23:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:23:34.338544 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1cd50-6c41-4b1c-bf6e-589887da93ca None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:34.338998 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1cd50-6c41-4b1c-bf6e-589887da93ca None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:34.339440 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1cd50-6c41-4b1c-bf6e-589887da93ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:34.354786 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:34.359952 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b80fd3-21b3-409e-91cf-9ba2808b6aa0 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:34.361417 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-b8e1cd50-6c41-4b1c-bf6e-589887da93ca None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:23:34.363130 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-b8e1cd50-6c41-4b1c-bf6e-589887da93ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:23:34.394248 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:34.396703 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2998223b-e1c2-4041-87be-d3795e250519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:34.397538 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998223b-e1c2-4041-87be-d3795e250519 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:34.397883 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998223b-e1c2-4041-87be-d3795e250519 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:34.398258 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998223b-e1c2-4041-87be-d3795e250519 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:34.399073 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2998223b-e1c2-4041-87be-d3795e250519 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:34.399410 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2998223b-e1c2-4041-87be-d3795e250519 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:34.400888 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2998223b-e1c2-4041-87be-d3795e250519 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:34.417534 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 365/729] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:34.417534 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2998223b-e1c2-4041-87be-d3795e250519 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:34.455027 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 365/730] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:23:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:23:34.455027 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e1cd50-6c41-4b1c-bf6e-589887da93ca None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:34.558348 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2998223b-e1c2-4041-87be-d3795e250519 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:34.590283 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e1cd50-6c41-4b1c-bf6e-589887da93ca None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:34.604794 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8fe471-850f-49af-a3eb-c6e6ac06dbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:34.605982 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8fe471-850f-49af-a3eb-c6e6ac06dbd3 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:34.606415 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8fe471-850f-49af-a3eb-c6e6ac06dbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:34.606839 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8fe471-850f-49af-a3eb-c6e6ac06dbd3 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:34.609129 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8fe471-850f-49af-a3eb-c6e6ac06dbd3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:34.609622 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8fe471-850f-49af-a3eb-c6e6ac06dbd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:34.611556 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8fe471-850f-49af-a3eb-c6e6ac06dbd3 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:34.624174 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 366/731] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 10:23:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:34.625369 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8fe471-850f-49af-a3eb-c6e6ac06dbd3 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:34.637970 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c10fb-94a9-4309-8ead-8900f59b3e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:34.639217 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c10fb-94a9-4309-8ead-8900f59b3e66 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:34.639403 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c10fb-94a9-4309-8ead-8900f59b3e66 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:34.639650 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c10fb-94a9-4309-8ead-8900f59b3e66 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:34.649995 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144c10fb-94a9-4309-8ead-8900f59b3e66 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:34.651444 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144c10fb-94a9-4309-8ead-8900f59b3e66 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:34.653085 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:34.673268 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-144c10fb-94a9-4309-8ead-8900f59b3e66 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 10:23:34.673268 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:34.673268 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:34.673268 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:34.673268 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:34.673268 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:34.673268 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:34.673268 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:34.673268 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:34.673268 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:34.673268 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:34.673268 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:34.673268 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:23:34.673268 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:23:34.673268 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:23:34.673268 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:23:34.674300 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:34.674300 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:34.674300 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:23:34.674300 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:23:34.674300 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:23:34.674300 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:23:34.674300 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:34.674300 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:34.674300 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:34.674300 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:34.674300 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:34.674300 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:34.674300 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:34.674300 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:34.674300 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:34.674300 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:34.674300 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:34.674300 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:34.675250 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:34.675250 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:34.675250 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:23:34.675250 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:23:34.675250 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:23:34.675250 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:23:34.675250 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:23:34.675250 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:23:34.675250 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 10:23:34.675250 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:34.675250 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 366/732] 10.222.0.39 () {56 vars in 1117 bytes} [Mon Jul 18 10:23:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:34.675836 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c10fb-94a9-4309-8ead-8900f59b3e66 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:34.701866 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:34.744425 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8fe471-850f-49af-a3eb-c6e6ac06dbd3 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:34.776494 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c10fb-94a9-4309-8ead-8900f59b3e66 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:34.778361 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301e5e68-eb31-47cf-b528-098d259dd30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:34.780517 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e5e68-eb31-47cf-b528-098d259dd30d None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:34.780802 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e5e68-eb31-47cf-b528-098d259dd30d None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:34.781108 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e5e68-eb31-47cf-b528-098d259dd30d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:34.791078 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301e5e68-eb31-47cf-b528-098d259dd30d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:23:34.799427 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-301e5e68-eb31-47cf-b528-098d259dd30d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:23:34.799427 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:34.799427 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:34.799427 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:34.799427 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:34.799427 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:34.799427 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:34.799427 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:34.799427 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:34.799427 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:34.799427 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:34.799427 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:34.799427 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:23:34.799427 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:23:34.799427 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:23:34.799427 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:23:34.800527 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:23:34.800527 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:23:34.800527 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:23:34.800527 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:23:34.800527 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:34.800527 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:34.800527 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:34.800527 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:34.800527 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:34.800527 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:34.800527 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:34.800527 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:34.800527 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:34.800527 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:34.800527 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:34.800527 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:34.801403 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:34.801403 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:34.801403 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:34.801403 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:34.801403 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:23:34.801403 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:23:34.801403 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:23:34.801403 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:23:34.801403 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:23:34.801403 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:23:34.801403 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:23:34.801403 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:34.801403 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 367/733] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 10:23:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:34.802093 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301e5e68-eb31-47cf-b528-098d259dd30d None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:34.815491 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a743e5-c5f6-40c1-abc7-4d28f9450552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:34.816291 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a743e5-c5f6-40c1-abc7-4d28f9450552 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:34.816573 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a743e5-c5f6-40c1-abc7-4d28f9450552 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:34.816850 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a743e5-c5f6-40c1-abc7-4d28f9450552 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:34.826955 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a743e5-c5f6-40c1-abc7-4d28f9450552 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:34.828393 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a743e5-c5f6-40c1-abc7-4d28f9450552 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:34.845962 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-e9a743e5-c5f6-40c1-abc7-4d28f9450552 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:34.845962 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:34.845962 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:34.845962 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:34.845962 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:34.845962 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:34.845962 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:34.845962 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:34.845962 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:34.845962 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:34.845962 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:34.845962 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:34.845962 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:34.845962 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:34.845962 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:34.846932 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:34.846932 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:34.846932 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:34.846932 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:34.846932 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:34.846932 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:34.846932 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:34.846932 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:34.846932 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:34.846932 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:34.846932 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:34.846932 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:34.846932 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:34.846932 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:34.846932 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:34.846932 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:34.846932 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:34.847829 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:34.847829 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:34.847829 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:34.847829 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:34.847829 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 367/734] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:34.848348 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999645a8-d02a-4c3c-a403-12ac0d0322a4 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:34.848633 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999645a8-d02a-4c3c-a403-12ac0d0322a4 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:34.848854 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999645a8-d02a-4c3c-a403-12ac0d0322a4 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:34.850122 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 368/735] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:23:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:23:34.851162 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c7349e-5bed-4598-a60f-d0198c5cb2c8 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:34.851442 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c7349e-5bed-4598-a60f-d0198c5cb2c8 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:34.851995 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c7349e-5bed-4598-a60f-d0198c5cb2c8 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:34.854513 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 369/736] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:23:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:23:34.854513 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c7349e-5bed-4598-a60f-d0198c5cb2c8 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:34.889111 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:34.907859 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301e5e68-eb31-47cf-b528-098d259dd30d None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:34.933126 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:34.941585 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f2f0f-306d-4d43-b864-1c9120719955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:34.942247 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f2f0f-306d-4d43-b864-1c9120719955 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:34.942526 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f2f0f-306d-4d43-b864-1c9120719955 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:34.944203 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f2f0f-306d-4d43-b864-1c9120719955 None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:34.944203 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54f2f0f-306d-4d43-b864-1c9120719955 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:34.944203 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54f2f0f-306d-4d43-b864-1c9120719955 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:34.945304 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54f2f0f-306d-4d43-b864-1c9120719955 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:34.959274 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c7349e-5bed-4598-a60f-d0198c5cb2c8 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:34.961826 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 368/737] 10.222.0.39 () {56 vars in 1149 bytes} [Mon Jul 18 10:23:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:34.962609 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f2f0f-306d-4d43-b864-1c9120719955 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:34.996685 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba73d8bc-2aae-404f-8b53-645a3b2e0975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:34.997407 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73d8bc-2aae-404f-8b53-645a3b2e0975 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:34.998040 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73d8bc-2aae-404f-8b53-645a3b2e0975 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:34.998040 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73d8bc-2aae-404f-8b53-645a3b2e0975 None admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:34.998785 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba73d8bc-2aae-404f-8b53-645a3b2e0975 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:34.999095 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba73d8bc-2aae-404f-8b53-645a3b2e0975 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:35.000573 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba73d8bc-2aae-404f-8b53-645a3b2e0975 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:35.009031 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 370/738] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 10:23:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:35.010311 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade707b-c79c-4ea5-8249-1d1bfdeeb8f0 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:35.010603 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade707b-c79c-4ea5-8249-1d1bfdeeb8f0 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:35.010883 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade707b-c79c-4ea5-8249-1d1bfdeeb8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:35.027386 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-3ade707b-c79c-4ea5-8249-1d1bfdeeb8f0 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:23:35.028580 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-3ade707b-c79c-4ea5-8249-1d1bfdeeb8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:23:35.068251 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f2f0f-306d-4d43-b864-1c9120719955 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:35.095267 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 371/739] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:23:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:23:35.096592 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05829169-b9c5-4ea3-9514-9a5896872d02 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:35.096858 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05829169-b9c5-4ea3-9514-9a5896872d02 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:35.097097 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05829169-b9c5-4ea3-9514-9a5896872d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:35.111216 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6b6804-2dd9-427e-9275-884f46d914ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:35.112017 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b6804-2dd9-427e-9275-884f46d914ee None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:35.112370 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b6804-2dd9-427e-9275-884f46d914ee None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:35.112710 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b6804-2dd9-427e-9275-884f46d914ee None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:35.113805 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6b6804-2dd9-427e-9275-884f46d914ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:35.114178 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6b6804-2dd9-427e-9275-884f46d914ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:35.114640 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-05829169-b9c5-4ea3-9514-9a5896872d02 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:23:35.115678 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6b6804-2dd9-427e-9275-884f46d914ee None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:35.115824 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-05829169-b9c5-4ea3-9514-9a5896872d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:23:35.122559 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:35.128483 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 369/740] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:35.129411 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6b6804-2dd9-427e-9275-884f46d914ee None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:35.178615 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:35.186795 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 372/741] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:23:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 10:23:35.187682 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05829169-b9c5-4ea3-9514-9a5896872d02 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:35.240202 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6b6804-2dd9-427e-9275-884f46d914ee None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:35.273251 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec05b4e2-29b8-4a9f-a22e-adcc145cd0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:35.273893 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05b4e2-29b8-4a9f-a22e-adcc145cd0cb None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:35.274170 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05b4e2-29b8-4a9f-a22e-adcc145cd0cb None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:35.274440 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05b4e2-29b8-4a9f-a22e-adcc145cd0cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:35.287013 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05829169-b9c5-4ea3-9514-9a5896872d02 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:35.320866 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec2dbd6-3fa6-46e7-95c0-8214bad85f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:35.321689 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec2dbd6-3fa6-46e7-95c0-8214bad85f95 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:35.321978 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec2dbd6-3fa6-46e7-95c0-8214bad85f95 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:35.322257 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec2dbd6-3fa6-46e7-95c0-8214bad85f95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:35.332242 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec2dbd6-3fa6-46e7-95c0-8214bad85f95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:35.333755 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec2dbd6-3fa6-46e7-95c0-8214bad85f95 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:35.337979 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:35.341497 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec05b4e2-29b8-4a9f-a22e-adcc145cd0cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:35.343064 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec05b4e2-29b8-4a9f-a22e-adcc145cd0cb None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:35.351042 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-aec2dbd6-3fa6-46e7-95c0-8214bad85f95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:35.351042 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:35.351042 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:35.351042 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:35.351042 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:35.351042 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:35.351042 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:35.351042 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:35.351042 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:35.351042 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:35.351042 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:35.351042 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:35.351042 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:35.351042 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:35.351042 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:35.351896 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:35.351896 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:35.351896 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:35.351896 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:35.351896 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:35.351896 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:35.351896 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:35.351896 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:35.351896 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:35.351896 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:35.351896 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:35.351896 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:35.351896 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:35.351896 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:35.351896 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:35.351896 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:35.351896 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:35.352975 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:35.352975 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:35.352975 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:35.352975 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:35.352975 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 373/742] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:35.353691 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec2dbd6-3fa6-46e7-95c0-8214bad85f95 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:35.401602 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:35.441821 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 370/743] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 10:23:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 10:23:35.442515 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec05b4e2-29b8-4a9f-a22e-adcc145cd0cb None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:35.453708 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec2dbd6-3fa6-46e7-95c0-8214bad85f95 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:35.487107 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fc15f1-81ce-4b9e-8d11-aba97179ef19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:35.488009 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fc15f1-81ce-4b9e-8d11-aba97179ef19 None admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:35.488297 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fc15f1-81ce-4b9e-8d11-aba97179ef19 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:35.488565 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fc15f1-81ce-4b9e-8d11-aba97179ef19 None admin] PATH_INFO: `/v3/services` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:35.489303 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fc15f1-81ce-4b9e-8d11-aba97179ef19 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:35.490666 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fc15f1-81ce-4b9e-8d11-aba97179ef19 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:35.536180 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:35.539888 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec05b4e2-29b8-4a9f-a22e-adcc145cd0cb None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:35.553887 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 374/744] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Jul 18 10:23:35 2022] POST /identity/v3/services => generated 240 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:23:35.554881 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fc15f1-81ce-4b9e-8d11-aba97179ef19 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:35.590380 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d444771d-2081-4e3b-9627-ea1202d41fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:35.591216 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d444771d-2081-4e3b-9627-ea1202d41fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:35.591562 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d444771d-2081-4e3b-9627-ea1202d41fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:35.591849 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d444771d-2081-4e3b-9627-ea1202d41fb7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:35.601341 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d444771d-2081-4e3b-9627-ea1202d41fb7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:35.602847 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d444771d-2081-4e3b-9627-ea1202d41fb7 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:35.618894 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-d444771d-2081-4e3b-9627-ea1202d41fb7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 10:23:35.618894 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:35.618894 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:35.618894 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:35.618894 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:35.618894 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:35.618894 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:35.618894 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:35.618894 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:35.618894 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:35.618894 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:35.618894 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:35.618894 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:23:35.618894 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:23:35.618894 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:23:35.618894 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:23:35.619987 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:35.619987 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:35.619987 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:23:35.619987 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:23:35.619987 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:23:35.619987 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:23:35.619987 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:35.619987 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:35.619987 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:35.619987 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:35.619987 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:35.619987 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:35.619987 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:35.619987 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:35.619987 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:35.619987 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:35.619987 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:35.619987 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:35.620926 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:35.620926 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:35.620926 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:23:35.620926 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:23:35.620926 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:23:35.620926 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:23:35.620926 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:23:35.620926 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:23:35.620926 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 10:23:35.620926 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:35.620926 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 371/745] 10.222.0.39 () {56 vars in 1093 bytes} [Mon Jul 18 10:23:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:35.621560 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d444771d-2081-4e3b-9627-ea1202d41fb7 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:35.679806 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fc15f1-81ce-4b9e-8d11-aba97179ef19 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:35.690791 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:35.723359 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac156846-00ca-45ee-9315-89b055f6aebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:35.724770 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac156846-00ca-45ee-9315-89b055f6aebf None admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:35.724770 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac156846-00ca-45ee-9315-89b055f6aebf None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:35.724938 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac156846-00ca-45ee-9315-89b055f6aebf None admin] PATH_INFO: `/v3/services` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:35.725698 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac156846-00ca-45ee-9315-89b055f6aebf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:35.727294 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac156846-00ca-45ee-9315-89b055f6aebf None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:35.738142 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d444771d-2081-4e3b-9627-ea1202d41fb7 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:35.771870 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d048f-5bcf-4cf5-a727-73fd6dbd447b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:35.772529 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d048f-5bcf-4cf5-a727-73fd6dbd447b None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:35.772808 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d048f-5bcf-4cf5-a727-73fd6dbd447b None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:35.773114 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d048f-5bcf-4cf5-a727-73fd6dbd447b None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:35.776703 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4d048f-5bcf-4cf5-a727-73fd6dbd447b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:35.776703 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4d048f-5bcf-4cf5-a727-73fd6dbd447b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:35.776703 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4d048f-5bcf-4cf5-a727-73fd6dbd447b None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:35.787708 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 372/746] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:35.788499 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d048f-5bcf-4cf5-a727-73fd6dbd447b None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:35.800851 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 375/747] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Jul 18 10:23:35 2022] POST /identity/v3/services => generated 251 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:23:35.801705 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac156846-00ca-45ee-9315-89b055f6aebf None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:35.806678 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:35.903809 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d048f-5bcf-4cf5-a727-73fd6dbd447b None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:35.951556 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac156846-00ca-45ee-9315-89b055f6aebf None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:35.957107 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878ad6eb-b6ad-472f-9378-121c5d39d2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:35.958231 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ad6eb-b6ad-472f-9378-121c5d39d2d6 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:35.958703 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ad6eb-b6ad-472f-9378-121c5d39d2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:35.959134 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878ad6eb-b6ad-472f-9378-121c5d39d2d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:35.971441 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878ad6eb-b6ad-472f-9378-121c5d39d2d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:35.973245 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878ad6eb-b6ad-472f-9378-121c5d39d2d6 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:35.993897 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-878ad6eb-b6ad-472f-9378-121c5d39d2d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:35.993897 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:35.993897 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:35.993897 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:35.993897 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:35.993897 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:35.993897 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:35.993897 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:35.993897 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:35.993897 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:35.993897 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:35.993897 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:35.993897 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:35.993897 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:35.993897 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:35.994828 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:35.994828 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:35.994828 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:35.994828 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:35.994828 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:35.994828 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:35.994828 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:35.994828 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:35.994828 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:35.994828 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:35.994828 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:35.994828 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:35.994828 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:35.994828 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:35.994828 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:35.994828 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:35.994828 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:35.995722 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:35.995722 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:35.995722 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:35.995722 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:35.995722 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 373/748] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:35.996002 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878ad6eb-b6ad-472f-9378-121c5d39d2d6 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:36.005230 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97339513-b9ae-417a-a630-78e8d5947a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:36.005230 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97339513-b9ae-417a-a630-78e8d5947a4e None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:36.005480 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97339513-b9ae-417a-a630-78e8d5947a4e None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:36.005699 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97339513-b9ae-417a-a630-78e8d5947a4e None admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:36.006451 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97339513-b9ae-417a-a630-78e8d5947a4e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:36.006745 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97339513-b9ae-417a-a630-78e8d5947a4e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:36.008212 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97339513-b9ae-417a-a630-78e8d5947a4e None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:36.032373 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 376/749] 10.222.0.39 () {56 vars in 1133 bytes} [Mon Jul 18 10:23:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:36.036983 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97339513-b9ae-417a-a630-78e8d5947a4e None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:36.072331 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:36.074781 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:36.119630 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878ad6eb-b6ad-472f-9378-121c5d39d2d6 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:36.156266 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca68fb16-58e5-4b7f-9488-6b973169e4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:36.156849 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca68fb16-58e5-4b7f-9488-6b973169e4bf None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:36.157191 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca68fb16-58e5-4b7f-9488-6b973169e4bf None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:36.157468 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca68fb16-58e5-4b7f-9488-6b973169e4bf None admin] PATH_INFO: `/v3/users/swift` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:36.165209 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca68fb16-58e5-4b7f-9488-6b973169e4bf None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:36.166649 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca68fb16-58e5-4b7f-9488-6b973169e4bf None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:36.181890 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-ca68fb16-58e5-4b7f-9488-6b973169e4bf None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 18 10:23:36.181890 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:36.181890 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:36.181890 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:36.181890 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:36.181890 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:36.181890 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:36.181890 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:36.181890 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:36.181890 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:36.181890 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:36.181890 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:36.181890 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:23:36.181890 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:23:36.181890 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:23:36.181890 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:23:36.182886 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:36.182886 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:36.182886 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:23:36.182886 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:23:36.182886 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:23:36.182886 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:23:36.182886 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:36.182886 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:36.182886 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:36.182886 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:36.182886 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:36.182886 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:36.182886 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:36.182886 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:36.182886 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:36.182886 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:36.182886 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:36.182886 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:36.183831 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:36.183831 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:36.183831 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:23:36.183831 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:23:36.183831 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:23:36.183831 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:23:36.183831 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:23:36.183831 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:23:36.183831 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 18 10:23:36.183831 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:36.183831 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 374/750] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 10:23:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:36.184432 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca68fb16-58e5-4b7f-9488-6b973169e4bf None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:36.200583 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97339513-b9ae-417a-a630-78e8d5947a4e None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:36.258334 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9099c5-85f9-4667-9e11-3aa34a5982d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:36.259692 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9099c5-85f9-4667-9e11-3aa34a5982d5 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:36.260764 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9099c5-85f9-4667-9e11-3aa34a5982d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:36.261274 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9099c5-85f9-4667-9e11-3aa34a5982d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:36.262485 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9099c5-85f9-4667-9e11-3aa34a5982d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:36.263330 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9099c5-85f9-4667-9e11-3aa34a5982d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:36.266521 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9099c5-85f9-4667-9e11-3aa34a5982d5 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:36.283047 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 377/751] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:36.283930 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9099c5-85f9-4667-9e11-3aa34a5982d5 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:36.306575 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca68fb16-58e5-4b7f-9488-6b973169e4bf None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:36.331564 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:36.344482 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9619b56-384d-457e-963a-f77eb5c19a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:36.358264 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9619b56-384d-457e-963a-f77eb5c19a94 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:36.358264 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9619b56-384d-457e-963a-f77eb5c19a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:36.358264 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9619b56-384d-457e-963a-f77eb5c19a94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:36.358264 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9619b56-384d-457e-963a-f77eb5c19a94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:36.358264 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9619b56-384d-457e-963a-f77eb5c19a94 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:36.381379 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-e9619b56-384d-457e-963a-f77eb5c19a94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:36.381379 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:36.381379 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:36.381379 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:36.381379 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:36.381379 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:36.381379 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:36.381379 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:36.381379 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:36.381379 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:36.381379 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:36.381379 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:36.381379 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:36.381379 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:36.381379 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:36.382500 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:36.382500 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:36.382500 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:36.382500 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:36.382500 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:36.382500 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:36.382500 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:36.382500 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:36.382500 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:36.382500 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:36.382500 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:36.382500 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:36.382500 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:36.382500 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:36.382500 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:36.382500 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:36.382500 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:36.383582 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:36.383582 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:36.383582 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:36.383582 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:36.389837 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 375/752] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:36.391924 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9619b56-384d-457e-963a-f77eb5c19a94 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:36.397951 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:36.416886 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9099c5-85f9-4667-9e11-3aa34a5982d5 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:36.455994 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf4b13a-21ed-45b3-803c-953fdc8fc50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:36.456727 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4b13a-21ed-45b3-803c-953fdc8fc50f None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:36.456962 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4b13a-21ed-45b3-803c-953fdc8fc50f None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:36.457273 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4b13a-21ed-45b3-803c-953fdc8fc50f None admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:36.458104 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf4b13a-21ed-45b3-803c-953fdc8fc50f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:36.458433 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf4b13a-21ed-45b3-803c-953fdc8fc50f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:36.459848 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf4b13a-21ed-45b3-803c-953fdc8fc50f None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:36.478716 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 378/753] 10.222.0.39 () {56 vars in 1135 bytes} [Mon Jul 18 10:23:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:36.479552 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf4b13a-21ed-45b3-803c-953fdc8fc50f None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:36.528140 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9619b56-384d-457e-963a-f77eb5c19a94 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:36.567460 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053dde66-6a8a-4152-a87e-4bb8cd3122f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:36.568659 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053dde66-6a8a-4152-a87e-4bb8cd3122f8 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:36.569180 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053dde66-6a8a-4152-a87e-4bb8cd3122f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:36.569689 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053dde66-6a8a-4152-a87e-4bb8cd3122f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:36.577981 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053dde66-6a8a-4152-a87e-4bb8cd3122f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:36.579682 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053dde66-6a8a-4152-a87e-4bb8cd3122f8 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:36.586844 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf4b13a-21ed-45b3-803c-953fdc8fc50f None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:36.594983 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-053dde66-6a8a-4152-a87e-4bb8cd3122f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:23:36.594983 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:36.594983 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:36.594983 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:36.594983 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:36.594983 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:36.594983 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:36.594983 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:36.594983 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:36.594983 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:36.594983 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:36.594983 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:36.594983 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:23:36.594983 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:23:36.594983 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:23:36.595864 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:23:36.595864 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:36.595864 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:36.595864 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:36.595864 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:36.595864 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:36.595864 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:36.595864 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:36.595864 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:36.595864 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:36.595864 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:36.595864 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:36.595864 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:36.595864 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:36.595864 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:36.595864 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:36.595864 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:36.596751 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:23:36.596751 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:23:36.596751 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:23:36.596751 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:23:36.596751 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:23:36.596751 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:23:36.596751 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:23:36.596751 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:36.599200 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 376/754] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 10:23:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:36.600293 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053dde66-6a8a-4152-a87e-4bb8cd3122f8 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:36.624749 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f12699-a38d-4e33-972f-2ad6bce68a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:36.625479 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f12699-a38d-4e33-972f-2ad6bce68a0b None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:36.625766 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f12699-a38d-4e33-972f-2ad6bce68a0b None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:36.626051 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f12699-a38d-4e33-972f-2ad6bce68a0b None admin] PATH_INFO: `/v3/domains` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:36.626782 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f12699-a38d-4e33-972f-2ad6bce68a0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:36.627090 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f12699-a38d-4e33-972f-2ad6bce68a0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:36.628577 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f12699-a38d-4e33-972f-2ad6bce68a0b None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:36.637194 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:36.645914 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 379/755] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:36.645914 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f12699-a38d-4e33-972f-2ad6bce68a0b None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:36.652616 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:36.721025 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053dde66-6a8a-4152-a87e-4bb8cd3122f8 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:36.758862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f12699-a38d-4e33-972f-2ad6bce68a0b None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:36.762291 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65234db2-3d35-4fa6-88bd-cb70234c626c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:36.763200 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65234db2-3d35-4fa6-88bd-cb70234c626c None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:36.764803 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65234db2-3d35-4fa6-88bd-cb70234c626c None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:36.765342 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65234db2-3d35-4fa6-88bd-cb70234c626c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:36.797540 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a9de51-d6ed-4ef8-8921-a4572749d942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:36.798094 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a9de51-d6ed-4ef8-8921-a4572749d942 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:36.798389 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a9de51-d6ed-4ef8-8921-a4572749d942 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:36.798675 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a9de51-d6ed-4ef8-8921-a4572749d942 None admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:36.799468 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a9de51-d6ed-4ef8-8921-a4572749d942 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:36.799892 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a9de51-d6ed-4ef8-8921-a4572749d942 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:36.801458 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a9de51-d6ed-4ef8-8921-a4572749d942 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:36.815620 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 380/756] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 10:23:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:36.816452 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a9de51-d6ed-4ef8-8921-a4572749d942 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:36.842138 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65234db2-3d35-4fa6-88bd-cb70234c626c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:36.843941 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65234db2-3d35-4fa6-88bd-cb70234c626c None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:36.880951 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:36.882435 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:36.927012 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a9de51-d6ed-4ef8-8921-a4572749d942 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:36.951619 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 377/757] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 10:23:36 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 10:23:36.952583 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65234db2-3d35-4fa6-88bd-cb70234c626c None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:36.967107 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33316bc5-76f8-484c-a042-17f41f7c5ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:36.968180 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33316bc5-76f8-484c-a042-17f41f7c5ba4 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:36.968762 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33316bc5-76f8-484c-a042-17f41f7c5ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:36.969273 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33316bc5-76f8-484c-a042-17f41f7c5ba4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:36.977288 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33316bc5-76f8-484c-a042-17f41f7c5ba4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:36.978952 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33316bc5-76f8-484c-a042-17f41f7c5ba4 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:36.998006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-33316bc5-76f8-484c-a042-17f41f7c5ba4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:23:36.998006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:36.998006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:36.998006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:36.998006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:36.998006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:36.998006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:36.998006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:36.998006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:36.998006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:36.998006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:36.998006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:36.998006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:23:36.998006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:23:36.998006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:23:36.999369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:23:36.999369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:36.999369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:36.999369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:36.999369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:36.999369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:36.999369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:36.999369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:36.999369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:36.999369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:36.999369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:36.999369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:36.999369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:36.999369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:36.999369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:36.999369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:36.999369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:37.000459 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:23:37.000459 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:23:37.000459 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:23:37.000459 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:23:37.000459 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:23:37.000459 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:23:37.000459 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:23:37.000459 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:37.003111 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 381/758] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 10:23:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:37.004136 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33316bc5-76f8-484c-a042-17f41f7c5ba4 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:37.073178 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65234db2-3d35-4fa6-88bd-cb70234c626c None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:37.119894 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0df9b0-62c0-4089-aeae-4213cb4b4892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:37.120698 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0df9b0-62c0-4089-aeae-4213cb4b4892 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:37.121030 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0df9b0-62c0-4089-aeae-4213cb4b4892 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:37.121339 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0df9b0-62c0-4089-aeae-4213cb4b4892 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:37.122225 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0df9b0-62c0-4089-aeae-4213cb4b4892 None admin] RBAC: Adding query filter params (role.id=d151ec157a524341b7194453e46b6b25, scope.project.id=a6098fe56d304980aa14bd95b4b92c17, user.id=88ad60446c5447a8bbd0096fa2133efb) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:37.122574 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0df9b0-62c0-4089-aeae-4213cb4b4892 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:37.124038 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33316bc5-76f8-484c-a042-17f41f7c5ba4 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:37.125137 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0df9b0-62c0-4089-aeae-4213cb4b4892 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:37.128073 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:37.131485 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 378/759] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 10:23:36 2022] GET /identity/v3/role_assignments?user.id=88ad60446c5447a8bbd0096fa2133efb&scope.project.id=a6098fe56d304980aa14bd95b4b92c17&role.id=d151ec157a524341b7194453e46b6b25 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:37.132375 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0df9b0-62c0-4089-aeae-4213cb4b4892 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:37.166727 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:37.199474 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affe1641-c77c-4c34-a52c-4b3cb771e466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:37.202704 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe1641-c77c-4c34-a52c-4b3cb771e466 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:37.203381 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe1641-c77c-4c34-a52c-4b3cb771e466 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:37.203381 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affe1641-c77c-4c34-a52c-4b3cb771e466 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:37.239044 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affe1641-c77c-4c34-a52c-4b3cb771e466 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:37.240596 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affe1641-c77c-4c34-a52c-4b3cb771e466 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:37.281513 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-affe1641-c77c-4c34-a52c-4b3cb771e466 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:37.281513 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:37.281513 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:37.281513 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:37.281513 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:37.281513 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:37.281513 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:37.281513 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:37.281513 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:37.281513 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:37.281513 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:37.281513 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:37.281513 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:37.281513 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:37.281513 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:37.282666 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:37.282666 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:37.282666 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:37.282666 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:37.282666 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:37.282666 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:37.282666 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:37.282666 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:37.282666 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:37.282666 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:37.282666 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:37.282666 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:37.282666 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:37.282666 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:37.282666 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:37.282666 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:37.282666 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:37.283752 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:37.283752 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:37.283752 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:37.283752 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:37.283752 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 382/760] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:37.289583 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affe1641-c77c-4c34-a52c-4b3cb771e466 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:37.316278 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0df9b0-62c0-4089-aeae-4213cb4b4892 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:37.390376 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af06fc2-6d77-4e9d-a3ec-c305f29f9686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:37.390965 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af06fc2-6d77-4e9d-a3ec-c305f29f9686 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:37.391246 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af06fc2-6d77-4e9d-a3ec-c305f29f9686 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:37.391516 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af06fc2-6d77-4e9d-a3ec-c305f29f9686 None admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:37.392305 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af06fc2-6d77-4e9d-a3ec-c305f29f9686 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:37.392616 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af06fc2-6d77-4e9d-a3ec-c305f29f9686 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:37.394249 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af06fc2-6d77-4e9d-a3ec-c305f29f9686 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:37.419203 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 379/761] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 10:23:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:37.426604 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af06fc2-6d77-4e9d-a3ec-c305f29f9686 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:37.445701 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affe1641-c77c-4c34-a52c-4b3cb771e466 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:37.498668 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c1b47-0db8-4964-a05c-f4845a37f18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:37.499790 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c1b47-0db8-4964-a05c-f4845a37f18d None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:37.500083 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c1b47-0db8-4964-a05c-f4845a37f18d None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:37.500361 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c1b47-0db8-4964-a05c-f4845a37f18d None admin] PATH_INFO: `/v3/domains` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:37.501120 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587c1b47-0db8-4964-a05c-f4845a37f18d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:37.501433 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587c1b47-0db8-4964-a05c-f4845a37f18d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:37.502946 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587c1b47-0db8-4964-a05c-f4845a37f18d None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:37.519247 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 383/762] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:37.524535 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c1b47-0db8-4964-a05c-f4845a37f18d None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:37.541424 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:37.586877 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:37.605996 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af06fc2-6d77-4e9d-a3ec-c305f29f9686 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:37.671458 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9126a44d-17f4-4608-885f-98e2560d0c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:37.672282 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126a44d-17f4-4608-885f-98e2560d0c70 None admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:37.672563 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126a44d-17f4-4608-885f-98e2560d0c70 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:37.672838 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126a44d-17f4-4608-885f-98e2560d0c70 None admin] PATH_INFO: `/v3/projects/a6098fe56d304980aa14bd95b4b92c17/users/8bbebf16219943879df84bdc9a900516/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:37.676653 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9126a44d-17f4-4608-885f-98e2560d0c70 None admin] RBAC: Authorizing `identity:create_grant(project_id=a6098fe56d304980aa14bd95b4b92c17, user_id=8bbebf16219943879df84bdc9a900516, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:37.678119 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9126a44d-17f4-4608-885f-98e2560d0c70 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:37.706312 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c1b47-0db8-4964-a05c-f4845a37f18d None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:37.741575 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058c24ee-ce8f-4411-ae0d-4388b8d77f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:37.742371 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c24ee-ce8f-4411-ae0d-4388b8d77f89 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:37.742655 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c24ee-ce8f-4411-ae0d-4388b8d77f89 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:37.742929 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058c24ee-ce8f-4411-ae0d-4388b8d77f89 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:37.751030 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058c24ee-ce8f-4411-ae0d-4388b8d77f89 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:37.752478 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058c24ee-ce8f-4411-ae0d-4388b8d77f89 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:37.768613 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 380/763] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jul 18 10:23:37 2022] PUT /identity/v3/projects/a6098fe56d304980aa14bd95b4b92c17/users/8bbebf16219943879df84bdc9a900516/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:23:37.771805 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-058c24ee-ce8f-4411-ae0d-4388b8d77f89 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:23:37.771805 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:37.771805 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:37.771805 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:37.771805 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:37.771805 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:37.771805 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:37.771805 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:37.771805 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:37.771805 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:37.771805 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:37.771805 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:37.771805 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:23:37.771805 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:23:37.771805 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:23:37.772687 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:23:37.772687 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:37.772687 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:37.772687 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:37.772687 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:37.772687 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:37.772687 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:37.772687 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:37.772687 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:37.772687 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:37.772687 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:37.772687 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:37.772687 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:37.772687 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:37.772687 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:37.772687 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:37.772687 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:37.780014 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:23:37.780014 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:23:37.780014 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:23:37.780014 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:23:37.780014 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:23:37.780014 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:23:37.780014 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:23:37.780014 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:37.780459 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b8d73-4c96-45e5-aa62-d036a6e44c42 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:37.780459 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b8d73-4c96-45e5-aa62-d036a6e44c42 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:37.780459 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b8d73-4c96-45e5-aa62-d036a6e44c42 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:37.780643 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 384/764] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 10:23:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:23:37.780721 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 381/765] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:23:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:23:37.786102 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa837b1-8f06-4686-91a9-288aba809dd7 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:37.786421 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa837b1-8f06-4686-91a9-288aba809dd7 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:37.786670 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa837b1-8f06-4686-91a9-288aba809dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:37.795509 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b8d73-4c96-45e5-aa62-d036a6e44c42 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:37.814301 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-efa837b1-8f06-4686-91a9-288aba809dd7 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:23:37.815667 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-efa837b1-8f06-4686-91a9-288aba809dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:23:37.976278 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 385/766] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:23:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:23:38.009153 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b8d73-4c96-45e5-aa62-d036a6e44c42 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:38.009483 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa837b1-8f06-4686-91a9-288aba809dd7 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:38.032049 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:38.036717 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:38.067423 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b627f631-366f-46be-bdd4-e59353b20154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:38.068097 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627f631-366f-46be-bdd4-e59353b20154 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:38.068383 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627f631-366f-46be-bdd4-e59353b20154 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:38.068656 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627f631-366f-46be-bdd4-e59353b20154 None admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:38.069481 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b627f631-366f-46be-bdd4-e59353b20154 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:38.069793 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b627f631-366f-46be-bdd4-e59353b20154 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:38.071232 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b627f631-366f-46be-bdd4-e59353b20154 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:38.089140 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 382/767] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 10:23:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:38.089915 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571be96d-17b4-43bd-995c-2578587b3ef9 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:38.090210 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571be96d-17b4-43bd-995c-2578587b3ef9 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:38.090494 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571be96d-17b4-43bd-995c-2578587b3ef9 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:38.092204 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 383/768] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:23:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:23:38.094247 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571be96d-17b4-43bd-995c-2578587b3ef9 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:38.147842 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa837b1-8f06-4686-91a9-288aba809dd7 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:38.189681 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26cd3a-742e-48cd-87ff-7b6f9337028c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:38.190624 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26cd3a-742e-48cd-87ff-7b6f9337028c None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:38.190975 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26cd3a-742e-48cd-87ff-7b6f9337028c None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:38.191317 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26cd3a-742e-48cd-87ff-7b6f9337028c None admin] PATH_INFO: `/v3/services/network` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:38.192051 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df26cd3a-742e-48cd-87ff-7b6f9337028c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:38.193585 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df26cd3a-742e-48cd-87ff-7b6f9337028c None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:38.206737 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-df26cd3a-742e-48cd-87ff-7b6f9337028c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 10:23:38.206737 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:38.206737 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 10:23:38.206737 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 10:23:38.206737 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 10:23:38.206737 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 10:23:38.206737 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 10:23:38.206737 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:23:38.206737 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 10:23:38.206737 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:38.206737 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 10:23:38.206737 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:38.206737 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:38.206737 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:38.206737 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:38.206737 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:38.206737 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:38.207791 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:38.207791 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:38.207791 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:38.207791 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:38.207791 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:38.207791 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:38.207791 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 10:23:38.207791 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 10:23:38.207791 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 10:23:38.207791 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 10:23:38.207791 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:38.207791 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:38.207791 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:38.207791 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:38.207791 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:38.207791 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:38.208626 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:38.208626 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:38.208626 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:38.208626 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:38.208626 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:38.208626 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:38.208626 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:38.208626 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:38.208626 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:38.208626 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:38.208626 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 10:23:38.208626 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:23:38.208626 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 10:23:38.208626 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:38.208626 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 386/769] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 10:23:38 2022] GET /identity/v3/services/network => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:23:38.209823 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf9ad4-eb79-4d42-854c-f9e54523bcd5 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:38.213062 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf9ad4-eb79-4d42-854c-f9e54523bcd5 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:38.213062 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf9ad4-eb79-4d42-854c-f9e54523bcd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:38.228976 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-fadf9ad4-eb79-4d42-854c-f9e54523bcd5 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:23:38.230325 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-fadf9ad4-eb79-4d42-854c-f9e54523bcd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:23:38.305915 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 387/770] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:23:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:23:38.306954 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadf9ad4-eb79-4d42-854c-f9e54523bcd5 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:38.326199 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:38.333533 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571be96d-17b4-43bd-995c-2578587b3ef9 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:38.371598 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f1fbb-2ee1-447d-987b-f673fd91689e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:38.372275 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f1fbb-2ee1-447d-987b-f673fd91689e None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:38.373342 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f1fbb-2ee1-447d-987b-f673fd91689e None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:38.373692 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f1fbb-2ee1-447d-987b-f673fd91689e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:38.374565 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f1fbb-2ee1-447d-987b-f673fd91689e None admin] RBAC: Adding query filter params (role.id=e7b6a55ecf6c491487955aaefbf9c388, scope.project.id=a6098fe56d304980aa14bd95b4b92c17, user.id=2c548474a8d94591ba58dd40e40a28d2) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:38.374882 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f1fbb-2ee1-447d-987b-f673fd91689e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:38.376367 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f1fbb-2ee1-447d-987b-f673fd91689e None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:38.389209 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 384/771] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 10:23:38 2022] GET /identity/v3/role_assignments?user.id=2c548474a8d94591ba58dd40e40a28d2&scope.project.id=a6098fe56d304980aa14bd95b4b92c17&role.id=e7b6a55ecf6c491487955aaefbf9c388 => generated 259 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:38.390245 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f1fbb-2ee1-447d-987b-f673fd91689e None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:38.420499 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadf9ad4-eb79-4d42-854c-f9e54523bcd5 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:38.458323 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaedd4d-e6a1-4ba8-97d6-328b16719c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:38.459166 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaedd4d-e6a1-4ba8-97d6-328b16719c8c None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:38.459362 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaedd4d-e6a1-4ba8-97d6-328b16719c8c None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:38.459644 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaedd4d-e6a1-4ba8-97d6-328b16719c8c None admin] PATH_INFO: `/v3/services` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:38.460360 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaedd4d-e6a1-4ba8-97d6-328b16719c8c None admin] RBAC: Adding query filter params (name=network) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:38.460665 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaedd4d-e6a1-4ba8-97d6-328b16719c8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:38.462080 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaedd4d-e6a1-4ba8-97d6-328b16719c8c None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:38.464283 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:38.467900 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 388/772] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Jul 18 10:23:38 2022] GET /identity/v3/services?name=network => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:38.473332 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaedd4d-e6a1-4ba8-97d6-328b16719c8c None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:38.550574 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f1fbb-2ee1-447d-987b-f673fd91689e None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:38.564061 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:38.584682 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaedd4d-e6a1-4ba8-97d6-328b16719c8c None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:38.624623 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e68be-4e9d-46be-a162-c86e69e015d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:38.625342 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e68be-4e9d-46be-a162-c86e69e015d6 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:38.625630 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e68be-4e9d-46be-a162-c86e69e015d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:38.625902 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e68be-4e9d-46be-a162-c86e69e015d6 None admin] PATH_INFO: `/v3/services` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:38.626625 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737e68be-4e9d-46be-a162-c86e69e015d6 None admin] RBAC: Adding query filter params (type=network) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:38.626931 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737e68be-4e9d-46be-a162-c86e69e015d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:38.631734 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737e68be-4e9d-46be-a162-c86e69e015d6 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:38.634227 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 389/773] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Jul 18 10:23:38 2022] GET /identity/v3/services?type=network => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:38.641513 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e68be-4e9d-46be-a162-c86e69e015d6 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:38.642469 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6451afe0-12d1-4d5c-9910-6f3063e2a3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:38.643342 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451afe0-12d1-4d5c-9910-6f3063e2a3c7 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:38.643626 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451afe0-12d1-4d5c-9910-6f3063e2a3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:38.643899 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451afe0-12d1-4d5c-9910-6f3063e2a3c7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:38.644558 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6451afe0-12d1-4d5c-9910-6f3063e2a3c7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:38.645961 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6451afe0-12d1-4d5c-9910-6f3063e2a3c7 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:38.686691 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-6451afe0-12d1-4d5c-9910-6f3063e2a3c7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 10:23:38.686691 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:38.686691 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 10:23:38.686691 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 10:23:38.686691 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 10:23:38.686691 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 10:23:38.686691 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 10:23:38.686691 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:23:38.686691 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 10:23:38.686691 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:38.686691 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 10:23:38.686691 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:38.686691 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:38.686691 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:38.686691 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:38.686691 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:38.687738 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:38.687738 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:38.687738 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:38.687738 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:38.687738 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:38.687738 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:38.687738 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:38.687738 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 10:23:38.687738 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 10:23:38.687738 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 10:23:38.687738 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 10:23:38.687738 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:38.687738 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:38.687738 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:38.687738 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:38.687738 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:38.689016 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:38.689016 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:38.689016 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:38.689016 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:38.689016 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:38.689016 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:38.689016 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:38.689016 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:38.689016 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:38.689016 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:38.689016 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:38.689016 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 10:23:38.689016 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:23:38.689016 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 10:23:38.689016 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:38.689016 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 385/774] 10.222.0.39 () {56 vars in 1129 bytes} [Mon Jul 18 10:23:38 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:38.697998 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6451afe0-12d1-4d5c-9910-6f3063e2a3c7 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:38.742560 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e68be-4e9d-46be-a162-c86e69e015d6 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:38.778435 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb060e-54b4-441b-a530-c2672f3e270c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:38.779634 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb060e-54b4-441b-a530-c2672f3e270c None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:38.779920 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb060e-54b4-441b-a530-c2672f3e270c None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:38.780194 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb060e-54b4-441b-a530-c2672f3e270c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:38.780990 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdb060e-54b4-441b-a530-c2672f3e270c None admin] RBAC: Adding query filter params (interface=public, service_id=5edb73f71941408d9ac4cd5ca7b3caa9, region_id=RegionOne) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:38.781331 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdb060e-54b4-441b-a530-c2672f3e270c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:38.782695 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdb060e-54b4-441b-a530-c2672f3e270c None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:38.790598 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 390/775] 10.222.0.39 () {56 vars in 1251 bytes} [Mon Jul 18 10:23:38 2022] GET /identity/v3/endpoints?service_id=5edb73f71941408d9ac4cd5ca7b3caa9&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:23:38.796712 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb060e-54b4-441b-a530-c2672f3e270c None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:38.813527 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:38.905964 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb060e-54b4-441b-a530-c2672f3e270c None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:38.942658 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23ce1c-382c-432b-9587-589ff3fc4dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:38.944133 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23ce1c-382c-432b-9587-589ff3fc4dde None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:38.944419 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23ce1c-382c-432b-9587-589ff3fc4dde None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:38.944693 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23ce1c-382c-432b-9587-589ff3fc4dde None admin] PATH_INFO: `/v3/services` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:38.945412 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df23ce1c-382c-432b-9587-589ff3fc4dde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:38.946793 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df23ce1c-382c-432b-9587-589ff3fc4dde None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:38.953673 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 391/776] 10.222.0.39 () {56 vars in 1087 bytes} [Mon Jul 18 10:23:38 2022] GET /identity/v3/services => generated 772 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:23:39.023832 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6451afe0-12d1-4d5c-9910-6f3063e2a3c7 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:39.034096 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:39.079572 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc9895-8cd1-4983-a99a-5cb1cc82d6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:39.080165 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc9895-8cd1-4983-a99a-5cb1cc82d6d8 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:39.080447 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc9895-8cd1-4983-a99a-5cb1cc82d6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:39.080723 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc9895-8cd1-4983-a99a-5cb1cc82d6d8 None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:39.081476 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcc9895-8cd1-4983-a99a-5cb1cc82d6d8 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:39.081783 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcc9895-8cd1-4983-a99a-5cb1cc82d6d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:39.083172 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcc9895-8cd1-4983-a99a-5cb1cc82d6d8 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:39.094199 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 386/777] 10.222.0.39 () {56 vars in 1124 bytes} [Mon Jul 18 10:23:38 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:39.102939 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23ce1c-382c-432b-9587-589ff3fc4dde None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:39.214268 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:39.245747 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23ce1c-382c-432b-9587-589ff3fc4dde None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:39.285143 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee35bf4-09be-4b87-b94d-9415130971dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:39.285896 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee35bf4-09be-4b87-b94d-9415130971dd None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:39.286178 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee35bf4-09be-4b87-b94d-9415130971dd None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:39.286452 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee35bf4-09be-4b87-b94d-9415130971dd None admin] PATH_INFO: `/v3/services` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:39.287218 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee35bf4-09be-4b87-b94d-9415130971dd None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:39.287526 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee35bf4-09be-4b87-b94d-9415130971dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:39.288938 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee35bf4-09be-4b87-b94d-9415130971dd None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:39.295077 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 392/778] 10.222.0.39 () {56 vars in 1124 bytes} [Mon Jul 18 10:23:39 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:39.300934 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc9895-8cd1-4983-a99a-5cb1cc82d6d8 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:39.370563 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28960563-f920-49e8-9c08-21f3244a103f None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:39.370860 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28960563-f920-49e8-9c08-21f3244a103f None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:39.371047 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28960563-f920-49e8-9c08-21f3244a103f None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:39.373089 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 393/779] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:23:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:23:39.378476 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3aac0-2f7e-49bd-abd8-7a1b10a38517 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:39.378783 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3aac0-2f7e-49bd-abd8-7a1b10a38517 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:39.379024 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3aac0-2f7e-49bd-abd8-7a1b10a38517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:39.396967 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-31d3aac0-2f7e-49bd-abd8-7a1b10a38517 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:23:39.398573 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-31d3aac0-2f7e-49bd-abd8-7a1b10a38517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:23:39.449484 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc9895-8cd1-4983-a99a-5cb1cc82d6d8 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:39.518417 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cee039-597b-4b16-b4e7-f9b1a3a04373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:39.520787 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cee039-597b-4b16-b4e7-f9b1a3a04373 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:39.521901 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cee039-597b-4b16-b4e7-f9b1a3a04373 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:39.522392 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cee039-597b-4b16-b4e7-f9b1a3a04373 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:39.523583 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cee039-597b-4b16-b4e7-f9b1a3a04373 None admin] RBAC: Adding query filter params (interface=public, service_id=94d8a4982da54fc89cd29c4ad9dd34e0, region_id=RegionOne) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:39.524873 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cee039-597b-4b16-b4e7-f9b1a3a04373 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:39.527791 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cee039-597b-4b16-b4e7-f9b1a3a04373 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:39.534006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 394/780] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:23:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (3 switches on core 0) Jul 18 10:23:39.543683 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 387/781] 10.222.0.39 () {56 vars in 1251 bytes} [Mon Jul 18 10:23:39 2022] GET /identity/v3/endpoints?service_id=94d8a4982da54fc89cd29c4ad9dd34e0&interface=public®ion_id=RegionOne => generated 194 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:39.549677 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d3aac0-2f7e-49bd-abd8-7a1b10a38517 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:39.597946 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cee039-597b-4b16-b4e7-f9b1a3a04373 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:39.637002 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:39.649471 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:39.705849 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d3aac0-2f7e-49bd-abd8-7a1b10a38517 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:39.714600 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cee039-597b-4b16-b4e7-f9b1a3a04373 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:39.752292 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485c8b48-bb36-49e4-aaf4-22e7bdffe1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:39.753494 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c8b48-bb36-49e4-aaf4-22e7bdffe1ca None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:39.754029 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c8b48-bb36-49e4-aaf4-22e7bdffe1ca None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:39.754637 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c8b48-bb36-49e4-aaf4-22e7bdffe1ca None admin] PATH_INFO: `/v3/roles/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:39.766633 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485c8b48-bb36-49e4-aaf4-22e7bdffe1ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:23:39.774870 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-485c8b48-bb36-49e4-aaf4-22e7bdffe1ca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:23:39.774870 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:39.774870 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:39.774870 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:39.774870 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:39.774870 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:39.774870 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:39.774870 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:39.774870 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:39.774870 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:39.774870 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:39.774870 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:39.774870 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:23:39.774870 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:23:39.774870 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:23:39.774870 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:23:39.775795 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:23:39.775795 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:23:39.775795 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:23:39.775795 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:23:39.775795 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:39.775795 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:39.775795 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:39.775795 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:39.775795 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:39.775795 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:39.775795 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:39.775795 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:39.775795 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:39.775795 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:39.775795 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:39.775795 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:39.776640 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:39.776640 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:39.776640 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:39.776640 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:39.776640 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:23:39.776640 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:23:39.776640 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:23:39.776640 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:23:39.776640 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:23:39.776640 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:23:39.776640 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:23:39.776640 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:39.779236 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dec06c-b675-4c51-90b0-467d0f259efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:39.779753 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 388/782] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jul 18 10:23:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:23:39.783653 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dec06c-b675-4c51-90b0-467d0f259efc None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:39.783653 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dec06c-b675-4c51-90b0-467d0f259efc None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:39.783653 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dec06c-b675-4c51-90b0-467d0f259efc None admin] PATH_INFO: `/v3/services` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:39.783653 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dec06c-b675-4c51-90b0-467d0f259efc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:39.783653 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dec06c-b675-4c51-90b0-467d0f259efc None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:39.786327 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485c8b48-bb36-49e4-aaf4-22e7bdffe1ca None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:39.798406 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 395/783] 10.222.0.39 () {56 vars in 1087 bytes} [Mon Jul 18 10:23:39 2022] GET /identity/v3/services => generated 772 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:39.891756 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:39.899768 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485c8b48-bb36-49e4-aaf4-22e7bdffe1ca None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:39.941602 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d33c59d-d96b-4d22-98a9-7d628de35e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:39.942671 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33c59d-d96b-4d22-98a9-7d628de35e5d None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:39.943188 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33c59d-d96b-4d22-98a9-7d628de35e5d None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:39.943676 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33c59d-d96b-4d22-98a9-7d628de35e5d None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:39.944680 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d33c59d-d96b-4d22-98a9-7d628de35e5d None admin] RBAC: Adding query filter params (name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:39.945259 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d33c59d-d96b-4d22-98a9-7d628de35e5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:39.946875 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d33c59d-d96b-4d22-98a9-7d628de35e5d None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:39.958019 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 389/784] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Jul 18 10:23:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:23:39.964158 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dec06c-b675-4c51-90b0-467d0f259efc None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:40.081512 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dec06c-b675-4c51-90b0-467d0f259efc None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:40.119821 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:40.126704 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c07b4d-1c6a-4cf6-ad82-6936394923c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:40.131487 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c07b4d-1c6a-4cf6-ad82-6936394923c8 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:40.131487 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c07b4d-1c6a-4cf6-ad82-6936394923c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:40.131487 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c07b4d-1c6a-4cf6-ad82-6936394923c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:40.140536 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c07b4d-1c6a-4cf6-ad82-6936394923c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:40.142427 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c07b4d-1c6a-4cf6-ad82-6936394923c8 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:40.161797 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-a8c07b4d-1c6a-4cf6-ad82-6936394923c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:40.161797 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:40.161797 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:40.161797 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:40.161797 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:40.161797 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:40.161797 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:40.161797 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:40.161797 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:40.161797 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:40.161797 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:40.161797 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:40.161797 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:40.161797 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:40.161797 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:40.162727 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:40.162727 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:40.162727 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:40.162727 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:40.162727 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:40.162727 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:40.162727 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:40.162727 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:40.162727 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:40.162727 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:40.162727 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:40.162727 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:40.162727 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:40.162727 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:40.162727 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:40.162727 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:40.162727 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:40.163602 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:40.163602 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:40.163602 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:40.163602 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:40.165938 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 396/785] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:40.172935 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d33c59d-d96b-4d22-98a9-7d628de35e5d None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:40.282472 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d33c59d-d96b-4d22-98a9-7d628de35e5d None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:40.318683 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8227c2b4-6d15-4485-9d95-9392c708eefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:40.319766 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8227c2b4-6d15-4485-9d95-9392c708eefe None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:40.320281 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8227c2b4-6d15-4485-9d95-9392c708eefe None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:40.320771 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8227c2b4-6d15-4485-9d95-9392c708eefe None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:40.321755 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8227c2b4-6d15-4485-9d95-9392c708eefe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:40.322270 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8227c2b4-6d15-4485-9d95-9392c708eefe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:40.323824 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8227c2b4-6d15-4485-9d95-9392c708eefe None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:40.337716 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 390/786] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:40.344226 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c07b4d-1c6a-4cf6-ad82-6936394923c8 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:40.465314 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c07b4d-1c6a-4cf6-ad82-6936394923c8 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:40.522323 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1013e154-8c09-476b-9959-32ccca4656d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:40.523537 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013e154-8c09-476b-9959-32ccca4656d1 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:40.524077 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013e154-8c09-476b-9959-32ccca4656d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:40.524576 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013e154-8c09-476b-9959-32ccca4656d1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:40.533785 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1013e154-8c09-476b-9959-32ccca4656d1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:40.535244 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1013e154-8c09-476b-9959-32ccca4656d1 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:40.546426 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ce3d1-e2a3-4898-8cd7-cceb35e9333c None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:40.547053 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ce3d1-e2a3-4898-8cd7-cceb35e9333c None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:40.547537 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ce3d1-e2a3-4898-8cd7-cceb35e9333c None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:40.549418 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 391/787] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:23:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:23:40.554685 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1c8a3-7a53-429e-93d1-1d2b4892fa1d None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:40.555202 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1c8a3-7a53-429e-93d1-1d2b4892fa1d None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:40.555706 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1c8a3-7a53-429e-93d1-1d2b4892fa1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:40.556278 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-1013e154-8c09-476b-9959-32ccca4656d1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 10:23:40.556278 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:40.556278 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:40.556278 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:40.556278 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:40.556278 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:40.556278 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:40.556278 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:40.556278 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:40.556278 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:40.556278 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:40.556278 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:40.556278 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:23:40.556278 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:23:40.556278 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:23:40.556278 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:23:40.557209 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:40.557209 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:40.557209 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:23:40.557209 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:23:40.557209 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:23:40.557209 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:23:40.557209 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:40.557209 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:40.557209 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:40.557209 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:40.557209 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:40.557209 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:40.557209 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:40.557209 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:40.557209 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:40.557209 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:40.557209 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:40.557209 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:40.558145 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:40.558145 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:40.558145 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:23:40.558145 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:23:40.558145 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:23:40.558145 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:23:40.558145 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:23:40.558145 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:23:40.558145 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 10:23:40.558145 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:40.558145 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 397/788] 10.222.0.39 () {56 vars in 1117 bytes} [Mon Jul 18 10:23:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:40.566849 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1013e154-8c09-476b-9959-32ccca4656d1 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:40.583106 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-cfa1c8a3-7a53-429e-93d1-1d2b4892fa1d None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:23:40.584652 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-cfa1c8a3-7a53-429e-93d1-1d2b4892fa1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:23:40.611287 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:40.625422 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:40.673824 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 392/789] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:23:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 10:23:40.700556 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa1c8a3-7a53-429e-93d1-1d2b4892fa1d None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:40.747914 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1013e154-8c09-476b-9959-32ccca4656d1 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:40.786302 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdeb668-e852-49e3-8e21-6582392caede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:40.786978 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdeb668-e852-49e3-8e21-6582392caede None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:40.787259 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdeb668-e852-49e3-8e21-6582392caede None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:40.787535 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdeb668-e852-49e3-8e21-6582392caede None admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:40.788373 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdeb668-e852-49e3-8e21-6582392caede None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:40.788680 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdeb668-e852-49e3-8e21-6582392caede None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:40.790131 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdeb668-e852-49e3-8e21-6582392caede None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:40.807653 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 398/790] 10.222.0.39 () {56 vars in 1149 bytes} [Mon Jul 18 10:23:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:23:40.809029 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9752a-b285-4338-9e69-156331667269 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:40.809336 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9752a-b285-4338-9e69-156331667269 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:40.809617 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9752a-b285-4338-9e69-156331667269 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:40.815727 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 399/791] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:23:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:23:40.816548 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9752a-b285-4338-9e69-156331667269 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:40.832461 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa1c8a3-7a53-429e-93d1-1d2b4892fa1d None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:40.867750 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40249e-cb1a-4916-bdd6-e4ce2b709bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:40.868601 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40249e-cb1a-4916-bdd6-e4ce2b709bfb None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:40.868890 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40249e-cb1a-4916-bdd6-e4ce2b709bfb None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:40.869201 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40249e-cb1a-4916-bdd6-e4ce2b709bfb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:40.880862 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b40249e-cb1a-4916-bdd6-e4ce2b709bfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:23:40.889972 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-5b40249e-cb1a-4916-bdd6-e4ce2b709bfb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:23:40.889972 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:40.889972 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:40.889972 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:40.889972 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:40.889972 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:40.889972 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:40.889972 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:40.889972 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:40.889972 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:40.889972 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:40.889972 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:40.889972 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:23:40.889972 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:23:40.889972 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:23:40.889972 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:23:40.890914 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:23:40.890914 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:23:40.890914 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:23:40.890914 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:23:40.890914 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:40.890914 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:40.890914 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:40.890914 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:40.890914 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:40.890914 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:40.890914 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:40.890914 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:40.890914 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:40.890914 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:40.890914 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:40.890914 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:40.892057 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:40.892057 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:40.892057 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:40.892057 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:40.892057 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:23:40.892057 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:23:40.892057 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:23:40.892057 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:23:40.892057 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:23:40.892057 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:23:40.892057 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:23:40.892057 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:40.892057 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 393/792] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 10:23:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:23:40.897674 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5dc42f-3bba-449a-b58c-74cec3bfa3a3 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:40.897963 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5dc42f-3bba-449a-b58c-74cec3bfa3a3 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:40.898247 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5dc42f-3bba-449a-b58c-74cec3bfa3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:40.910389 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:40.915593 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-da5dc42f-3bba-449a-b58c-74cec3bfa3a3 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:23:40.916793 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-da5dc42f-3bba-449a-b58c-74cec3bfa3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:23:40.923731 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9752a-b285-4338-9e69-156331667269 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:40.933384 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:40.959853 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4798296b-0544-463b-9a36-8c499d9cce1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:40.960788 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798296b-0544-463b-9a36-8c499d9cce1a None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:40.961180 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798296b-0544-463b-9a36-8c499d9cce1a None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:40.961531 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798296b-0544-463b-9a36-8c499d9cce1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:40.973000 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4798296b-0544-463b-9a36-8c499d9cce1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:40.974606 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4798296b-0544-463b-9a36-8c499d9cce1a None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:40.993463 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 394/793] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:23:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:23:40.994388 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5dc42f-3bba-449a-b58c-74cec3bfa3a3 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:40.998159 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-4798296b-0544-463b-9a36-8c499d9cce1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:40.998159 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:40.998159 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:40.998159 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:40.998159 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:40.998159 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:40.998159 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:40.998159 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:40.998159 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:40.998159 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:40.998159 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:40.998159 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:40.998159 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:40.998159 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:40.998159 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:40.999233 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:40.999233 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:40.999233 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:40.999233 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:40.999233 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:40.999233 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:40.999233 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:40.999233 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:40.999233 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:40.999233 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:40.999233 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:40.999233 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:40.999233 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:40.999233 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:40.999233 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:40.999233 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:40.999233 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:41.000341 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:41.000341 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:41.000341 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:41.000341 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:41.010051 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 400/794] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:41.018214 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4798296b-0544-463b-9a36-8c499d9cce1a None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:41.124890 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5dc42f-3bba-449a-b58c-74cec3bfa3a3 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:41.148590 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4798296b-0544-463b-9a36-8c499d9cce1a None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:41.166611 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0234555c-2d2b-4da6-bc93-e181c4a77eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:41.167474 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234555c-2d2b-4da6-bc93-e181c4a77eab None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:41.167851 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234555c-2d2b-4da6-bc93-e181c4a77eab None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:41.168307 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234555c-2d2b-4da6-bc93-e181c4a77eab None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:41.169280 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0234555c-2d2b-4da6-bc93-e181c4a77eab None admin] RBAC: Adding query filter params (name=admin) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:41.169891 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0234555c-2d2b-4da6-bc93-e181c4a77eab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:41.171475 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0234555c-2d2b-4da6-bc93-e181c4a77eab None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:41.174392 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:41.185497 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 395/795] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 10:23:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:41.185497 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0234555c-2d2b-4da6-bc93-e181c4a77eab None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:41.299871 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0234555c-2d2b-4da6-bc93-e181c4a77eab None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:41.317880 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7591a3-a404-4ad9-a9c2-2583f8f9ce7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:41.319037 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7591a3-a404-4ad9-a9c2-2583f8f9ce7b None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:41.319482 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7591a3-a404-4ad9-a9c2-2583f8f9ce7b None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:41.319949 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7591a3-a404-4ad9-a9c2-2583f8f9ce7b None admin] PATH_INFO: `/v3/domains` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:41.320904 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7591a3-a404-4ad9-a9c2-2583f8f9ce7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:41.321439 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7591a3-a404-4ad9-a9c2-2583f8f9ce7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:41.323354 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7591a3-a404-4ad9-a9c2-2583f8f9ce7b None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:41.342251 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 401/796] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:41.343644 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59564a9-0822-44ff-965f-1b5b223e2e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:41.343866 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7591a3-a404-4ad9-a9c2-2583f8f9ce7b None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:41.344658 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59564a9-0822-44ff-965f-1b5b223e2e59 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:41.345009 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59564a9-0822-44ff-965f-1b5b223e2e59 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:41.345368 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59564a9-0822-44ff-965f-1b5b223e2e59 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:41.360774 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59564a9-0822-44ff-965f-1b5b223e2e59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:23:41.363769 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:41.370498 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-c59564a9-0822-44ff-965f-1b5b223e2e59 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:23:41.370498 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:41.370498 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:41.370498 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:41.370498 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:41.370498 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:41.370498 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:41.370498 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:41.370498 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:41.370498 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:41.370498 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:41.370498 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:41.370498 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:23:41.370498 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:23:41.370498 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:23:41.370498 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:23:41.371436 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:23:41.371436 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:23:41.371436 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:23:41.371436 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:23:41.371436 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:41.371436 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:41.371436 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:41.371436 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:41.371436 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:41.371436 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:41.371436 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:41.371436 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:41.371436 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:41.371436 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:41.371436 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:41.371436 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:41.372384 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:41.372384 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:41.372384 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:41.372384 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:41.372384 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:23:41.372384 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:23:41.372384 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:23:41.372384 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:23:41.372384 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:23:41.372384 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:23:41.372384 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:23:41.372384 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:41.377125 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 396/797] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 10:23:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:41.379298 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59564a9-0822-44ff-965f-1b5b223e2e59 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:41.454721 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:41.469979 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7591a3-a404-4ad9-a9c2-2583f8f9ce7b None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:41.506462 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59564a9-0822-44ff-965f-1b5b223e2e59 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:41.509209 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad30865-f7fa-4931-94c9-33b253b193f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:41.510236 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad30865-f7fa-4931-94c9-33b253b193f9 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:41.510698 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad30865-f7fa-4931-94c9-33b253b193f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:41.511123 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad30865-f7fa-4931-94c9-33b253b193f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:41.523787 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad30865-f7fa-4931-94c9-33b253b193f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:41.525670 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad30865-f7fa-4931-94c9-33b253b193f9 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:41.544297 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19247a67-1873-460c-b57e-31208aaa1a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:41.544912 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-0ad30865-f7fa-4931-94c9-33b253b193f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:41.544912 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:41.544912 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:41.544912 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:41.544912 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:41.544912 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:41.544912 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:41.544912 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:41.544912 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:41.544912 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:41.544912 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:41.544912 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:41.544912 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:41.544912 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:41.544912 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:41.546373 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:41.546373 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:41.546373 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:41.546373 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:41.546373 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:41.546373 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:41.546373 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:41.546373 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:41.546373 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:41.546373 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:41.546373 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:41.546373 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:41.546373 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:41.546373 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:41.546373 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:41.546373 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:41.546373 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:41.547484 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:41.547484 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:41.547484 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:41.547484 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:41.547752 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19247a67-1873-460c-b57e-31208aaa1a9d None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:41.547752 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19247a67-1873-460c-b57e-31208aaa1a9d None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:41.547752 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19247a67-1873-460c-b57e-31208aaa1a9d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:41.554207 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19247a67-1873-460c-b57e-31208aaa1a9d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:41.554404 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 402/798] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:41.555394 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad30865-f7fa-4931-94c9-33b253b193f9 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:41.555748 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19247a67-1873-460c-b57e-31208aaa1a9d None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:41.573873 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-19247a67-1873-460c-b57e-31208aaa1a9d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:23:41.573873 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:41.573873 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:41.573873 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:41.573873 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:41.573873 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:41.573873 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:41.573873 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:41.573873 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:41.573873 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:41.573873 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:41.573873 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:41.573873 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:23:41.573873 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:23:41.573873 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:23:41.575007 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:23:41.575007 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:41.575007 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:41.575007 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:41.575007 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:41.575007 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:41.575007 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:41.575007 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:41.575007 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:41.575007 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:41.575007 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:41.575007 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:41.575007 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:41.575007 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:41.575007 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:41.575007 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:41.575007 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:41.576807 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:23:41.576807 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:23:41.576807 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:23:41.576807 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:23:41.576807 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:23:41.576807 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:23:41.576807 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:23:41.576807 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:41.583354 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 397/799] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 10:23:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:41.584334 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19247a67-1873-460c-b57e-31208aaa1a9d None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:41.623979 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:41.670892 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad30865-f7fa-4931-94c9-33b253b193f9 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:41.694138 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19247a67-1873-460c-b57e-31208aaa1a9d None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:41.705504 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e4f1b-009e-4801-8ff0-28a4bf9b4c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:41.706182 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e4f1b-009e-4801-8ff0-28a4bf9b4c58 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:41.706470 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e4f1b-009e-4801-8ff0-28a4bf9b4c58 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:41.706749 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e4f1b-009e-4801-8ff0-28a4bf9b4c58 None admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:41.707501 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64e4f1b-009e-4801-8ff0-28a4bf9b4c58 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:41.707812 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64e4f1b-009e-4801-8ff0-28a4bf9b4c58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:41.709208 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64e4f1b-009e-4801-8ff0-28a4bf9b4c58 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:41.715221 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:41.723957 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 403/800] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 10:23:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:41.725188 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79264bc3-3130-4ed0-863e-6159b9abac78 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:41.725487 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79264bc3-3130-4ed0-863e-6159b9abac78 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:41.731081 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79264bc3-3130-4ed0-863e-6159b9abac78 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:41.731081 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 404/801] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:23:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:23:41.731081 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79264bc3-3130-4ed0-863e-6159b9abac78 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:41.735470 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a558c-71a0-4341-b619-754c6c6ee46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:41.736140 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a558c-71a0-4341-b619-754c6c6ee46f None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:41.736427 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a558c-71a0-4341-b619-754c6c6ee46f None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:41.736702 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a558c-71a0-4341-b619-754c6c6ee46f None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:41.737717 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6a558c-71a0-4341-b619-754c6c6ee46f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:41.738036 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6a558c-71a0-4341-b619-754c6c6ee46f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:41.739388 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6a558c-71a0-4341-b619-754c6c6ee46f None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:41.751292 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 398/802] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:41.752118 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a558c-71a0-4341-b619-754c6c6ee46f None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:41.841264 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79264bc3-3130-4ed0-863e-6159b9abac78 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:41.858535 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a558c-71a0-4341-b619-754c6c6ee46f None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:41.869362 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:41.879507 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14f7e4-4bde-42af-bb86-2d2d59431e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:41.880177 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14f7e4-4bde-42af-bb86-2d2d59431e91 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:41.880463 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14f7e4-4bde-42af-bb86-2d2d59431e91 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:41.880740 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14f7e4-4bde-42af-bb86-2d2d59431e91 None admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:41.882001 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef14f7e4-4bde-42af-bb86-2d2d59431e91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:41.882474 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef14f7e4-4bde-42af-bb86-2d2d59431e91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:41.883925 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef14f7e4-4bde-42af-bb86-2d2d59431e91 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:41.895656 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b144a3a4-0079-44ab-a20f-6b596c427024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:41.900724 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 405/803] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 10:23:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:41.900845 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144a3a4-0079-44ab-a20f-6b596c427024 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:41.900845 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144a3a4-0079-44ab-a20f-6b596c427024 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:41.900845 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144a3a4-0079-44ab-a20f-6b596c427024 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:41.901225 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe435bc-e801-4783-9474-84bc56eeabff None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:41.901225 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe435bc-e801-4783-9474-84bc56eeabff None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:41.901225 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe435bc-e801-4783-9474-84bc56eeabff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:41.912393 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b144a3a4-0079-44ab-a20f-6b596c427024 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:41.913980 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b144a3a4-0079-44ab-a20f-6b596c427024 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:41.916751 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-ffe435bc-e801-4783-9474-84bc56eeabff None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:23:41.917747 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-ffe435bc-e801-4783-9474-84bc56eeabff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:23:41.933161 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-b144a3a4-0079-44ab-a20f-6b596c427024 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:41.933161 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:41.933161 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:41.933161 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:41.933161 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:41.933161 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:41.933161 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:41.933161 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:41.933161 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:41.933161 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:41.933161 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:41.933161 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:41.933161 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:41.933161 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:41.933161 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:41.934284 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:41.934284 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:41.934284 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:41.934284 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:41.934284 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:41.934284 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:41.934284 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:41.934284 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:41.934284 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:41.934284 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:41.934284 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:41.934284 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:41.934284 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:41.934284 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:41.934284 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:41.934284 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:41.934284 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:41.936032 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:41.936032 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:41.936032 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:41.936032 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:41.941370 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 399/804] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:41.941370 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b144a3a4-0079-44ab-a20f-6b596c427024 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:41.970619 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:41.997902 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 406/805] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:23:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:23:41.999127 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe435bc-e801-4783-9474-84bc56eeabff None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:42.065174 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b144a3a4-0079-44ab-a20f-6b596c427024 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:42.104764 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df726392-6874-47f9-9287-dde459da6612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:42.105734 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df726392-6874-47f9-9287-dde459da6612 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:42.106153 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df726392-6874-47f9-9287-dde459da6612 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:42.106301 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df726392-6874-47f9-9287-dde459da6612 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:42.112245 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe435bc-e801-4783-9474-84bc56eeabff None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:42.114906 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df726392-6874-47f9-9287-dde459da6612 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:42.116337 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df726392-6874-47f9-9287-dde459da6612 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:42.131350 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-df726392-6874-47f9-9287-dde459da6612 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 10:23:42.131350 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:42.131350 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:42.131350 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:42.131350 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:42.131350 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:42.131350 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:42.131350 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:42.131350 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:42.131350 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:42.131350 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:42.131350 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:42.131350 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:23:42.131350 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:23:42.131350 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:23:42.131350 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:23:42.132344 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:42.132344 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:42.132344 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:23:42.132344 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:23:42.132344 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:23:42.132344 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:23:42.132344 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:42.132344 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:42.132344 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:42.132344 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:42.132344 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:42.132344 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:42.132344 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:42.132344 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:42.132344 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:42.132344 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:42.132344 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:42.132344 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:42.133316 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:42.133316 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:42.133316 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:23:42.133316 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:23:42.133316 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:23:42.133316 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:23:42.133316 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:23:42.133316 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:23:42.133316 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 10:23:42.133316 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:42.134295 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:42.134382 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 400/806] 10.222.0.39 () {56 vars in 1093 bytes} [Mon Jul 18 10:23:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:42.134382 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df726392-6874-47f9-9287-dde459da6612 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:42.156482 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af866528-381f-4c87-87b1-89452a58f0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:42.157421 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af866528-381f-4c87-87b1-89452a58f0a9 None admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:42.157705 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af866528-381f-4c87-87b1-89452a58f0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:42.157984 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af866528-381f-4c87-87b1-89452a58f0a9 None admin] PATH_INFO: `/v3/projects/a6098fe56d304980aa14bd95b4b92c17/users/88ad60446c5447a8bbd0096fa2133efb/roles/d151ec157a524341b7194453e46b6b25` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:42.174503 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af866528-381f-4c87-87b1-89452a58f0a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=a6098fe56d304980aa14bd95b4b92c17, user_id=88ad60446c5447a8bbd0096fa2133efb, role_id=d151ec157a524341b7194453e46b6b25)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:42.175968 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af866528-381f-4c87-87b1-89452a58f0a9 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:42.232443 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:42.239167 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 407/807] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jul 18 10:23:41 2022] PUT /identity/v3/projects/a6098fe56d304980aa14bd95b4b92c17/users/88ad60446c5447a8bbd0096fa2133efb/roles/d151ec157a524341b7194453e46b6b25 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:23:42.240026 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af866528-381f-4c87-87b1-89452a58f0a9 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:42.244190 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df726392-6874-47f9-9287-dde459da6612 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:42.285019 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c5037d-ce0d-4b20-a6d8-6c8d960d8122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:42.286029 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c5037d-ce0d-4b20-a6d8-6c8d960d8122 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:42.286466 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c5037d-ce0d-4b20-a6d8-6c8d960d8122 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:42.286897 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c5037d-ce0d-4b20-a6d8-6c8d960d8122 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:42.287857 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c5037d-ce0d-4b20-a6d8-6c8d960d8122 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:42.288335 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c5037d-ce0d-4b20-a6d8-6c8d960d8122 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:42.289933 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c5037d-ce0d-4b20-a6d8-6c8d960d8122 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:42.303434 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 401/808] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:42.304390 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c5037d-ce0d-4b20-a6d8-6c8d960d8122 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:42.373196 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af866528-381f-4c87-87b1-89452a58f0a9 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:42.417984 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda8fa8-95e5-492d-a1b4-65738480e687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:42.418787 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda8fa8-95e5-492d-a1b4-65738480e687 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:42.419074 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda8fa8-95e5-492d-a1b4-65738480e687 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:42.419380 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda8fa8-95e5-492d-a1b4-65738480e687 None admin] PATH_INFO: `/v3/services/network` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:42.420034 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda8fa8-95e5-492d-a1b4-65738480e687 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:42.421437 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda8fa8-95e5-492d-a1b4-65738480e687 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:42.426094 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c5037d-ce0d-4b20-a6d8-6c8d960d8122 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:42.433263 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-ecda8fa8-95e5-492d-a1b4-65738480e687 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 10:23:42.433263 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:42.433263 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 10:23:42.433263 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 10:23:42.433263 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 10:23:42.433263 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 10:23:42.433263 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 10:23:42.433263 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:23:42.433263 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 10:23:42.433263 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:42.433263 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 10:23:42.433263 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:42.433263 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:42.433263 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:42.433263 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:42.433263 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:42.433263 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:42.434480 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:42.434480 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:42.434480 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:42.434480 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:42.434480 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:42.434480 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:42.434480 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 10:23:42.434480 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 10:23:42.434480 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 10:23:42.434480 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 10:23:42.434480 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:42.434480 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:42.434480 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:42.434480 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:42.434480 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:42.434480 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:42.436419 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:42.436419 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:42.436419 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:42.436419 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:42.436419 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:42.436419 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:42.436419 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:42.436419 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:42.436419 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:42.436419 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:42.436419 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 10:23:42.436419 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:23:42.436419 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 10:23:42.436419 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:42.436419 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 408/809] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 10:23:42 2022] GET /identity/v3/services/network => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:42.437454 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b66d0-3922-4e89-86ac-d2a19a83917a None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:42.437454 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b66d0-3922-4e89-86ac-d2a19a83917a None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:42.437454 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b66d0-3922-4e89-86ac-d2a19a83917a None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:42.438337 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 409/810] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:23:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:23:42.439028 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b66d0-3922-4e89-86ac-d2a19a83917a None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:42.471531 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df5000-8f99-4ad3-8369-43f7b3f5a2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:42.472204 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df5000-8f99-4ad3-8369-43f7b3f5a2f9 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:42.472492 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df5000-8f99-4ad3-8369-43f7b3f5a2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:42.472765 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df5000-8f99-4ad3-8369-43f7b3f5a2f9 None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:42.473628 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1df5000-8f99-4ad3-8369-43f7b3f5a2f9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:42.473935 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1df5000-8f99-4ad3-8369-43f7b3f5a2f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:42.475339 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1df5000-8f99-4ad3-8369-43f7b3f5a2f9 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:42.475911 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:42.495318 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 402/811] 10.222.0.39 () {56 vars in 1133 bytes} [Mon Jul 18 10:23:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:42.496247 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df5000-8f99-4ad3-8369-43f7b3f5a2f9 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:42.508617 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:42.551401 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b66d0-3922-4e89-86ac-d2a19a83917a None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:42.589526 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb4f7e-4e6f-494e-bfd5-ee8a34ccc2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:42.590331 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb4f7e-4e6f-494e-bfd5-ee8a34ccc2d3 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:42.590615 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb4f7e-4e6f-494e-bfd5-ee8a34ccc2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:42.590910 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb4f7e-4e6f-494e-bfd5-ee8a34ccc2d3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:42.599909 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcb4f7e-4e6f-494e-bfd5-ee8a34ccc2d3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:42.601373 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcb4f7e-4e6f-494e-bfd5-ee8a34ccc2d3 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:42.605701 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df5000-8f99-4ad3-8369-43f7b3f5a2f9 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:42.616301 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-9bcb4f7e-4e6f-494e-bfd5-ee8a34ccc2d3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 18 10:23:42.616301 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:42.616301 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:42.616301 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:42.616301 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:42.616301 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:42.616301 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:42.616301 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:42.616301 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:42.616301 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:42.616301 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:42.616301 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:42.616301 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:23:42.616301 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:23:42.616301 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:23:42.616301 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:23:42.617514 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:42.617514 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:42.617514 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:23:42.617514 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:23:42.617514 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:23:42.617514 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:23:42.617514 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:42.617514 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:42.617514 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:42.617514 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:42.617514 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:42.617514 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:42.617514 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:42.617514 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:42.617514 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:42.617514 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:42.617514 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:42.617514 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:42.618694 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:42.618694 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:42.618694 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:23:42.618694 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:23:42.618694 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:23:42.618694 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:23:42.618694 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:23:42.618694 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:23:42.618694 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 18 10:23:42.618694 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:42.618694 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 410/812] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 10:23:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:42.618694 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723f07f-e605-4172-a46c-bf2ba73aa657 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:42.619478 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723f07f-e605-4172-a46c-bf2ba73aa657 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:42.619478 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723f07f-e605-4172-a46c-bf2ba73aa657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:42.636394 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-7723f07f-e605-4172-a46c-bf2ba73aa657 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:23:42.638381 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-7723f07f-e605-4172-a46c-bf2ba73aa657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:23:42.646918 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bfe763-3a42-4f4d-afc1-177f3649d895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:42.647709 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfe763-3a42-4f4d-afc1-177f3649d895 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:42.648065 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfe763-3a42-4f4d-afc1-177f3649d895 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:42.648400 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfe763-3a42-4f4d-afc1-177f3649d895 None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:42.649204 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bfe763-3a42-4f4d-afc1-177f3649d895 None admin] RBAC: Adding query filter params (name=network) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:42.649572 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bfe763-3a42-4f4d-afc1-177f3649d895 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:42.650972 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bfe763-3a42-4f4d-afc1-177f3649d895 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:42.656485 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 403/813] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Jul 18 10:23:42 2022] GET /identity/v3/services?name=network => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:42.657248 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bfe763-3a42-4f4d-afc1-177f3649d895 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:42.725102 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 411/814] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:23:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:23:42.725102 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723f07f-e605-4172-a46c-bf2ba73aa657 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:42.740553 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:42.748243 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:42.783129 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bfe763-3a42-4f4d-afc1-177f3649d895 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:42.820645 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb8e216-38af-4c11-8012-bd906d748b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:42.821338 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8e216-38af-4c11-8012-bd906d748b14 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:42.821623 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8e216-38af-4c11-8012-bd906d748b14 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:42.821898 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8e216-38af-4c11-8012-bd906d748b14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:42.822503 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723f07f-e605-4172-a46c-bf2ba73aa657 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:42.857062 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b4658-d11f-4e9d-a51a-7cbafa2ff4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:42.857877 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b4658-d11f-4e9d-a51a-7cbafa2ff4ad None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:42.858221 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b4658-d11f-4e9d-a51a-7cbafa2ff4ad None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:42.858556 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b4658-d11f-4e9d-a51a-7cbafa2ff4ad None admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:42.859381 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860b4658-d11f-4e9d-a51a-7cbafa2ff4ad None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:42.859688 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860b4658-d11f-4e9d-a51a-7cbafa2ff4ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:42.861306 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860b4658-d11f-4e9d-a51a-7cbafa2ff4ad None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:42.878827 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 412/815] 10.222.0.39 () {56 vars in 1135 bytes} [Mon Jul 18 10:23:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:42.879642 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b4658-d11f-4e9d-a51a-7cbafa2ff4ad None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:42.896837 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb8e216-38af-4c11-8012-bd906d748b14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:42.898308 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb8e216-38af-4c11-8012-bd906d748b14 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:42.968097 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:42.969869 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:42.992495 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b4658-d11f-4e9d-a51a-7cbafa2ff4ad None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:42.999919 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 404/816] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 10:23:42 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 10:23:43.000768 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb8e216-38af-4c11-8012-bd906d748b14 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:43.033770 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408956a9-5c88-4652-bedd-a5e9f7d3cde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:43.034840 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408956a9-5c88-4652-bedd-a5e9f7d3cde7 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:43.035321 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408956a9-5c88-4652-bedd-a5e9f7d3cde7 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:43.035808 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408956a9-5c88-4652-bedd-a5e9f7d3cde7 None admin] PATH_INFO: `/v3/services` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:43.036728 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408956a9-5c88-4652-bedd-a5e9f7d3cde7 None admin] RBAC: Adding query filter params (type=network) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:43.037184 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408956a9-5c88-4652-bedd-a5e9f7d3cde7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:43.038627 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408956a9-5c88-4652-bedd-a5e9f7d3cde7 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:43.043766 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 413/817] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Jul 18 10:23:42 2022] GET /identity/v3/services?type=network => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:43.049090 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408956a9-5c88-4652-bedd-a5e9f7d3cde7 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:43.116418 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb8e216-38af-4c11-8012-bd906d748b14 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:43.152134 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b811f6b1-ba55-4c97-a06b-171fd2605ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:43.152872 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811f6b1-ba55-4c97-a06b-171fd2605ca2 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:43.153179 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811f6b1-ba55-4c97-a06b-171fd2605ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:43.153956 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811f6b1-ba55-4c97-a06b-171fd2605ca2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:43.154606 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b811f6b1-ba55-4c97-a06b-171fd2605ca2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:43.155953 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b811f6b1-ba55-4c97-a06b-171fd2605ca2 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:43.161547 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408956a9-5c88-4652-bedd-a5e9f7d3cde7 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:43.168045 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-b811f6b1-ba55-4c97-a06b-171fd2605ca2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 10:23:43.168045 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:43.168045 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 10:23:43.168045 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 10:23:43.168045 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 10:23:43.168045 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 10:23:43.168045 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 10:23:43.168045 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:23:43.168045 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 10:23:43.168045 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:43.168045 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 10:23:43.168045 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:43.168045 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:43.168045 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:43.168045 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:43.168045 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:43.169015 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:43.169015 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:43.169015 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:43.169015 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:43.169015 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:43.169015 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:43.169015 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:43.169015 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 10:23:43.169015 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 10:23:43.169015 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 10:23:43.169015 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 10:23:43.169015 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:43.169015 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:43.169015 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:43.169015 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:43.169015 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:43.169957 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:43.169957 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:43.169957 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:43.169957 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:43.169957 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:43.169957 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:43.169957 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:43.169957 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:43.169957 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:43.169957 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:43.169957 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:43.169957 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 10:23:43.169957 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:23:43.169957 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 10:23:43.169957 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:43.169957 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 405/818] 10.222.0.39 () {56 vars in 1129 bytes} [Mon Jul 18 10:23:42 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:43.170801 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b811f6b1-ba55-4c97-a06b-171fd2605ca2 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:43.199892 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a677ffec-9553-4519-b311-256b0550e0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:43.201273 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a677ffec-9553-4519-b311-256b0550e0f3 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:43.201586 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a677ffec-9553-4519-b311-256b0550e0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:43.201855 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a677ffec-9553-4519-b311-256b0550e0f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:43.211767 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a677ffec-9553-4519-b311-256b0550e0f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:43.212564 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:43.213592 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a677ffec-9553-4519-b311-256b0550e0f3 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:43.215452 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:43.232296 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-a677ffec-9553-4519-b311-256b0550e0f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:43.232296 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:43.232296 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:43.232296 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:43.232296 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:43.232296 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:43.232296 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:43.232296 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:43.232296 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:43.232296 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:43.232296 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:43.232296 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:43.232296 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:43.232296 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:43.232296 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:43.233370 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:43.233370 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:43.233370 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:43.233370 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:43.233370 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:43.233370 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:43.233370 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:43.233370 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:43.233370 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:43.233370 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:43.233370 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:43.233370 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:43.233370 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:43.233370 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:43.233370 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:43.233370 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:43.233370 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:43.234446 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:43.234446 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:43.234446 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:43.234446 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:43.236281 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 414/819] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:43.237079 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a677ffec-9553-4519-b311-256b0550e0f3 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:43.285898 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b811f6b1-ba55-4c97-a06b-171fd2605ca2 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:43.320465 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8c20a4-f293-4688-88c6-f383edffe6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:43.321295 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c20a4-f293-4688-88c6-f383edffe6ef None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:43.321580 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c20a4-f293-4688-88c6-f383edffe6ef None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:43.321851 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c20a4-f293-4688-88c6-f383edffe6ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:43.333002 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8c20a4-f293-4688-88c6-f383edffe6ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:43.334462 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8c20a4-f293-4688-88c6-f383edffe6ef None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:43.346430 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a677ffec-9553-4519-b311-256b0550e0f3 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:43.353198 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-5d8c20a4-f293-4688-88c6-f383edffe6ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:43.353198 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:43.353198 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:43.353198 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:43.353198 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:43.353198 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:43.353198 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:43.353198 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:43.353198 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:43.353198 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:43.353198 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:43.353198 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:43.353198 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:43.353198 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:43.353198 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:43.354079 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:43.354079 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:43.354079 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:43.354079 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:43.354079 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:43.354079 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:43.354079 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:43.354079 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:43.354079 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:43.354079 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:43.354079 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:43.354079 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:43.354079 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:43.354079 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:43.354079 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:43.354079 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:43.354079 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:43.354982 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:43.354982 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:43.354982 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:43.354982 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:43.354982 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 406/820] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:43.355261 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8c20a4-f293-4688-88c6-f383edffe6ef None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:43.389069 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132b6e30-fc9c-43d9-b58d-3fe5e0a46efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:43.390078 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b6e30-fc9c-43d9-b58d-3fe5e0a46efe None admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:43.390547 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b6e30-fc9c-43d9-b58d-3fe5e0a46efe None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:43.391000 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b6e30-fc9c-43d9-b58d-3fe5e0a46efe None admin] PATH_INFO: `/v3/endpoints` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:43.391931 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132b6e30-fc9c-43d9-b58d-3fe5e0a46efe None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:43.393551 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132b6e30-fc9c-43d9-b58d-3fe5e0a46efe None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:43.445796 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:43.457452 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8c20a4-f293-4688-88c6-f383edffe6ef None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:43.496580 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a3c19-f02f-4c38-9a75-2decce5c3a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:43.497872 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a3c19-f02f-4c38-9a75-2decce5c3a88 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:43.498161 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a3c19-f02f-4c38-9a75-2decce5c3a88 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:43.498441 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a3c19-f02f-4c38-9a75-2decce5c3a88 None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:43.499150 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5a3c19-f02f-4c38-9a75-2decce5c3a88 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:43.499481 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5a3c19-f02f-4c38-9a75-2decce5c3a88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:43.501240 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5a3c19-f02f-4c38-9a75-2decce5c3a88 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:43.506661 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 407/821] 10.222.0.39 () {56 vars in 1124 bytes} [Mon Jul 18 10:23:43 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:43.507708 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a3c19-f02f-4c38-9a75-2decce5c3a88 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:43.517313 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 415/822] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Jul 18 10:23:43 2022] POST /identity/v3/endpoints => generated 327 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:23:43.521695 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132b6e30-fc9c-43d9-b58d-3fe5e0a46efe None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:43.587462 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:43.632111 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a3c19-f02f-4c38-9a75-2decce5c3a88 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:43.665754 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132b6e30-fc9c-43d9-b58d-3fe5e0a46efe None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:43.675007 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fa8463-2063-487f-b037-403f830811fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:43.675986 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa8463-2063-487f-b037-403f830811fa None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:43.676474 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa8463-2063-487f-b037-403f830811fa None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:43.676976 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa8463-2063-487f-b037-403f830811fa None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:43.677928 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fa8463-2063-487f-b037-403f830811fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:43.678437 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fa8463-2063-487f-b037-403f830811fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:43.679995 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fa8463-2063-487f-b037-403f830811fa None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:43.693912 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 408/823] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:43.694761 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fa8463-2063-487f-b037-403f830811fa None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:43.710148 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c9892-c2e4-4b40-b2ea-0c1fca94eefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:43.710746 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c9892-c2e4-4b40-b2ea-0c1fca94eefd None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:43.711135 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c9892-c2e4-4b40-b2ea-0c1fca94eefd None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:43.711475 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c9892-c2e4-4b40-b2ea-0c1fca94eefd None admin] PATH_INFO: `/v3/domains` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:43.712278 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c9892-c2e4-4b40-b2ea-0c1fca94eefd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:43.712559 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c9892-c2e4-4b40-b2ea-0c1fca94eefd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:43.714242 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c9892-c2e4-4b40-b2ea-0c1fca94eefd None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:43.715717 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:43.735173 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 416/824] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:43.735173 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c9892-c2e4-4b40-b2ea-0c1fca94eefd None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:43.824481 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fa8463-2063-487f-b037-403f830811fa None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:43.854009 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c9892-c2e4-4b40-b2ea-0c1fca94eefd None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:43.858197 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79565afb-e128-4cd9-9fb6-0c7f85ea72fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:43.858867 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79565afb-e128-4cd9-9fb6-0c7f85ea72fa None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:43.859146 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79565afb-e128-4cd9-9fb6-0c7f85ea72fa None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:43.859417 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79565afb-e128-4cd9-9fb6-0c7f85ea72fa None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:43.860116 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79565afb-e128-4cd9-9fb6-0c7f85ea72fa None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:43.860419 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79565afb-e128-4cd9-9fb6-0c7f85ea72fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:43.861726 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:43.861842 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79565afb-e128-4cd9-9fb6-0c7f85ea72fa None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:43.867269 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 409/825] 10.222.0.39 () {56 vars in 1124 bytes} [Mon Jul 18 10:23:43 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:43.872722 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79565afb-e128-4cd9-9fb6-0c7f85ea72fa None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:43.896619 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916383dd-37a7-4339-9759-ff643aebef62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:43.897607 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916383dd-37a7-4339-9759-ff643aebef62 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:43.897828 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916383dd-37a7-4339-9759-ff643aebef62 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:43.898211 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916383dd-37a7-4339-9759-ff643aebef62 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:43.906860 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916383dd-37a7-4339-9759-ff643aebef62 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:43.908301 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916383dd-37a7-4339-9759-ff643aebef62 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:43.923399 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-916383dd-37a7-4339-9759-ff643aebef62 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:23:43.923399 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:43.923399 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:43.923399 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:43.923399 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:43.923399 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:43.923399 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:43.923399 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:43.923399 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:43.923399 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:43.923399 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:43.923399 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:43.923399 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:23:43.923399 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:23:43.923399 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:23:43.924324 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:23:43.924324 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:43.924324 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:43.924324 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:43.924324 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:43.924324 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:43.924324 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:43.924324 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:43.924324 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:43.924324 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:43.924324 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:43.924324 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:43.924324 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:43.924324 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:43.924324 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:43.924324 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:43.924324 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:43.925255 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:23:43.925255 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:23:43.925255 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:23:43.925255 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:23:43.925255 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:23:43.925255 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:23:43.925255 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:23:43.925255 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:43.925255 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 417/826] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 10:23:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:43.926380 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916383dd-37a7-4339-9759-ff643aebef62 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:43.954277 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:43.976933 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79565afb-e128-4cd9-9fb6-0c7f85ea72fa None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:44.012226 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd76c7-bc9c-4298-987d-2de8f29c5a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:44.013637 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd76c7-bc9c-4298-987d-2de8f29c5a2b None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:44.013896 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd76c7-bc9c-4298-987d-2de8f29c5a2b None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:44.014253 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd76c7-bc9c-4298-987d-2de8f29c5a2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:44.021240 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bd76c7-bc9c-4298-987d-2de8f29c5a2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:44.022662 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bd76c7-bc9c-4298-987d-2de8f29c5a2b None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:44.033375 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916383dd-37a7-4339-9759-ff643aebef62 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:44.036793 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-37bd76c7-bc9c-4298-987d-2de8f29c5a2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:23:44.036793 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:44.036793 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:44.036793 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:44.036793 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:44.036793 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:44.036793 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:44.036793 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:44.036793 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:44.036793 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:44.036793 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:44.036793 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:44.036793 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:23:44.036793 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:23:44.036793 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:23:44.037801 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:23:44.037801 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:44.037801 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:44.037801 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:44.037801 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:44.037801 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:44.037801 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:44.037801 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:44.037801 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:44.037801 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:44.037801 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:44.037801 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:44.037801 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:44.037801 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:44.037801 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:44.037801 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:44.037801 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:44.038725 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:23:44.038725 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:23:44.038725 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:23:44.038725 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:23:44.038725 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:23:44.038725 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:23:44.038725 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:23:44.038725 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:44.038725 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 410/827] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 10:23:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:44.039204 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd76c7-bc9c-4298-987d-2de8f29c5a2b None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:44.071948 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e4bac-6397-4e1a-bbf6-f0c990634bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:44.072856 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e4bac-6397-4e1a-bbf6-f0c990634bfd None admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:44.073329 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e4bac-6397-4e1a-bbf6-f0c990634bfd None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:44.073607 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e4bac-6397-4e1a-bbf6-f0c990634bfd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:44.074341 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7e4bac-6397-4e1a-bbf6-f0c990634bfd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:44.075735 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7e4bac-6397-4e1a-bbf6-f0c990634bfd None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:44.144374 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd76c7-bc9c-4298-987d-2de8f29c5a2b None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:44.148365 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 418/828] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Jul 18 10:23:43 2022] POST /identity/v3/endpoints => generated 346 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:23:44.158194 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e4bac-6397-4e1a-bbf6-f0c990634bfd None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:44.189815 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:44.194793 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54d94c-2710-4a1c-967b-cf985fd92d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:44.195693 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54d94c-2710-4a1c-967b-cf985fd92d2d None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:44.196315 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54d94c-2710-4a1c-967b-cf985fd92d2d None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:44.196427 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54d94c-2710-4a1c-967b-cf985fd92d2d None admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:44.197235 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb54d94c-2710-4a1c-967b-cf985fd92d2d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:44.197593 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb54d94c-2710-4a1c-967b-cf985fd92d2d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:44.199753 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb54d94c-2710-4a1c-967b-cf985fd92d2d None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:44.205227 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:44.221226 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 411/829] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 10:23:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:44.223354 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54d94c-2710-4a1c-967b-cf985fd92d2d None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:44.314168 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e4bac-6397-4e1a-bbf6-f0c990634bfd None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:44.351183 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54d94c-2710-4a1c-967b-cf985fd92d2d None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:44.356288 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cdd40d-bf57-4c6f-9099-7fe938dc9f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:44.357550 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cdd40d-bf57-4c6f-9099-7fe938dc9f7e None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:44.357828 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cdd40d-bf57-4c6f-9099-7fe938dc9f7e None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:44.358101 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cdd40d-bf57-4c6f-9099-7fe938dc9f7e None admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:44.358891 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cdd40d-bf57-4c6f-9099-7fe938dc9f7e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:44.359195 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cdd40d-bf57-4c6f-9099-7fe938dc9f7e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:44.360670 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cdd40d-bf57-4c6f-9099-7fe938dc9f7e None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:44.375324 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 419/830] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 10:23:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:44.376903 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a1789-e9f4-463f-97c4-d6d378f0fe11 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:44.376903 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a1789-e9f4-463f-97c4-d6d378f0fe11 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:44.377184 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a1789-e9f4-463f-97c4-d6d378f0fe11 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:44.378199 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 420/831] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:23:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:23:44.383380 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f17b98-c3ab-42f7-b0aa-858a1aa5f856 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:44.383664 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f17b98-c3ab-42f7-b0aa-858a1aa5f856 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:44.383942 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f17b98-c3ab-42f7-b0aa-858a1aa5f856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:44.392009 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9eac84-eae1-4a85-9981-16b39be85452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:44.393199 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9eac84-eae1-4a85-9981-16b39be85452 None admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:44.393671 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9eac84-eae1-4a85-9981-16b39be85452 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:44.394156 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9eac84-eae1-4a85-9981-16b39be85452 None admin] PATH_INFO: `/v3/projects/a6098fe56d304980aa14bd95b4b92c17/users/2c548474a8d94591ba58dd40e40a28d2/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:44.396463 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9eac84-eae1-4a85-9981-16b39be85452 None admin] RBAC: Authorizing `identity:create_grant(project_id=a6098fe56d304980aa14bd95b4b92c17, user_id=2c548474a8d94591ba58dd40e40a28d2, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:44.398185 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9eac84-eae1-4a85-9981-16b39be85452 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:44.400831 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-a3f17b98-c3ab-42f7-b0aa-858a1aa5f856 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:23:44.402049 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-a3f17b98-c3ab-42f7-b0aa-858a1aa5f856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:23:44.472495 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 421/833] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:23:44 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 10:23:44.472495 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f17b98-c3ab-42f7-b0aa-858a1aa5f856 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:44.473154 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 412/833] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jul 18 10:23:44 2022] PUT /identity/v3/projects/a6098fe56d304980aa14bd95b4b92c17/users/2c548474a8d94591ba58dd40e40a28d2/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:23:44.488448 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:44.491795 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9eac84-eae1-4a85-9981-16b39be85452 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:44.555484 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:44.609667 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9eac84-eae1-4a85-9981-16b39be85452 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:44.616886 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f17b98-c3ab-42f7-b0aa-858a1aa5f856 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:44.651838 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6833152-d32b-4e26-aa96-f621269543f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:44.652641 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6833152-d32b-4e26-aa96-f621269543f6 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:44.652920 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6833152-d32b-4e26-aa96-f621269543f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:44.653884 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6833152-d32b-4e26-aa96-f621269543f6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:44.664639 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7729f41a-b21c-410d-a37c-9262b87d61cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:44.665369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729f41a-b21c-410d-a37c-9262b87d61cf None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:44.665654 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729f41a-b21c-410d-a37c-9262b87d61cf None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:44.665988 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729f41a-b21c-410d-a37c-9262b87d61cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:44.666732 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6833152-d32b-4e26-aa96-f621269543f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:23:44.666838 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7729f41a-b21c-410d-a37c-9262b87d61cf None admin] RBAC: Adding query filter params (role.id=e7b6a55ecf6c491487955aaefbf9c388, scope.project.id=a6098fe56d304980aa14bd95b4b92c17, user.id=8bbebf16219943879df84bdc9a900516) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:44.667042 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7729f41a-b21c-410d-a37c-9262b87d61cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:44.668475 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7729f41a-b21c-410d-a37c-9262b87d61cf None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:44.675831 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 422/834] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 10:23:44 2022] GET /identity/v3/role_assignments?user.id=8bbebf16219943879df84bdc9a900516&scope.project.id=a6098fe56d304980aa14bd95b4b92c17&role.id=e7b6a55ecf6c491487955aaefbf9c388 => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:44.676450 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-b6833152-d32b-4e26-aa96-f621269543f6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:23:44.676450 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:44.676450 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:44.676450 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:44.676450 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:44.676450 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:44.676450 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:44.676450 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:44.676450 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:44.676450 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:44.676450 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:44.676450 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:44.676450 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:23:44.676450 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:23:44.676450 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:23:44.676450 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:23:44.677420 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:23:44.677420 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:23:44.677420 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:23:44.677420 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:23:44.677420 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:44.677420 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:44.677420 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:44.677420 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:44.677420 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:44.677420 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:44.677420 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:44.677420 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:44.677420 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:44.677420 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:44.677420 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:44.677420 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:44.678270 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:44.678270 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:44.678270 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:44.678270 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:44.678270 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:23:44.678270 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:23:44.678270 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:23:44.678270 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:23:44.678270 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:23:44.678270 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:23:44.678270 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:23:44.678270 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:44.682071 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 413/835] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jul 18 10:23:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:23:44.688583 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7729f41a-b21c-410d-a37c-9262b87d61cf None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:44.777013 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:44.803059 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7729f41a-b21c-410d-a37c-9262b87d61cf None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:44.840215 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de81fec5-0b48-4d87-8fe5-7069e606412e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:44.841325 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81fec5-0b48-4d87-8fe5-7069e606412e None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:44.841792 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81fec5-0b48-4d87-8fe5-7069e606412e None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:44.842275 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81fec5-0b48-4d87-8fe5-7069e606412e None admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:44.843212 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de81fec5-0b48-4d87-8fe5-7069e606412e None admin] RBAC: Adding query filter params (name=service) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:44.843699 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de81fec5-0b48-4d87-8fe5-7069e606412e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:44.845288 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de81fec5-0b48-4d87-8fe5-7069e606412e None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:44.855055 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 423/836] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Jul 18 10:23:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:44.861639 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6833152-d32b-4e26-aa96-f621269543f6 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:44.968489 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6833152-d32b-4e26-aa96-f621269543f6 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:44.983229 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:45.005333 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104341f9-93d4-4b2a-8425-cbd94a60b78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:45.006136 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104341f9-93d4-4b2a-8425-cbd94a60b78a None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:45.006475 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104341f9-93d4-4b2a-8425-cbd94a60b78a None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:45.006748 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104341f9-93d4-4b2a-8425-cbd94a60b78a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:45.017667 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104341f9-93d4-4b2a-8425-cbd94a60b78a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:45.019157 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104341f9-93d4-4b2a-8425-cbd94a60b78a None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:45.036548 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-104341f9-93d4-4b2a-8425-cbd94a60b78a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:45.036548 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:45.036548 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:45.036548 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:45.036548 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:45.036548 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:45.036548 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:45.036548 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:45.036548 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:45.036548 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:45.036548 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:45.036548 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:45.036548 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:45.036548 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:45.036548 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:45.037494 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:45.037494 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:45.037494 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:45.037494 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:45.037494 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:45.037494 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:45.037494 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:45.037494 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:45.037494 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:45.037494 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:45.037494 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:45.037494 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:45.037494 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:45.037494 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:45.037494 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:45.037494 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:45.037494 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:45.038353 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:45.038353 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:45.038353 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:45.038353 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:45.038353 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 414/837] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:45.045692 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de81fec5-0b48-4d87-8fe5-7069e606412e None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:45.160497 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de81fec5-0b48-4d87-8fe5-7069e606412e None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:45.195471 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9ec450-2104-4c84-9b43-2443742974f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:45.196492 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ec450-2104-4c84-9b43-2443742974f8 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:45.196997 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ec450-2104-4c84-9b43-2443742974f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:45.197505 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ec450-2104-4c84-9b43-2443742974f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:45.198429 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9ec450-2104-4c84-9b43-2443742974f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:45.198953 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9ec450-2104-4c84-9b43-2443742974f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:45.200756 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9ec450-2104-4c84-9b43-2443742974f8 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:45.213822 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:45.214078 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 424/838] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:45.219521 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104341f9-93d4-4b2a-8425-cbd94a60b78a None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:45.326947 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104341f9-93d4-4b2a-8425-cbd94a60b78a None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:45.364579 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2a9f58-f5d0-480f-9c6e-21602bb3c84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:45.365435 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a9f58-f5d0-480f-9c6e-21602bb3c84c None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:45.365718 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a9f58-f5d0-480f-9c6e-21602bb3c84c None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:45.365991 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a9f58-f5d0-480f-9c6e-21602bb3c84c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:45.374379 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2a9f58-f5d0-480f-9c6e-21602bb3c84c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:45.375808 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2a9f58-f5d0-480f-9c6e-21602bb3c84c None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:45.391070 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-7e2a9f58-f5d0-480f-9c6e-21602bb3c84c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 10:23:45.391070 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:45.391070 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:45.391070 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:45.391070 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:45.391070 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:45.391070 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:45.391070 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:45.391070 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:45.391070 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:45.391070 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:45.391070 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:45.391070 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:23:45.391070 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:23:45.391070 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:23:45.391070 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:23:45.391983 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:45.391983 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:45.391983 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:23:45.391983 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:23:45.391983 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:23:45.391983 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:23:45.391983 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:45.391983 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:45.391983 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:45.391983 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:45.391983 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:45.391983 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:45.391983 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:45.391983 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:45.391983 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:45.391983 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:45.391983 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:45.391983 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:45.392907 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:45.392907 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:45.392907 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:23:45.392907 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:23:45.392907 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:23:45.392907 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:23:45.392907 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:23:45.392907 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:23:45.392907 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 10:23:45.392907 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:45.392907 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 415/839] 10.222.0.39 () {56 vars in 1117 bytes} [Mon Jul 18 10:23:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:45.398156 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9ec450-2104-4c84-9b43-2443742974f8 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:45.499753 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9ec450-2104-4c84-9b43-2443742974f8 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:45.534587 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68a2265-60cd-4647-a655-8f1871b4dab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:45.535483 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a2265-60cd-4647-a655-8f1871b4dab4 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:45.535909 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a2265-60cd-4647-a655-8f1871b4dab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:45.536429 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a2265-60cd-4647-a655-8f1871b4dab4 None admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:45.537427 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68a2265-60cd-4647-a655-8f1871b4dab4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:45.537876 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68a2265-60cd-4647-a655-8f1871b4dab4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:45.539422 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68a2265-60cd-4647-a655-8f1871b4dab4 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:45.562681 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 425/840] 10.222.0.39 () {56 vars in 1149 bytes} [Mon Jul 18 10:23:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:45.568266 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2a9f58-f5d0-480f-9c6e-21602bb3c84c None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:45.596498 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:45.675517 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2a9f58-f5d0-480f-9c6e-21602bb3c84c None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:45.712071 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce888e01-77b5-4ba2-914b-6430fbea2df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:45.713100 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce888e01-77b5-4ba2-914b-6430fbea2df8 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:45.713603 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce888e01-77b5-4ba2-914b-6430fbea2df8 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:45.714098 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce888e01-77b5-4ba2-914b-6430fbea2df8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:45.788698 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce888e01-77b5-4ba2-914b-6430fbea2df8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:45.790485 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce888e01-77b5-4ba2-914b-6430fbea2df8 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:45.817940 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:45.895372 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 416/841] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 10:23:45 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 10:23:45.901646 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68a2265-60cd-4647-a655-8f1871b4dab4 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:45.963837 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:46.008757 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68a2265-60cd-4647-a655-8f1871b4dab4 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:46.042996 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b88ca-99e4-450e-b06b-69b31671c50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:46.043756 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b88ca-99e4-450e-b06b-69b31671c50d None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:46.044068 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b88ca-99e4-450e-b06b-69b31671c50d None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:46.044341 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b88ca-99e4-450e-b06b-69b31671c50d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:46.054753 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57b88ca-99e4-450e-b06b-69b31671c50d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:46.056181 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57b88ca-99e4-450e-b06b-69b31671c50d None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:46.078925 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-e57b88ca-99e4-450e-b06b-69b31671c50d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:46.078925 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:46.078925 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:46.078925 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:46.078925 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:46.078925 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:46.078925 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:46.078925 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:46.078925 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:46.078925 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:46.078925 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:46.078925 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:46.078925 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:46.078925 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:46.078925 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:46.079840 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:46.079840 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:46.079840 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:46.079840 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:46.079840 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:46.079840 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:46.079840 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:46.079840 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:46.079840 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:46.079840 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:46.079840 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:46.079840 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:46.079840 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:46.079840 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:46.079840 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:46.079840 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:46.079840 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:46.080716 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:46.080716 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:46.080716 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:46.080716 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:46.080716 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 426/842] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:46.085741 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce888e01-77b5-4ba2-914b-6430fbea2df8 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:46.199360 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce888e01-77b5-4ba2-914b-6430fbea2df8 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:46.224451 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:46.235666 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d0eb7-5fd3-48f1-87ba-dc66ca5cee37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:46.242462 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d0eb7-5fd3-48f1-87ba-dc66ca5cee37 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:46.242462 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d0eb7-5fd3-48f1-87ba-dc66ca5cee37 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:46.242462 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d0eb7-5fd3-48f1-87ba-dc66ca5cee37 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:46.242462 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d0eb7-5fd3-48f1-87ba-dc66ca5cee37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:46.242462 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d0eb7-5fd3-48f1-87ba-dc66ca5cee37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:46.242462 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d0eb7-5fd3-48f1-87ba-dc66ca5cee37 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:46.253032 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 417/843] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:46.258919 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b88ca-99e4-450e-b06b-69b31671c50d None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:46.267387 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe399251-db4e-4cf6-aa52-24f314ee5316 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:46.267680 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe399251-db4e-4cf6-aa52-24f314ee5316 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:46.267964 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe399251-db4e-4cf6-aa52-24f314ee5316 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:46.273081 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 418/844] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:23:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:23:46.274749 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57942fff-abd7-4182-b275-d115ff3a60df None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:46.275043 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57942fff-abd7-4182-b275-d115ff3a60df None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:46.275331 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57942fff-abd7-4182-b275-d115ff3a60df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:46.291998 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-57942fff-abd7-4182-b275-d115ff3a60df None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:23:46.293309 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-57942fff-abd7-4182-b275-d115ff3a60df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:23:46.378341 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 419/845] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:23:46 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 10:23:46.394531 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b88ca-99e4-450e-b06b-69b31671c50d None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:46.404070 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:46.406481 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57942fff-abd7-4182-b275-d115ff3a60df None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:46.437296 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5740266c-3fde-4102-af98-6fc7fb9c294a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:46.438584 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5740266c-3fde-4102-af98-6fc7fb9c294a None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:46.439169 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5740266c-3fde-4102-af98-6fc7fb9c294a None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:46.439668 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5740266c-3fde-4102-af98-6fc7fb9c294a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:46.447009 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5740266c-3fde-4102-af98-6fc7fb9c294a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:46.448831 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5740266c-3fde-4102-af98-6fc7fb9c294a None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:46.465476 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-5740266c-3fde-4102-af98-6fc7fb9c294a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:23:46.465476 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:46.465476 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:46.465476 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:46.465476 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:46.465476 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:46.465476 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:46.465476 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:46.465476 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:46.465476 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:46.465476 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:46.465476 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:46.465476 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:23:46.465476 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:23:46.465476 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:23:46.467515 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:23:46.467515 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:46.467515 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:46.467515 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:46.467515 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:46.467515 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:46.467515 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:46.467515 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:46.467515 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:46.467515 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:46.467515 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:46.467515 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:46.467515 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:46.467515 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:46.467515 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:46.467515 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:46.467515 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:46.468405 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:23:46.468405 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:23:46.468405 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:23:46.468405 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:23:46.468405 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:23:46.468405 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:23:46.468405 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:23:46.468405 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:46.471024 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 427/846] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 10:23:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:46.477179 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5740266c-3fde-4102-af98-6fc7fb9c294a None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:46.515424 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57942fff-abd7-4182-b275-d115ff3a60df None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:46.530614 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:46.553199 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f3897-1043-4642-8845-b27b24c8f592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:46.554550 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f3897-1043-4642-8845-b27b24c8f592 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:46.555461 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f3897-1043-4642-8845-b27b24c8f592 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:46.555461 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f3897-1043-4642-8845-b27b24c8f592 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:46.556097 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90f3897-1043-4642-8845-b27b24c8f592 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:46.558001 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90f3897-1043-4642-8845-b27b24c8f592 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:46.572391 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-b90f3897-1043-4642-8845-b27b24c8f592 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 10:23:46.572391 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:46.572391 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 10:23:46.572391 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 10:23:46.572391 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 10:23:46.572391 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 10:23:46.572391 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 10:23:46.572391 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:23:46.572391 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 10:23:46.572391 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:46.572391 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 10:23:46.572391 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:46.572391 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:46.572391 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:46.572391 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:46.572391 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:46.572391 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:46.573539 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:46.573539 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:46.573539 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:46.573539 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:46.573539 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:46.573539 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:46.573539 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 10:23:46.573539 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 10:23:46.573539 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 10:23:46.573539 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 10:23:46.573539 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:46.573539 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:46.573539 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:46.573539 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:46.573539 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:46.573539 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:46.574348 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:46.574348 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:46.574348 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:46.574348 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:46.574348 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:46.574348 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:46.574348 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:46.574348 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:46.574348 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:46.574348 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:46.574348 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 10:23:46.574348 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:23:46.574348 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 10:23:46.574348 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:46.575603 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 420/847] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Jul 18 10:23:46 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:23:46.581451 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f3897-1043-4642-8845-b27b24c8f592 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:46.591581 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5740266c-3fde-4102-af98-6fc7fb9c294a None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:46.631290 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af23425a-50f2-4dd4-9ee3-4e789923724a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:46.632450 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23425a-50f2-4dd4-9ee3-4e789923724a None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:46.632791 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23425a-50f2-4dd4-9ee3-4e789923724a None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:46.633173 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af23425a-50f2-4dd4-9ee3-4e789923724a None admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:46.634027 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af23425a-50f2-4dd4-9ee3-4e789923724a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:46.634426 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af23425a-50f2-4dd4-9ee3-4e789923724a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:46.636011 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af23425a-50f2-4dd4-9ee3-4e789923724a None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:46.656308 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 428/848] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 10:23:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:46.657472 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af23425a-50f2-4dd4-9ee3-4e789923724a None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:46.689905 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:46.711839 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f3897-1043-4642-8845-b27b24c8f592 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:46.749491 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef4ca3b-f99e-4435-a5ab-a93b67ba2f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:46.750170 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4ca3b-f99e-4435-a5ab-a93b67ba2f4a None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:46.750505 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4ca3b-f99e-4435-a5ab-a93b67ba2f4a None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:46.750739 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4ca3b-f99e-4435-a5ab-a93b67ba2f4a None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:46.751457 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef4ca3b-f99e-4435-a5ab-a93b67ba2f4a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:46.751769 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef4ca3b-f99e-4435-a5ab-a93b67ba2f4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:46.753159 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef4ca3b-f99e-4435-a5ab-a93b67ba2f4a None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:46.758316 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 421/849] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Jul 18 10:23:46 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:46.759540 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39284280-f6c5-4efa-851c-3ecc87e480d4 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:46.759829 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39284280-f6c5-4efa-851c-3ecc87e480d4 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:46.760107 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39284280-f6c5-4efa-851c-3ecc87e480d4 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:46.765106 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 422/850] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:23:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:23:46.765106 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39284280-f6c5-4efa-851c-3ecc87e480d4 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:46.776864 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af23425a-50f2-4dd4-9ee3-4e789923724a None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:46.812597 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d408d-3f48-4332-b071-47456d740e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:46.813327 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d408d-3f48-4332-b071-47456d740e64 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:46.813570 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:46.813684 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d408d-3f48-4332-b071-47456d740e64 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:46.813937 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d408d-3f48-4332-b071-47456d740e64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:46.814770 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d408d-3f48-4332-b071-47456d740e64 None admin] RBAC: Adding query filter params (role.id=d151ec157a524341b7194453e46b6b25, scope.project.id=a6098fe56d304980aa14bd95b4b92c17, user.id=88ad60446c5447a8bbd0096fa2133efb) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:46.815080 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d408d-3f48-4332-b071-47456d740e64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:46.816503 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d408d-3f48-4332-b071-47456d740e64 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:46.833084 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 429/851] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 10:23:46 2022] GET /identity/v3/role_assignments?user.id=88ad60446c5447a8bbd0096fa2133efb&scope.project.id=a6098fe56d304980aa14bd95b4b92c17&role.id=d151ec157a524341b7194453e46b6b25 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:46.833084 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b674563-2af0-4986-a032-9b76a888e752 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:46.833084 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b674563-2af0-4986-a032-9b76a888e752 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:46.833084 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b674563-2af0-4986-a032-9b76a888e752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:46.846160 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-7b674563-2af0-4986-a032-9b76a888e752 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:23:46.847370 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-7b674563-2af0-4986-a032-9b76a888e752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:23:46.897939 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39284280-f6c5-4efa-851c-3ecc87e480d4 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:46.944327 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 430/852] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:23:46 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:23:46.944862 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bd2146-ad7b-4181-92e7-46098f49ced1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:46.944862 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd2146-ad7b-4181-92e7-46098f49ced1 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:46.944862 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd2146-ad7b-4181-92e7-46098f49ced1 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:46.945192 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea02bd-7609-43c7-b106-bedaa4079224 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:46.945281 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd2146-ad7b-4181-92e7-46098f49ced1 None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:46.945373 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea02bd-7609-43c7-b106-bedaa4079224 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:46.945373 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea02bd-7609-43c7-b106-bedaa4079224 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:46.945524 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bd2146-ad7b-4181-92e7-46098f49ced1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:46.945524 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bd2146-ad7b-4181-92e7-46098f49ced1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:46.945731 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 431/853] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:23:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:23:46.945818 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bd2146-ad7b-4181-92e7-46098f49ced1 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:46.947897 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e31de4-22ad-4b6e-a344-35d56a2307fe None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:46.948191 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e31de4-22ad-4b6e-a344-35d56a2307fe None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:46.948472 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e31de4-22ad-4b6e-a344-35d56a2307fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:46.953866 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 423/854] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Jul 18 10:23:46 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:23:46.968061 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-01e31de4-22ad-4b6e-a344-35d56a2307fe None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:23:46.969347 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-01e31de4-22ad-4b6e-a344-35d56a2307fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:23:46.974351 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bd2146-ad7b-4181-92e7-46098f49ced1 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:46.994906 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:47.071631 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 432/855] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:23:46 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:23:47.102916 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e31de4-22ad-4b6e-a344-35d56a2307fe None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:47.121526 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bd2146-ad7b-4181-92e7-46098f49ced1 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:47.134750 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:47.168351 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae8d51-25dc-4ddf-a9d6-e3f6a62a4674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:47.169526 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae8d51-25dc-4ddf-a9d6-e3f6a62a4674 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:47.170012 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae8d51-25dc-4ddf-a9d6-e3f6a62a4674 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:47.170456 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae8d51-25dc-4ddf-a9d6-e3f6a62a4674 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:47.184335 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ae8d51-25dc-4ddf-a9d6-e3f6a62a4674 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:23:47.194383 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-f2ae8d51-25dc-4ddf-a9d6-e3f6a62a4674 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:23:47.194383 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:47.194383 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:47.194383 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:47.194383 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:47.194383 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:47.194383 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:47.194383 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:47.194383 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:47.194383 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:47.194383 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:47.194383 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:47.194383 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:23:47.194383 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:23:47.194383 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:23:47.194383 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:23:47.195394 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:23:47.195394 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:23:47.195394 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:23:47.195394 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:23:47.195394 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:47.195394 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:47.195394 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:47.195394 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:47.195394 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:47.195394 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:47.195394 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:47.195394 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:47.195394 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:47.195394 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:47.195394 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:47.195394 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:47.196202 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:47.196202 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:47.196202 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:47.196202 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:47.196202 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:23:47.196202 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:23:47.196202 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:23:47.196202 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:23:47.196202 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:23:47.196202 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:23:47.196202 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:23:47.196202 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:47.199292 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 424/856] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 10:23:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:47.207584 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae8d51-25dc-4ddf-a9d6-e3f6a62a4674 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:47.227601 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e31de4-22ad-4b6e-a344-35d56a2307fe None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:47.266808 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c986363-f039-485b-bef5-c592910d8e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:47.268061 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c986363-f039-485b-bef5-c592910d8e13 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:47.268809 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c986363-f039-485b-bef5-c592910d8e13 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:47.269252 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c986363-f039-485b-bef5-c592910d8e13 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:47.270024 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c986363-f039-485b-bef5-c592910d8e13 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:47.272060 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c986363-f039-485b-bef5-c592910d8e13 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:47.289970 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-4c986363-f039-485b-bef5-c592910d8e13 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 10:23:47.289970 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:47.289970 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 10:23:47.289970 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 10:23:47.289970 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 10:23:47.289970 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 10:23:47.289970 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 10:23:47.289970 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:23:47.289970 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 10:23:47.289970 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:47.289970 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 10:23:47.289970 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:47.289970 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:47.289970 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:47.289970 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:47.289970 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:47.290957 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:47.290957 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:47.290957 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:47.290957 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:47.290957 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:47.290957 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:47.290957 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:47.290957 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 10:23:47.290957 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 10:23:47.290957 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 10:23:47.290957 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 10:23:47.290957 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:47.290957 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:47.290957 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:47.290957 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:47.290957 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:47.291774 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:47.291774 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:47.291774 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:47.291774 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:47.291774 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:47.291774 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:47.291774 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:47.291774 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:47.291774 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:47.291774 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:47.291774 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:47.291774 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 10:23:47.291774 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:23:47.291774 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 10:23:47.291774 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:47.292546 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 433/857] 10.222.0.39 () {56 vars in 1132 bytes} [Mon Jul 18 10:23:47 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:47.298788 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c986363-f039-485b-bef5-c592910d8e13 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:47.318836 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:47.324276 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae8d51-25dc-4ddf-a9d6-e3f6a62a4674 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:47.361187 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0397f21-8a65-4cbf-b9c5-bfa1cf2af480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:47.361859 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0397f21-8a65-4cbf-b9c5-bfa1cf2af480 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:47.362388 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0397f21-8a65-4cbf-b9c5-bfa1cf2af480 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:47.362667 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0397f21-8a65-4cbf-b9c5-bfa1cf2af480 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:47.363413 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0397f21-8a65-4cbf-b9c5-bfa1cf2af480 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:47.363773 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0397f21-8a65-4cbf-b9c5-bfa1cf2af480 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:47.365345 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0397f21-8a65-4cbf-b9c5-bfa1cf2af480 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:47.374515 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 425/858] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 10:23:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:47.379987 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0397f21-8a65-4cbf-b9c5-bfa1cf2af480 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:47.408761 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c986363-f039-485b-bef5-c592910d8e13 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:47.411172 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:47.446828 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02facc3-da9d-43f4-a2c3-1f118afdfd4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:47.447512 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02facc3-da9d-43f4-a2c3-1f118afdfd4d None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:47.447855 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02facc3-da9d-43f4-a2c3-1f118afdfd4d None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:47.448135 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02facc3-da9d-43f4-a2c3-1f118afdfd4d None admin] PATH_INFO: `/v3/services` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:47.449059 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02facc3-da9d-43f4-a2c3-1f118afdfd4d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:47.449400 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02facc3-da9d-43f4-a2c3-1f118afdfd4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:47.451993 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02facc3-da9d-43f4-a2c3-1f118afdfd4d None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:47.462405 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 434/859] 10.222.0.39 () {56 vars in 1126 bytes} [Mon Jul 18 10:23:47 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:23:47.463285 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02facc3-da9d-43f4-a2c3-1f118afdfd4d None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:47.498797 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0397f21-8a65-4cbf-b9c5-bfa1cf2af480 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:47.535429 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624a52f0-37d1-45c3-9613-fcc552aa8140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:47.536639 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a52f0-37d1-45c3-9613-fcc552aa8140 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:47.537166 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a52f0-37d1-45c3-9613-fcc552aa8140 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:47.537646 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624a52f0-37d1-45c3-9613-fcc552aa8140 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:47.548503 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624a52f0-37d1-45c3-9613-fcc552aa8140 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:47.550297 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624a52f0-37d1-45c3-9613-fcc552aa8140 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:47.568927 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:47.569334 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-624a52f0-37d1-45c3-9613-fcc552aa8140 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:47.569334 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:47.569334 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:47.569334 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:47.569334 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:47.569334 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:47.569334 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:47.569334 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:47.569334 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:47.569334 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:47.569334 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:47.569334 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:47.569334 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:47.569334 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:47.569334 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:47.570222 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:47.570222 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:47.570222 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:47.570222 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:47.570222 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:47.570222 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:47.570222 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:47.570222 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:47.570222 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:47.570222 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:47.570222 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:47.570222 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:47.570222 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:47.570222 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:47.570222 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:47.570222 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:47.570222 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:47.571095 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:47.571095 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:47.571095 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:47.571095 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:47.581464 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 426/860] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:23:47.581464 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624a52f0-37d1-45c3-9613-fcc552aa8140 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:47.591235 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02facc3-da9d-43f4-a2c3-1f118afdfd4d None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:47.634877 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d94f272-f6b5-4e06-b670-6eaf505b635b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:47.635924 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94f272-f6b5-4e06-b670-6eaf505b635b None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:47.636422 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94f272-f6b5-4e06-b670-6eaf505b635b None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:47.636896 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94f272-f6b5-4e06-b670-6eaf505b635b None admin] PATH_INFO: `/v3/services` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:47.638568 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d94f272-f6b5-4e06-b670-6eaf505b635b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:47.639183 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d94f272-f6b5-4e06-b670-6eaf505b635b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:47.640795 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d94f272-f6b5-4e06-b670-6eaf505b635b None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:47.654083 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 435/861] 10.222.0.39 () {56 vars in 1126 bytes} [Mon Jul 18 10:23:47 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:47.678047 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:47.699852 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624a52f0-37d1-45c3-9613-fcc552aa8140 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:47.740911 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec4faa-c836-4628-934d-e48e90b55bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:47.741640 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec4faa-c836-4628-934d-e48e90b55bb0 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:47.741926 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec4faa-c836-4628-934d-e48e90b55bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:47.742205 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec4faa-c836-4628-934d-e48e90b55bb0 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:47.743002 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec4faa-c836-4628-934d-e48e90b55bb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:47.743324 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec4faa-c836-4628-934d-e48e90b55bb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:47.744709 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec4faa-c836-4628-934d-e48e90b55bb0 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:47.758628 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 427/862] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:23:47.764792 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d94f272-f6b5-4e06-b670-6eaf505b635b None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:47.875088 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d94f272-f6b5-4e06-b670-6eaf505b635b None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:47.909382 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ee8f3-3a67-4e52-bcc0-634610b4d55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:47.910236 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ee8f3-3a67-4e52-bcc0-634610b4d55e None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:47.910537 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ee8f3-3a67-4e52-bcc0-634610b4d55e None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:47.910818 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ee8f3-3a67-4e52-bcc0-634610b4d55e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:47.918572 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1ee8f3-3a67-4e52-bcc0-634610b4d55e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:47.920544 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1ee8f3-3a67-4e52-bcc0-634610b4d55e None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:47.935491 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-2e1ee8f3-3a67-4e52-bcc0-634610b4d55e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 18 10:23:47.935491 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:47.935491 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:47.935491 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:47.935491 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:47.935491 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:47.935491 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:47.935491 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:47.935491 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:47.935491 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:47.935491 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:47.935491 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:47.935491 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:23:47.935491 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:23:47.935491 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:23:47.935491 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:23:47.936438 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:47.936438 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:47.936438 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:23:47.936438 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:23:47.936438 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:23:47.936438 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:23:47.936438 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:47.936438 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:47.936438 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:47.936438 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:47.936438 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:47.936438 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:47.936438 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:47.936438 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:47.936438 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:47.936438 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:47.936438 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:47.936438 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:47.937437 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:47.937437 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:47.937437 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:23:47.937437 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:23:47.937437 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:23:47.937437 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:23:47.937437 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:23:47.937437 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:23:47.937437 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 18 10:23:47.937437 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:47.937437 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 436/863] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 10:23:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:47.944194 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec4faa-c836-4628-934d-e48e90b55bb0 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:48.054689 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec4faa-c836-4628-934d-e48e90b55bb0 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:48.095754 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62215e4c-0cb9-4332-b630-080694c350de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:48.096824 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62215e4c-0cb9-4332-b630-080694c350de None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:48.097341 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62215e4c-0cb9-4332-b630-080694c350de None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:48.097840 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62215e4c-0cb9-4332-b630-080694c350de None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:48.098900 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62215e4c-0cb9-4332-b630-080694c350de None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:48.099498 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62215e4c-0cb9-4332-b630-080694c350de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:48.101235 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62215e4c-0cb9-4332-b630-080694c350de None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:48.116513 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:48.132576 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 428/864] 10.222.0.39 () {56 vars in 1135 bytes} [Mon Jul 18 10:23:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:48.134126 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ee8f3-3a67-4e52-bcc0-634610b4d55e None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:48.145419 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:48.242521 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ee8f3-3a67-4e52-bcc0-634610b4d55e None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:48.277207 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c5c374-46af-49b5-ac52-fddeb4fcf1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:48.277909 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c5c374-46af-49b5-ac52-fddeb4fcf1b6 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:48.278331 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c5c374-46af-49b5-ac52-fddeb4fcf1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:48.278669 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c5c374-46af-49b5-ac52-fddeb4fcf1b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:48.354533 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c5c374-46af-49b5-ac52-fddeb4fcf1b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:48.356359 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c5c374-46af-49b5-ac52-fddeb4fcf1b6 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:48.359397 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:48.462953 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 437/865] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 10:23:48 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 18 10:23:48.471310 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62215e4c-0cb9-4332-b630-080694c350de None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:48.572611 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62215e4c-0cb9-4332-b630-080694c350de None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:48.608265 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49993ffe-e5bd-4fd6-b4b5-f72d13159e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:48.609439 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49993ffe-e5bd-4fd6-b4b5-f72d13159e74 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:48.609954 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49993ffe-e5bd-4fd6-b4b5-f72d13159e74 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:48.610431 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49993ffe-e5bd-4fd6-b4b5-f72d13159e74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:48.621349 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49993ffe-e5bd-4fd6-b4b5-f72d13159e74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:48.623669 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49993ffe-e5bd-4fd6-b4b5-f72d13159e74 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:48.642568 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-49993ffe-e5bd-4fd6-b4b5-f72d13159e74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:48.642568 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:48.642568 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:48.642568 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:48.642568 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:48.642568 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:48.642568 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:48.642568 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:48.642568 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:48.642568 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:48.642568 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:48.642568 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:48.642568 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:48.642568 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:48.642568 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:48.643505 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:48.643505 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:48.643505 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:48.643505 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:48.643505 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:48.643505 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:48.643505 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:48.643505 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:48.643505 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:48.643505 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:48.643505 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:48.643505 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:48.643505 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:48.643505 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:48.643505 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:48.643505 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:48.643505 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:48.644388 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:48.644388 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:48.644388 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:48.644388 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:48.646660 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 429/866] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:48.651878 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c5c374-46af-49b5-ac52-fddeb4fcf1b6 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:48.759036 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c5c374-46af-49b5-ac52-fddeb4fcf1b6 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:48.769801 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:48.796592 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de5775b-b149-439b-a00a-327ebf5ac766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:48.797740 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5775b-b149-439b-a00a-327ebf5ac766 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:48.798236 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5775b-b149-439b-a00a-327ebf5ac766 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:48.798719 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5775b-b149-439b-a00a-327ebf5ac766 None admin] PATH_INFO: `/v3/domains` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:48.799653 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de5775b-b149-439b-a00a-327ebf5ac766 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:48.800168 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de5775b-b149-439b-a00a-327ebf5ac766 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:48.801769 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de5775b-b149-439b-a00a-327ebf5ac766 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:48.814895 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 438/867] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:48.822684 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49993ffe-e5bd-4fd6-b4b5-f72d13159e74 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:48.879678 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:48.936761 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49993ffe-e5bd-4fd6-b4b5-f72d13159e74 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:48.973071 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37ec1d5-1af2-4d48-b6c2-5b82a3b6d565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:48.973901 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ec1d5-1af2-4d48-b6c2-5b82a3b6d565 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:48.974221 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ec1d5-1af2-4d48-b6c2-5b82a3b6d565 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:48.974505 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ec1d5-1af2-4d48-b6c2-5b82a3b6d565 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:48.981645 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37ec1d5-1af2-4d48-b6c2-5b82a3b6d565 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:48.983200 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37ec1d5-1af2-4d48-b6c2-5b82a3b6d565 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:48.998292 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-f37ec1d5-1af2-4d48-b6c2-5b82a3b6d565 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:23:48.998292 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:48.998292 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:48.998292 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:48.998292 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:48.998292 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:48.998292 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:48.998292 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:48.998292 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:48.998292 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:48.998292 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:48.998292 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:48.998292 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:23:48.998292 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:23:48.998292 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:23:48.999206 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:23:48.999206 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:48.999206 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:48.999206 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:48.999206 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:48.999206 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:48.999206 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:48.999206 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:48.999206 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:48.999206 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:48.999206 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:48.999206 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:48.999206 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:48.999206 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:48.999206 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:48.999206 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:48.999206 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:49.000145 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:23:49.000145 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:23:49.000145 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:23:49.000145 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:23:49.000145 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:23:49.000145 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:23:49.000145 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:23:49.000145 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:49.000145 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 430/868] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 10:23:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:49.006878 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de5775b-b149-439b-a00a-327ebf5ac766 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:49.058577 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84ad47-6671-436e-a50c-7271f4700b9d None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:49.058877 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84ad47-6671-436e-a50c-7271f4700b9d None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:49.059062 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84ad47-6671-436e-a50c-7271f4700b9d None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:49.062701 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 431/869] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:23:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:23:49.066752 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a163a-4693-4fff-82ee-aa8707aedebd None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:49.067044 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a163a-4693-4fff-82ee-aa8707aedebd None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:49.067328 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a163a-4693-4fff-82ee-aa8707aedebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:49.084266 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-3f6a163a-4693-4fff-82ee-aa8707aedebd None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:23:49.085526 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-3f6a163a-4693-4fff-82ee-aa8707aedebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:23:49.127764 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de5775b-b149-439b-a00a-327ebf5ac766 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:49.164057 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 432/870] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:23:49 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 10:23:49.165919 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac253f4-2e15-4fec-96c0-302a9b3537af None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:49.166215 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac253f4-2e15-4fec-96c0-302a9b3537af None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:49.166494 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac253f4-2e15-4fec-96c0-302a9b3537af None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:49.172028 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 433/871] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:23:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:23:49.173798 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca88426-d51f-44ab-a0c6-e942b8cf87aa None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:49.174279 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca88426-d51f-44ab-a0c6-e942b8cf87aa None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:49.174755 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca88426-d51f-44ab-a0c6-e942b8cf87aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:49.176326 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5117f3fe-5055-44b1-bf14-98453ff3be37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:49.177526 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117f3fe-5055-44b1-bf14-98453ff3be37 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:49.177962 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117f3fe-5055-44b1-bf14-98453ff3be37 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:49.178441 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117f3fe-5055-44b1-bf14-98453ff3be37 None admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:49.179426 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5117f3fe-5055-44b1-bf14-98453ff3be37 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:49.179907 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5117f3fe-5055-44b1-bf14-98453ff3be37 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:49.181606 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5117f3fe-5055-44b1-bf14-98453ff3be37 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:49.193922 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-9ca88426-d51f-44ab-a0c6-e942b8cf87aa None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:23:49.195764 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-9ca88426-d51f-44ab-a0c6-e942b8cf87aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:23:49.195877 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 439/872] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 10:23:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:49.196065 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5117f3fe-5055-44b1-bf14-98453ff3be37 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:49.223041 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:49.233342 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:49.269108 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 434/873] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:23:49 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 10:23:49.269108 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca88426-d51f-44ab-a0c6-e942b8cf87aa None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:49.314956 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5117f3fe-5055-44b1-bf14-98453ff3be37 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:49.350637 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def08b0e-662e-4649-9970-e1dd487145fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:49.351305 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def08b0e-662e-4649-9970-e1dd487145fc None admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:49.351591 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def08b0e-662e-4649-9970-e1dd487145fc None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:49.351868 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def08b0e-662e-4649-9970-e1dd487145fc None admin] PATH_INFO: `/v3/services` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:49.352599 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def08b0e-662e-4649-9970-e1dd487145fc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:49.353994 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def08b0e-662e-4649-9970-e1dd487145fc None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:49.375465 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca88426-d51f-44ab-a0c6-e942b8cf87aa None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:49.409017 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83767da-cf93-4ecf-90af-e9e536db8bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:49.409704 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83767da-cf93-4ecf-90af-e9e536db8bf3 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:49.409989 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83767da-cf93-4ecf-90af-e9e536db8bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:49.410266 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83767da-cf93-4ecf-90af-e9e536db8bf3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:49.411097 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83767da-cf93-4ecf-90af-e9e536db8bf3 None admin] RBAC: Adding query filter params (role.id=e7b6a55ecf6c491487955aaefbf9c388, scope.project.id=a6098fe56d304980aa14bd95b4b92c17, user.id=2c548474a8d94591ba58dd40e40a28d2) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:49.411409 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83767da-cf93-4ecf-90af-e9e536db8bf3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:49.412819 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83767da-cf93-4ecf-90af-e9e536db8bf3 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:49.419336 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 435/874] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 10:23:49 2022] GET /identity/v3/role_assignments?user.id=2c548474a8d94591ba58dd40e40a28d2&scope.project.id=a6098fe56d304980aa14bd95b4b92c17&role.id=e7b6a55ecf6c491487955aaefbf9c388 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:49.420451 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83767da-cf93-4ecf-90af-e9e536db8bf3 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:49.445869 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 440/875] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Jul 18 10:23:49 2022] POST /identity/v3/services => generated 251 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:23:49.467444 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:49.550941 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83767da-cf93-4ecf-90af-e9e536db8bf3 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:49.601993 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd64b231-6927-4f50-9c02-97024bb51502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:49.603215 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64b231-6927-4f50-9c02-97024bb51502 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:49.603705 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64b231-6927-4f50-9c02-97024bb51502 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:49.604182 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64b231-6927-4f50-9c02-97024bb51502 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:49.618495 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd64b231-6927-4f50-9c02-97024bb51502 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:23:49.628030 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-bd64b231-6927-4f50-9c02-97024bb51502 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 10:23:49.628030 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:49.628030 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:49.628030 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:49.628030 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:49.628030 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:49.628030 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:49.628030 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:49.628030 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:49.628030 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:49.628030 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:49.628030 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:49.628030 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:23:49.628030 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:23:49.628030 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:23:49.628030 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:23:49.629027 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:23:49.629027 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:23:49.629027 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:23:49.629027 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:23:49.629027 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:49.629027 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:49.629027 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:49.629027 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:49.629027 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:49.629027 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:49.629027 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:49.629027 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:49.629027 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:49.629027 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:49.629027 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:49.629027 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:49.629914 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:49.629914 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:49.629914 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:49.629914 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:49.629914 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:23:49.629914 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:23:49.629914 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:23:49.629914 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:23:49.629914 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:23:49.629914 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:23:49.629914 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 10:23:49.629914 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:49.629914 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 436/876] 10.222.0.39 () {56 vars in 1120 bytes} [Mon Jul 18 10:23:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:49.635915 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def08b0e-662e-4649-9970-e1dd487145fc None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:49.734410 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:49.751964 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def08b0e-662e-4649-9970-e1dd487145fc None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:49.788991 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e4906-a884-41e3-ac66-bb64346edfab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:49.789749 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e4906-a884-41e3-ac66-bb64346edfab None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:49.790035 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e4906-a884-41e3-ac66-bb64346edfab None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:49.790310 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e4906-a884-41e3-ac66-bb64346edfab None admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:49.791068 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6e4906-a884-41e3-ac66-bb64346edfab None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:49.791380 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6e4906-a884-41e3-ac66-bb64346edfab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:49.792808 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6e4906-a884-41e3-ac66-bb64346edfab None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:49.801839 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 441/877] 10.222.0.39 () {56 vars in 1115 bytes} [Mon Jul 18 10:23:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:49.807409 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd64b231-6927-4f50-9c02-97024bb51502 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:49.810533 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20adc54d-6202-4bcf-8f6b-49bc65e9835c None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:49.810825 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20adc54d-6202-4bcf-8f6b-49bc65e9835c None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:49.811100 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20adc54d-6202-4bcf-8f6b-49bc65e9835c None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:49.812698 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 442/878] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:23:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:23:49.817995 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2df9e-c983-4d1e-94a6-73d65ab919d6 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:49.818293 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2df9e-c983-4d1e-94a6-73d65ab919d6 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:49.818579 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2df9e-c983-4d1e-94a6-73d65ab919d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:49.836413 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-cae2df9e-c983-4d1e-94a6-73d65ab919d6 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:23:49.837662 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-cae2df9e-c983-4d1e-94a6-73d65ab919d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:23:49.919826 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 443/879] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:23:49 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 10:23:49.928882 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:49.938336 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2df9e-c983-4d1e-94a6-73d65ab919d6 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:49.941369 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd64b231-6927-4f50-9c02-97024bb51502 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:49.989497 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1806079-1323-4ba7-9d17-de3104104eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:49.991474 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1806079-1323-4ba7-9d17-de3104104eba None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:49.992009 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1806079-1323-4ba7-9d17-de3104104eba None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:49.992697 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1806079-1323-4ba7-9d17-de3104104eba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:50.006769 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1806079-1323-4ba7-9d17-de3104104eba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:50.008867 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1806079-1323-4ba7-9d17-de3104104eba None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:50.026161 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:50.033622 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-f1806079-1323-4ba7-9d17-de3104104eba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:50.033622 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:50.033622 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:50.033622 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:50.033622 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:50.033622 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:50.033622 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:50.033622 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:50.033622 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:50.033622 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:50.033622 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:50.033622 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:50.033622 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:50.033622 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:50.033622 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:50.034701 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:50.034701 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:50.034701 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:50.034701 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:50.034701 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:50.034701 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:50.034701 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:50.034701 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:50.034701 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:50.034701 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:50.034701 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:50.034701 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:50.034701 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:50.034701 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:50.034701 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:50.034701 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:50.034701 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:50.035786 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:50.035786 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:50.035786 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:50.035786 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:50.038359 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 437/880] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:50.047643 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1806079-1323-4ba7-9d17-de3104104eba None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:50.056318 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2df9e-c983-4d1e-94a6-73d65ab919d6 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:50.114796 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b28d0-c00c-4b76-9479-fd8c2fe37147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:50.116004 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b28d0-c00c-4b76-9479-fd8c2fe37147 None admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:50.116712 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b28d0-c00c-4b76-9479-fd8c2fe37147 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:50.117193 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b28d0-c00c-4b76-9479-fd8c2fe37147 None admin] PATH_INFO: `/v3/services` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:50.118740 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51b28d0-c00c-4b76-9479-fd8c2fe37147 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:50.120353 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51b28d0-c00c-4b76-9479-fd8c2fe37147 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:50.159934 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1806079-1323-4ba7-9d17-de3104104eba None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:50.195835 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d21e03-7b56-4fd0-bc63-2bb8ff357815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:50.196514 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d21e03-7b56-4fd0-bc63-2bb8ff357815 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:50.196803 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d21e03-7b56-4fd0-bc63-2bb8ff357815 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:50.197103 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d21e03-7b56-4fd0-bc63-2bb8ff357815 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:50.197939 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d21e03-7b56-4fd0-bc63-2bb8ff357815 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:50.198139 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d21e03-7b56-4fd0-bc63-2bb8ff357815 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:50.198359 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 444/881] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Jul 18 10:23:49 2022] POST /identity/v3/services => generated 269 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:23:50.199492 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d21e03-7b56-4fd0-bc63-2bb8ff357815 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:50.218784 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 438/882] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:50.224553 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b28d0-c00c-4b76-9479-fd8c2fe37147 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:50.356103 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b28d0-c00c-4b76-9479-fd8c2fe37147 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:50.388428 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:50.394553 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41176d3a-fad4-41ba-852a-8d3102e8f382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:50.395377 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41176d3a-fad4-41ba-852a-8d3102e8f382 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:50.395657 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41176d3a-fad4-41ba-852a-8d3102e8f382 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:50.395930 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41176d3a-fad4-41ba-852a-8d3102e8f382 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:50.404696 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41176d3a-fad4-41ba-852a-8d3102e8f382 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:50.406157 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41176d3a-fad4-41ba-852a-8d3102e8f382 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:50.421893 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-41176d3a-fad4-41ba-852a-8d3102e8f382 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 10:23:50.421893 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:50.421893 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:50.421893 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:50.421893 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:50.421893 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:50.421893 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:50.421893 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:50.421893 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:50.421893 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:50.421893 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:50.421893 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:50.421893 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:23:50.421893 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:23:50.421893 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:23:50.421893 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:23:50.422862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:50.422862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:50.422862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:23:50.422862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:23:50.422862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:23:50.422862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:23:50.422862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:50.422862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:50.422862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:50.422862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:50.422862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:50.422862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:50.422862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:50.422862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:50.422862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:50.422862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:50.422862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:50.422862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:50.423793 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:50.423793 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:50.423793 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:23:50.423793 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:23:50.423793 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:23:50.423793 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:23:50.423793 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:23:50.423793 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:23:50.423793 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 10:23:50.423793 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:50.423793 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 445/883] 10.222.0.39 () {56 vars in 1117 bytes} [Mon Jul 18 10:23:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:50.430435 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d21e03-7b56-4fd0-bc63-2bb8ff357815 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:50.433563 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:50.538173 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d21e03-7b56-4fd0-bc63-2bb8ff357815 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:50.573724 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd11638-87cf-4fe5-840f-d889430054d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:50.574831 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd11638-87cf-4fe5-840f-d889430054d8 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:50.575895 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd11638-87cf-4fe5-840f-d889430054d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:50.576436 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd11638-87cf-4fe5-840f-d889430054d8 None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:50.577513 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd11638-87cf-4fe5-840f-d889430054d8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:50.578047 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd11638-87cf-4fe5-840f-d889430054d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:50.579653 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd11638-87cf-4fe5-840f-d889430054d8 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:50.598532 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 439/884] 10.222.0.39 () {56 vars in 1149 bytes} [Mon Jul 18 10:23:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:50.604354 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41176d3a-fad4-41ba-852a-8d3102e8f382 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:50.712702 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41176d3a-fad4-41ba-852a-8d3102e8f382 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:50.749075 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2835ecf-9835-4065-8e84-ad673d075388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:50.749744 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2835ecf-9835-4065-8e84-ad673d075388 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:50.750025 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2835ecf-9835-4065-8e84-ad673d075388 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:50.750300 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2835ecf-9835-4065-8e84-ad673d075388 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:50.812456 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:50.821630 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2835ecf-9835-4065-8e84-ad673d075388 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:50.823070 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2835ecf-9835-4065-8e84-ad673d075388 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:50.927858 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 446/885] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 10:23:50 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 10:23:50.933463 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd11638-87cf-4fe5-840f-d889430054d8 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:50.997963 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:51.040128 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd11638-87cf-4fe5-840f-d889430054d8 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:51.077145 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979b4a7a-9fbb-4565-88c0-7c94ee4cce94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:51.078274 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b4a7a-9fbb-4565-88c0-7c94ee4cce94 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:51.078758 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b4a7a-9fbb-4565-88c0-7c94ee4cce94 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:51.079232 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979b4a7a-9fbb-4565-88c0-7c94ee4cce94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:51.089877 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979b4a7a-9fbb-4565-88c0-7c94ee4cce94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:51.091853 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979b4a7a-9fbb-4565-88c0-7c94ee4cce94 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:51.110624 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-979b4a7a-9fbb-4565-88c0-7c94ee4cce94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:51.110624 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:51.110624 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:51.110624 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:51.110624 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:51.110624 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:51.110624 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:51.110624 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:51.110624 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:51.110624 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:51.110624 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:51.110624 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:51.110624 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:51.110624 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:51.110624 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:51.111496 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:51.111496 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:51.111496 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:51.111496 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:51.111496 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:51.111496 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:51.111496 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:51.111496 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:51.111496 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:51.111496 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:51.111496 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:51.111496 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:51.111496 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:51.111496 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:51.111496 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:51.111496 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:51.111496 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:51.113196 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:51.113196 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:51.113196 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:51.113196 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:51.113196 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 440/886] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:51.117934 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2835ecf-9835-4065-8e84-ad673d075388 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:51.209179 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:51.218596 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2835ecf-9835-4065-8e84-ad673d075388 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:51.254381 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0793c3d0-3db5-496d-b384-a74b40f2e707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:51.255625 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793c3d0-3db5-496d-b384-a74b40f2e707 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:51.256144 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793c3d0-3db5-496d-b384-a74b40f2e707 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:51.256629 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793c3d0-3db5-496d-b384-a74b40f2e707 None admin] PATH_INFO: `/v3/domains` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:51.257602 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0793c3d0-3db5-496d-b384-a74b40f2e707 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:51.258209 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0793c3d0-3db5-496d-b384-a74b40f2e707 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:51.259788 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0793c3d0-3db5-496d-b384-a74b40f2e707 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:51.272281 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 447/887] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:51.277466 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979b4a7a-9fbb-4565-88c0-7c94ee4cce94 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:51.382283 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979b4a7a-9fbb-4565-88c0-7c94ee4cce94 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:51.396420 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:51.418223 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16135e-ce3f-4456-bca2-a4bec130e122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:51.419645 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16135e-ce3f-4456-bca2-a4bec130e122 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:51.419926 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16135e-ce3f-4456-bca2-a4bec130e122 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:51.420203 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16135e-ce3f-4456-bca2-a4bec130e122 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:51.427704 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a16135e-ce3f-4456-bca2-a4bec130e122 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:51.429202 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a16135e-ce3f-4456-bca2-a4bec130e122 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:51.448272 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-8a16135e-ce3f-4456-bca2-a4bec130e122 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:23:51.448272 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:51.448272 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:51.448272 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:51.448272 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:51.448272 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:51.448272 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:51.448272 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:51.448272 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:51.448272 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:51.448272 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:51.448272 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:51.448272 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:23:51.448272 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:23:51.448272 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:23:51.449277 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:23:51.449277 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:51.449277 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:51.449277 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:51.449277 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:51.449277 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:51.449277 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:51.449277 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:51.449277 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:51.449277 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:51.449277 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:51.449277 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:51.449277 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:51.449277 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:51.449277 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:51.449277 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:51.449277 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:51.450774 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:23:51.450774 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:23:51.450774 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:23:51.450774 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:23:51.450774 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:23:51.450774 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:23:51.450774 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:23:51.450774 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:51.451736 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 441/888] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 10:23:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:51.456922 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0793c3d0-3db5-496d-b384-a74b40f2e707 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:51.577516 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0793c3d0-3db5-496d-b384-a74b40f2e707 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:51.615167 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a375d-d835-4694-85df-9cba5387a0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:51.616190 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a375d-d835-4694-85df-9cba5387a0f4 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:51.616697 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a375d-d835-4694-85df-9cba5387a0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:51.617464 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a375d-d835-4694-85df-9cba5387a0f4 None admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:51.619198 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a375d-d835-4694-85df-9cba5387a0f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:51.619771 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a375d-d835-4694-85df-9cba5387a0f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:51.621419 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a375d-d835-4694-85df-9cba5387a0f4 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:51.635833 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 448/889] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 10:23:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:51.642642 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16135e-ce3f-4456-bca2-a4bec130e122 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:51.678521 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a648c39-6b4b-417f-8f73-c6a58a7e27bc None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:51.679122 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a648c39-6b4b-417f-8f73-c6a58a7e27bc None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:51.679581 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a648c39-6b4b-417f-8f73-c6a58a7e27bc None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:51.681143 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 449/890] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:23:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:23:51.695291 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c216b7-8952-4c6b-8b15-a315e546cbda None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:51.695920 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c216b7-8952-4c6b-8b15-a315e546cbda None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:51.696400 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c216b7-8952-4c6b-8b15-a315e546cbda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:51.714779 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-c5c216b7-8952-4c6b-8b15-a315e546cbda None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:23:51.717177 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-c5c216b7-8952-4c6b-8b15-a315e546cbda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:23:51.724497 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:51.756399 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16135e-ce3f-4456-bca2-a4bec130e122 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:51.788119 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 450/891] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:23:51 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:23:51.793445 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f6a84-226b-4494-a614-eb59d271dd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:51.794228 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f6a84-226b-4494-a614-eb59d271dd5d None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:51.794692 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f6a84-226b-4494-a614-eb59d271dd5d None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:51.794973 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f6a84-226b-4494-a614-eb59d271dd5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:51.795579 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8620e1-4e2b-4ac9-95dd-68870f2d3de0 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:51.795820 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2f6a84-226b-4494-a614-eb59d271dd5d None admin] RBAC: Adding query filter params (role.id=e5d4d6eee014413ea5c24c2b65d09652, scope.project.id=a6098fe56d304980aa14bd95b4b92c17, user.id=88ad60446c5447a8bbd0096fa2133efb) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:51.796137 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2f6a84-226b-4494-a614-eb59d271dd5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:51.796531 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8620e1-4e2b-4ac9-95dd-68870f2d3de0 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:51.797032 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8620e1-4e2b-4ac9-95dd-68870f2d3de0 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:51.797595 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2f6a84-226b-4494-a614-eb59d271dd5d None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:51.802769 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 451/892] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:23:51 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:23:51.804135 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e04672e-e1da-4ee6-9034-2d35bb250e47 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:51.804427 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e04672e-e1da-4ee6-9034-2d35bb250e47 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:51.804705 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e04672e-e1da-4ee6-9034-2d35bb250e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:51.809905 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 442/893] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 10:23:51 2022] GET /identity/v3/role_assignments?user.id=88ad60446c5447a8bbd0096fa2133efb&scope.project.id=a6098fe56d304980aa14bd95b4b92c17&role.id=e5d4d6eee014413ea5c24c2b65d09652 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:51.811941 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f6a84-226b-4494-a614-eb59d271dd5d None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:51.829224 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-5e04672e-e1da-4ee6-9034-2d35bb250e47 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:23:51.831070 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-5e04672e-e1da-4ee6-9034-2d35bb250e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:23:51.856620 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:51.929151 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 452/894] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:23:51 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:23:51.950766 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e04672e-e1da-4ee6-9034-2d35bb250e47 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:51.957983 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f6a84-226b-4494-a614-eb59d271dd5d None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:52.002034 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b0c3e-e39f-4966-bb24-a67fe434e878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:52.002927 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b0c3e-e39f-4966-bb24-a67fe434e878 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:52.003211 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b0c3e-e39f-4966-bb24-a67fe434e878 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:52.003492 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b0c3e-e39f-4966-bb24-a67fe434e878 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:52.004156 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88b0c3e-e39f-4966-bb24-a67fe434e878 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:52.005575 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88b0c3e-e39f-4966-bb24-a67fe434e878 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:52.021765 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-c88b0c3e-e39f-4966-bb24-a67fe434e878 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 10:23:52.021765 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:52.021765 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 10:23:52.021765 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 10:23:52.021765 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 10:23:52.021765 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 10:23:52.021765 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 10:23:52.021765 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:23:52.021765 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 10:23:52.021765 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:52.021765 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 10:23:52.021765 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:52.021765 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:52.021765 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:52.021765 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:52.021765 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:52.021765 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:52.022911 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:52.022911 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:52.022911 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:52.022911 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:52.022911 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:52.022911 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:52.022911 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 10:23:52.022911 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 10:23:52.022911 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 10:23:52.022911 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 10:23:52.022911 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:52.022911 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:52.022911 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:52.022911 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:52.022911 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:52.022911 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:52.023771 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:52.023771 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:52.023771 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:52.023771 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:52.023771 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:52.023771 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:52.023771 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:52.023771 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:52.023771 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:52.023771 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:52.023771 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 10:23:52.023771 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:23:52.023771 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 10:23:52.023771 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:52.023771 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 443/895] 10.222.0.39 () {56 vars in 1126 bytes} [Mon Jul 18 10:23:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:52.031565 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b0c3e-e39f-4966-bb24-a67fe434e878 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:52.040274 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:52.077830 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e04672e-e1da-4ee6-9034-2d35bb250e47 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:52.128404 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df20381-d186-49b0-8fb8-949730e2c4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:52.129727 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df20381-d186-49b0-8fb8-949730e2c4f3 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:52.130251 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df20381-d186-49b0-8fb8-949730e2c4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:52.130731 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df20381-d186-49b0-8fb8-949730e2c4f3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:52.131605 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df20381-d186-49b0-8fb8-949730e2c4f3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:52.133217 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df20381-d186-49b0-8fb8-949730e2c4f3 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:52.150334 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-9df20381-d186-49b0-8fb8-949730e2c4f3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 10:23:52.150334 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:52.150334 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 10:23:52.150334 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 10:23:52.150334 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 10:23:52.150334 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 10:23:52.150334 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 10:23:52.150334 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:23:52.150334 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 10:23:52.150334 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:52.150334 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 10:23:52.150334 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:52.150334 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:52.150334 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:52.150334 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:52.150334 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:52.150334 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:52.151490 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:52.151490 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:52.151490 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:52.151490 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:52.151490 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:52.151490 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:52.151490 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 10:23:52.151490 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 10:23:52.151490 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 10:23:52.151490 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 10:23:52.151490 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:52.151490 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:52.151490 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:52.151490 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:52.151490 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:52.151490 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:52.152365 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:52.152365 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:52.152365 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:52.152365 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:52.152365 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:52.152365 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:52.152365 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:52.152365 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:52.152365 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:52.152365 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:52.152365 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 10:23:52.152365 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:23:52.152365 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 10:23:52.152365 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:52.160425 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 453/896] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Jul 18 10:23:51 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:23:52.166625 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:52.168022 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df20381-d186-49b0-8fb8-949730e2c4f3 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:52.171027 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b0c3e-e39f-4966-bb24-a67fe434e878 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:52.220596 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb1bcd7-9d6d-452b-956b-fd32c5f8b405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:52.221957 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1bcd7-9d6d-452b-956b-fd32c5f8b405 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:52.222949 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1bcd7-9d6d-452b-956b-fd32c5f8b405 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:52.223452 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1bcd7-9d6d-452b-956b-fd32c5f8b405 None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:52.224609 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb1bcd7-9d6d-452b-956b-fd32c5f8b405 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:52.225386 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb1bcd7-9d6d-452b-956b-fd32c5f8b405 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:52.226770 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb1bcd7-9d6d-452b-956b-fd32c5f8b405 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:52.232860 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 444/897] 10.222.0.39 () {56 vars in 1122 bytes} [Mon Jul 18 10:23:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:52.242288 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb1bcd7-9d6d-452b-956b-fd32c5f8b405 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:52.302482 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df20381-d186-49b0-8fb8-949730e2c4f3 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:52.349120 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c802303f-4013-41a8-affb-708784fc3c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:52.350116 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802303f-4013-41a8-affb-708784fc3c01 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:52.350431 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802303f-4013-41a8-affb-708784fc3c01 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:52.350813 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802303f-4013-41a8-affb-708784fc3c01 None admin] PATH_INFO: `/v3/services` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:52.351642 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c802303f-4013-41a8-affb-708784fc3c01 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:52.352037 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c802303f-4013-41a8-affb-708784fc3c01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:52.353660 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c802303f-4013-41a8-affb-708784fc3c01 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:52.355744 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:52.361088 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 454/898] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Jul 18 10:23:52 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:52.366930 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c802303f-4013-41a8-affb-708784fc3c01 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:52.377892 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb1bcd7-9d6d-452b-956b-fd32c5f8b405 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:52.419128 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c025b-842e-41d3-afb6-9ab0439557aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:52.419794 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c025b-842e-41d3-afb6-9ab0439557aa None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:52.420074 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c025b-842e-41d3-afb6-9ab0439557aa None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:52.420349 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c025b-842e-41d3-afb6-9ab0439557aa None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:52.421067 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2c025b-842e-41d3-afb6-9ab0439557aa None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:52.421389 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2c025b-842e-41d3-afb6-9ab0439557aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:52.422743 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2c025b-842e-41d3-afb6-9ab0439557aa None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:52.427839 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 445/899] 10.222.0.39 () {56 vars in 1122 bytes} [Mon Jul 18 10:23:52 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:52.429084 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34b40a-1872-4ba7-bc40-eb2b2d0b5d67 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:52.429369 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34b40a-1872-4ba7-bc40-eb2b2d0b5d67 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:52.429641 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34b40a-1872-4ba7-bc40-eb2b2d0b5d67 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:52.431053 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 446/900] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:23:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:23:52.437608 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae587cc-e248-484b-8ea9-995ad5958257 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:52.437895 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae587cc-e248-484b-8ea9-995ad5958257 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:52.438170 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae587cc-e248-484b-8ea9-995ad5958257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:52.457857 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-8ae587cc-e248-484b-8ea9-995ad5958257 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:23:52.459093 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-8ae587cc-e248-484b-8ea9-995ad5958257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:23:52.502283 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:52.504251 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c802303f-4013-41a8-affb-708784fc3c01 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:52.542907 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7979012-3dc2-4e8c-bba1-749964c726c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:52.544099 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7979012-3dc2-4e8c-bba1-749964c726c6 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:52.544419 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7979012-3dc2-4e8c-bba1-749964c726c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:52.544974 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7979012-3dc2-4e8c-bba1-749964c726c6 None admin] PATH_INFO: `/v3/services` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:52.546217 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 447/901] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:23:52 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 10:23:52.546595 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7979012-3dc2-4e8c-bba1-749964c726c6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:52.547205 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7979012-3dc2-4e8c-bba1-749964c726c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:52.548809 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7979012-3dc2-4e8c-bba1-749964c726c6 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:52.563507 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 455/902] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Jul 18 10:23:52 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:23:52.565275 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae587cc-e248-484b-8ea9-995ad5958257 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:52.570269 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7979012-3dc2-4e8c-bba1-749964c726c6 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:52.647527 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:52.683378 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae587cc-e248-484b-8ea9-995ad5958257 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:52.701461 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7979012-3dc2-4e8c-bba1-749964c726c6 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:52.721618 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a80172c-7555-447a-aa2f-f825b2d6a831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:52.722318 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a80172c-7555-447a-aa2f-f825b2d6a831 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:52.722548 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a80172c-7555-447a-aa2f-f825b2d6a831 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:52.722818 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a80172c-7555-447a-aa2f-f825b2d6a831 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:52.723599 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a80172c-7555-447a-aa2f-f825b2d6a831 None admin] RBAC: Adding query filter params (interface=public, service_id=ce2758aabb404634be4f8a2bad14e67f, region_id=RegionOne) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:52.723907 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a80172c-7555-447a-aa2f-f825b2d6a831 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:52.725509 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a80172c-7555-447a-aa2f-f825b2d6a831 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:52.736005 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 448/903] 10.222.0.39 () {56 vars in 1251 bytes} [Mon Jul 18 10:23:52 2022] GET /identity/v3/endpoints?service_id=ce2758aabb404634be4f8a2bad14e67f&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:52.737225 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a80172c-7555-447a-aa2f-f825b2d6a831 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:52.745271 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4789c11b-ec58-449d-a910-7eb726fdb800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:52.746512 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789c11b-ec58-449d-a910-7eb726fdb800 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:52.747683 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789c11b-ec58-449d-a910-7eb726fdb800 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:52.748146 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789c11b-ec58-449d-a910-7eb726fdb800 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:52.749090 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4789c11b-ec58-449d-a910-7eb726fdb800 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:52.750746 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4789c11b-ec58-449d-a910-7eb726fdb800 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:52.763701 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:52.765774 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-4789c11b-ec58-449d-a910-7eb726fdb800 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 10:23:52.765774 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:52.765774 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 10:23:52.765774 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 10:23:52.765774 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 10:23:52.765774 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 10:23:52.765774 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 10:23:52.765774 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:23:52.765774 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 10:23:52.765774 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:52.765774 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 10:23:52.765774 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:52.765774 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:52.765774 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:52.765774 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:52.765774 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:52.766664 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:52.766664 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:52.766664 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:52.766664 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:52.766664 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:52.766664 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:52.766664 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:52.766664 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 10:23:52.766664 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 10:23:52.766664 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 10:23:52.766664 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 10:23:52.766664 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:52.766664 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:52.766664 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:52.766664 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:52.766664 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:52.767497 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:52.767497 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:52.767497 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:52.767497 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:52.767497 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:52.767497 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:52.767497 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:52.767497 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:52.767497 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:52.767497 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:52.767497 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:52.767497 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 10:23:52.767497 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:23:52.767497 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 10:23:52.767497 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:52.769971 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 456/904] 10.222.0.39 () {56 vars in 1132 bytes} [Mon Jul 18 10:23:52 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:52.775935 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4789c11b-ec58-449d-a910-7eb726fdb800 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:52.869898 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a80172c-7555-447a-aa2f-f825b2d6a831 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:52.894222 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4789c11b-ec58-449d-a910-7eb726fdb800 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:52.914640 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec83cf7c-a4ed-476e-875b-2728671652d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:52.915303 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83cf7c-a4ed-476e-875b-2728671652d5 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:52.915584 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83cf7c-a4ed-476e-875b-2728671652d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:52.916133 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83cf7c-a4ed-476e-875b-2728671652d5 None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:52.916526 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec83cf7c-a4ed-476e-875b-2728671652d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:52.918015 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec83cf7c-a4ed-476e-875b-2728671652d5 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:52.924838 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 449/905] 10.222.0.39 () {56 vars in 1087 bytes} [Mon Jul 18 10:23:52 2022] GET /identity/v3/services => generated 1268 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 10:23:52.931407 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:52.941304 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a592335-ae5e-48ec-a046-9ddffa9e79bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:52.942316 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a592335-ae5e-48ec-a046-9ddffa9e79bf None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:52.942769 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a592335-ae5e-48ec-a046-9ddffa9e79bf None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:52.943215 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a592335-ae5e-48ec-a046-9ddffa9e79bf None admin] PATH_INFO: `/v3/services` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:52.946543 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a592335-ae5e-48ec-a046-9ddffa9e79bf None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:52.946543 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a592335-ae5e-48ec-a046-9ddffa9e79bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:52.946543 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a592335-ae5e-48ec-a046-9ddffa9e79bf None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:52.953310 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 457/906] 10.222.0.39 () {56 vars in 1126 bytes} [Mon Jul 18 10:23:52 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:23:52.961857 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec83cf7c-a4ed-476e-875b-2728671652d5 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:53.068041 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:53.092526 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec83cf7c-a4ed-476e-875b-2728671652d5 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:53.135712 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7313071-a713-4c99-9379-2be8ca20e7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:53.136388 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7313071-a713-4c99-9379-2be8ca20e7f0 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:53.136670 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7313071-a713-4c99-9379-2be8ca20e7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:53.136986 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7313071-a713-4c99-9379-2be8ca20e7f0 None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:53.138512 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7313071-a713-4c99-9379-2be8ca20e7f0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:53.138883 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7313071-a713-4c99-9379-2be8ca20e7f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:53.140300 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7313071-a713-4c99-9379-2be8ca20e7f0 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:53.145788 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 450/907] 10.222.0.39 () {56 vars in 1126 bytes} [Mon Jul 18 10:23:52 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:53.154773 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a592335-ae5e-48ec-a046-9ddffa9e79bf None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:53.258249 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a592335-ae5e-48ec-a046-9ddffa9e79bf None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:53.292879 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e7ad6c-9617-498b-bbd4-d4c0fe2a6a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:53.293644 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7ad6c-9617-498b-bbd4-d4c0fe2a6a31 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:53.293956 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7ad6c-9617-498b-bbd4-d4c0fe2a6a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:53.294179 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7ad6c-9617-498b-bbd4-d4c0fe2a6a31 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:53.294968 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e7ad6c-9617-498b-bbd4-d4c0fe2a6a31 None admin] RBAC: Adding query filter params (interface=public, service_id=ef3e909bcdb04ae8a3ddc212d47ffc72, region_id=RegionOne) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:53.295284 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e7ad6c-9617-498b-bbd4-d4c0fe2a6a31 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:53.296649 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e7ad6c-9617-498b-bbd4-d4c0fe2a6a31 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:53.302340 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 458/908] 10.222.0.39 () {56 vars in 1251 bytes} [Mon Jul 18 10:23:53 2022] GET /identity/v3/endpoints?service_id=ef3e909bcdb04ae8a3ddc212d47ffc72&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:53.307738 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7313071-a713-4c99-9379-2be8ca20e7f0 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:53.414593 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7313071-a713-4c99-9379-2be8ca20e7f0 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:53.449715 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769a2a4-97e7-4fb9-a0a2-c7b1f614d7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:53.450390 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769a2a4-97e7-4fb9-a0a2-c7b1f614d7c5 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:53.450670 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769a2a4-97e7-4fb9-a0a2-c7b1f614d7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:53.450949 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769a2a4-97e7-4fb9-a0a2-c7b1f614d7c5 None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:53.451619 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2769a2a4-97e7-4fb9-a0a2-c7b1f614d7c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:53.452971 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2769a2a4-97e7-4fb9-a0a2-c7b1f614d7c5 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:53.459297 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 451/909] 10.222.0.39 () {56 vars in 1087 bytes} [Mon Jul 18 10:23:53 2022] GET /identity/v3/services => generated 1268 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:23:53.995688 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d562fd-a6fe-421a-af96-c251d05f62e0 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:53.996242 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d562fd-a6fe-421a-af96-c251d05f62e0 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:53.996242 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d562fd-a6fe-421a-af96-c251d05f62e0 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:53.999088 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 459/910] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:23:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:23:54.004354 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097919c-af40-4174-afec-941856b09c5d None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:54.004644 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097919c-af40-4174-afec-941856b09c5d None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:54.004924 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097919c-af40-4174-afec-941856b09c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:54.023064 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-0097919c-af40-4174-afec-941856b09c5d None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:23:54.024246 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-0097919c-af40-4174-afec-941856b09c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:23:54.034860 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:54.099920 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 452/911] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:23:54 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:23:54.126763 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d562fd-a6fe-421a-af96-c251d05f62e0 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:54.195060 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:54.242299 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d562fd-a6fe-421a-af96-c251d05f62e0 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:54.279061 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87224cf-9a88-4abd-af99-d1eb18b2f8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:54.279802 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87224cf-9a88-4abd-af99-d1eb18b2f8ad None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:54.280085 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87224cf-9a88-4abd-af99-d1eb18b2f8ad None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:54.280361 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87224cf-9a88-4abd-af99-d1eb18b2f8ad None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:54.290969 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87224cf-9a88-4abd-af99-d1eb18b2f8ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:23:54.302819 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-f87224cf-9a88-4abd-af99-d1eb18b2f8ad None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 10:23:54.302819 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:54.302819 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:54.302819 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:54.302819 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:54.302819 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:54.302819 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:54.302819 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:54.302819 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:54.302819 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:54.302819 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:54.302819 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:54.302819 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:23:54.302819 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:23:54.302819 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:23:54.302819 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:23:54.303759 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:23:54.303759 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:23:54.303759 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:23:54.303759 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:23:54.303759 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:54.303759 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:54.303759 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:54.303759 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:54.303759 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:54.303759 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:54.303759 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:54.303759 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:54.303759 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:54.303759 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:54.303759 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:54.303759 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:54.304584 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:54.304584 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:54.304584 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:54.304584 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:54.304584 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:23:54.304584 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:23:54.304584 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:23:54.304584 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:23:54.304584 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:23:54.304584 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:23:54.304584 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 10:23:54.304584 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:54.304584 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 460/912] 10.222.0.39 () {56 vars in 1120 bytes} [Mon Jul 18 10:23:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:54.312232 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0097919c-af40-4174-afec-941856b09c5d None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:54.414767 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0097919c-af40-4174-afec-941856b09c5d None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:54.451555 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a90310-33df-4df6-ace9-79bdbf303e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:54.452243 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a90310-33df-4df6-ace9-79bdbf303e1c None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:54.452524 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a90310-33df-4df6-ace9-79bdbf303e1c None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:54.452798 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a90310-33df-4df6-ace9-79bdbf303e1c None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:54.453574 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a90310-33df-4df6-ace9-79bdbf303e1c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:54.453879 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a90310-33df-4df6-ace9-79bdbf303e1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:54.455234 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a90310-33df-4df6-ace9-79bdbf303e1c None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:54.464039 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 453/913] 10.222.0.39 () {56 vars in 1115 bytes} [Mon Jul 18 10:23:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:54.474237 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87224cf-9a88-4abd-af99-d1eb18b2f8ad None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:54.531260 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0eeea6-5ee0-402a-8449-3b02f663fc03 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:54.531560 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0eeea6-5ee0-402a-8449-3b02f663fc03 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:54.531749 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0eeea6-5ee0-402a-8449-3b02f663fc03 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:54.533251 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 454/914] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:23:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:23:54.540782 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e381e-0ef0-469f-b925-412673562130 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:54.541649 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e381e-0ef0-469f-b925-412673562130 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:54.542150 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e381e-0ef0-469f-b925-412673562130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:54.557397 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:54.566415 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-d16e381e-0ef0-469f-b925-412673562130 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:23:54.568510 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-d16e381e-0ef0-469f-b925-412673562130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:23:54.585276 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87224cf-9a88-4abd-af99-d1eb18b2f8ad None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:54.604827 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:54.628527 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18576d5a-f533-4352-9858-ac30581eb2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:54.629627 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18576d5a-f533-4352-9858-ac30581eb2e9 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:54.629978 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18576d5a-f533-4352-9858-ac30581eb2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:54.630323 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18576d5a-f533-4352-9858-ac30581eb2e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:54.642423 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18576d5a-f533-4352-9858-ac30581eb2e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:54.644314 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18576d5a-f533-4352-9858-ac30581eb2e9 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:54.669365 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-18576d5a-f533-4352-9858-ac30581eb2e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:54.669365 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:54.669365 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:54.669365 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:54.669365 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:54.669365 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:54.669365 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:54.669365 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:54.669365 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:54.669365 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:54.669365 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:54.669365 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:54.669365 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:54.669365 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:54.669365 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:54.670299 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:54.670299 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:54.670299 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:54.670299 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:54.670299 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:54.670299 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:54.670299 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:54.670299 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:54.670299 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:54.670299 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:54.670299 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:54.670299 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:54.670299 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:54.670299 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:54.670299 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:54.670299 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:54.670299 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:54.671205 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:54.671205 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:54.671205 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:54.671205 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:54.671205 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 461/916] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:54.671487 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 455/916] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:23:54 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 10:23:54.675175 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18576d5a-f533-4352-9858-ac30581eb2e9 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:54.695417 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16e381e-0ef0-469f-b925-412673562130 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:54.807676 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18576d5a-f533-4352-9858-ac30581eb2e9 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:54.817377 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16e381e-0ef0-469f-b925-412673562130 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:54.846684 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6e10f-454d-4fc6-93d7-ce70bcd9cf63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:54.847350 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6e10f-454d-4fc6-93d7-ce70bcd9cf63 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:54.847630 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6e10f-454d-4fc6-93d7-ce70bcd9cf63 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:54.847900 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6e10f-454d-4fc6-93d7-ce70bcd9cf63 None admin] PATH_INFO: `/v3/domains` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:54.848674 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b6e10f-454d-4fc6-93d7-ce70bcd9cf63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:54.848980 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b6e10f-454d-4fc6-93d7-ce70bcd9cf63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:54.850637 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b6e10f-454d-4fc6-93d7-ce70bcd9cf63 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:54.864272 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5a2930-c7bb-447f-95ab-d997b2500fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:54.864599 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 462/917] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:23:54.865479 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a2930-c7bb-447f-95ab-d997b2500fc7 None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:54.865924 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a2930-c7bb-447f-95ab-d997b2500fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:54.866344 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a2930-c7bb-447f-95ab-d997b2500fc7 None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:54.867221 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5a2930-c7bb-447f-95ab-d997b2500fc7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:54.868730 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5a2930-c7bb-447f-95ab-d997b2500fc7 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:54.869868 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6e10f-454d-4fc6-93d7-ce70bcd9cf63 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:54.875086 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:54.900536 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:54.961080 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 456/918] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Jul 18 10:23:54 2022] POST /identity/v3/services => generated 241 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:23:54.984982 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6e10f-454d-4fc6-93d7-ce70bcd9cf63 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:55.034406 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b0423f-d25c-4d62-ad8a-05a7ef37a897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:55.035237 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0423f-d25c-4d62-ad8a-05a7ef37a897 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:55.035522 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0423f-d25c-4d62-ad8a-05a7ef37a897 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:55.035796 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0423f-d25c-4d62-ad8a-05a7ef37a897 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:55.045357 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b0423f-d25c-4d62-ad8a-05a7ef37a897 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:55.046951 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b0423f-d25c-4d62-ad8a-05a7ef37a897 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:55.065266 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-e5b0423f-d25c-4d62-ad8a-05a7ef37a897 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 10:23:55.065266 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:55.065266 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:55.065266 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:55.065266 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:55.065266 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:55.065266 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:55.065266 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:55.065266 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:55.065266 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:55.065266 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:55.065266 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:55.065266 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:23:55.065266 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:23:55.065266 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:23:55.065266 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:23:55.066315 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:55.066315 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:55.066315 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:23:55.066315 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:23:55.066315 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:23:55.066315 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:23:55.066315 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:55.066315 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:55.066315 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:55.066315 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:55.066315 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:55.066315 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:55.066315 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:55.066315 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:55.066315 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:55.066315 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:55.066315 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:55.066315 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:55.067315 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:55.067315 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:55.067315 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:23:55.067315 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:23:55.067315 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:23:55.067315 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:23:55.067315 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:23:55.067315 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:23:55.067315 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 10:23:55.067315 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:55.067315 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 463/919] 10.222.0.39 () {56 vars in 1117 bytes} [Mon Jul 18 10:23:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:55.072185 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5a2930-c7bb-447f-95ab-d997b2500fc7 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:55.126826 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2cc984-8477-4aa0-bb1f-4144660f0dc8 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:55.127165 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2cc984-8477-4aa0-bb1f-4144660f0dc8 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:55.127382 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2cc984-8477-4aa0-bb1f-4144660f0dc8 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:55.129716 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 464/920] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:23:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:23:55.136947 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58810584-bbd5-4f0a-9769-42cb7a86e8eb None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:55.137962 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58810584-bbd5-4f0a-9769-42cb7a86e8eb None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:55.137962 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58810584-bbd5-4f0a-9769-42cb7a86e8eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:55.158800 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-58810584-bbd5-4f0a-9769-42cb7a86e8eb None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:23:55.160021 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-58810584-bbd5-4f0a-9769-42cb7a86e8eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:23:55.209912 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5a2930-c7bb-447f-95ab-d997b2500fc7 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:55.239493 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 465/921] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:23:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 10:23:55.249060 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2938b5c-3896-4463-b145-cd3f0632900b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:55.250072 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2938b5c-3896-4463-b145-cd3f0632900b None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:55.250570 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2938b5c-3896-4463-b145-cd3f0632900b None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:55.251153 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2938b5c-3896-4463-b145-cd3f0632900b None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:55.252213 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2938b5c-3896-4463-b145-cd3f0632900b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:55.252746 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2938b5c-3896-4463-b145-cd3f0632900b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:55.254446 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2938b5c-3896-4463-b145-cd3f0632900b None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:55.264355 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58810584-bbd5-4f0a-9769-42cb7a86e8eb None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:55.275323 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 457/922] 10.222.0.39 () {56 vars in 1149 bytes} [Mon Jul 18 10:23:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:55.281541 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2938b5c-3896-4463-b145-cd3f0632900b None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:55.284577 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:55.345955 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:55.385591 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58810584-bbd5-4f0a-9769-42cb7a86e8eb None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:55.394878 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2938b5c-3896-4463-b145-cd3f0632900b None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:55.426365 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0414895-9ce1-421d-b2f5-6a1084a1112c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:55.427461 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0414895-9ce1-421d-b2f5-6a1084a1112c None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:55.427952 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0414895-9ce1-421d-b2f5-6a1084a1112c None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:55.428478 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0414895-9ce1-421d-b2f5-6a1084a1112c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:55.429361 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0414895-9ce1-421d-b2f5-6a1084a1112c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:55.430953 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0414895-9ce1-421d-b2f5-6a1084a1112c None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:55.434602 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79c718-8865-4a7c-8457-83999ab181db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:55.435639 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79c718-8865-4a7c-8457-83999ab181db None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:55.436073 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79c718-8865-4a7c-8457-83999ab181db None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:55.436499 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79c718-8865-4a7c-8457-83999ab181db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:55.445369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-b0414895-9ce1-421d-b2f5-6a1084a1112c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 10:23:55.445369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:55.445369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 10:23:55.445369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 10:23:55.445369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 10:23:55.445369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 10:23:55.445369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 10:23:55.445369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:23:55.445369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 10:23:55.445369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:55.445369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 10:23:55.445369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:55.445369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:55.445369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:55.445369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:55.445369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:55.445369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:55.446613 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:55.446613 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:55.446613 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:55.446613 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:55.446613 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:55.446613 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:55.446613 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 10:23:55.446613 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 10:23:55.446613 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 10:23:55.446613 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 10:23:55.446613 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:55.446613 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:55.446613 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:55.446613 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:55.446613 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:55.446613 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:55.447658 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:55.447658 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:55.447658 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:55.447658 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:55.447658 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:55.447658 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:55.447658 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:55.447658 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:55.447658 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:55.447658 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:55.447658 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 10:23:55.447658 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:23:55.447658 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 10:23:55.447658 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:55.451114 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba79c718-8865-4a7c-8457-83999ab181db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:55.452753 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba79c718-8865-4a7c-8457-83999ab181db None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:55.454819 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 466/923] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Jul 18 10:23:55 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:23:55.455987 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0414895-9ce1-421d-b2f5-6a1084a1112c None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:55.473031 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-ba79c718-8865-4a7c-8457-83999ab181db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:55.473031 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:55.473031 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:55.473031 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:55.473031 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:55.473031 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:55.473031 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:55.473031 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:55.473031 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:55.473031 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:55.473031 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:55.473031 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:55.473031 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:55.473031 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:55.473031 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:55.474005 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:55.474005 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:55.474005 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:55.474005 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:55.474005 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:55.474005 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:55.474005 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:55.474005 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:55.474005 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:55.474005 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:55.474005 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:55.474005 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:55.474005 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:55.474005 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:55.474005 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:55.474005 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:55.474005 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:55.474899 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:55.474899 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:55.474899 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:55.474899 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:55.478395 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 458/924] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:55.485986 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79c718-8865-4a7c-8457-83999ab181db None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:55.557431 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:55.582710 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0414895-9ce1-421d-b2f5-6a1084a1112c None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:55.598531 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79c718-8865-4a7c-8457-83999ab181db None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:55.607969 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:55.620430 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf0c4f8-592e-453e-9803-ede53cff39ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:55.634716 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0c4f8-592e-453e-9803-ede53cff39ba None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:55.634716 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0c4f8-592e-453e-9803-ede53cff39ba None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:55.634716 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0c4f8-592e-453e-9803-ede53cff39ba None admin] PATH_INFO: `/v3/services` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:55.634716 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf0c4f8-592e-453e-9803-ede53cff39ba None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:55.634716 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf0c4f8-592e-453e-9803-ede53cff39ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:55.634716 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf0c4f8-592e-453e-9803-ede53cff39ba None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:55.635169 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 467/925] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Jul 18 10:23:55 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:55.635169 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e7b7b-ee09-4995-94d1-2814bf0792d0 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:55.635169 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e7b7b-ee09-4995-94d1-2814bf0792d0 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:55.635169 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e7b7b-ee09-4995-94d1-2814bf0792d0 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:55.635169 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 468/926] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:23:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:23:55.635485 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6e7b7b-ee09-4995-94d1-2814bf0792d0 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:55.644311 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffe6097-96fa-42b0-a6e5-9a5cb1647b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:55.644977 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe6097-96fa-42b0-a6e5-9a5cb1647b6d None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:55.645281 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe6097-96fa-42b0-a6e5-9a5cb1647b6d None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:55.645552 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe6097-96fa-42b0-a6e5-9a5cb1647b6d None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:55.646278 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffe6097-96fa-42b0-a6e5-9a5cb1647b6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:55.646581 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffe6097-96fa-42b0-a6e5-9a5cb1647b6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:55.647934 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffe6097-96fa-42b0-a6e5-9a5cb1647b6d None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:55.666000 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 459/927] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:55.666000 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec1a7c8-e3a3-4658-8934-248d5976f276 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:55.666000 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec1a7c8-e3a3-4658-8934-248d5976f276 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:55.666000 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec1a7c8-e3a3-4658-8934-248d5976f276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:55.682974 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-0ec1a7c8-e3a3-4658-8934-248d5976f276 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:23:55.684239 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-0ec1a7c8-e3a3-4658-8934-248d5976f276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:23:55.747271 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6e7b7b-ee09-4995-94d1-2814bf0792d0 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:55.755001 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 460/928] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:23:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:23:55.761945 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec1a7c8-e3a3-4658-8934-248d5976f276 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:55.785678 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779d2e5-8816-4b9b-8113-aea8984be301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:55.786362 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779d2e5-8816-4b9b-8113-aea8984be301 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:55.786648 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779d2e5-8816-4b9b-8113-aea8984be301 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:55.786926 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779d2e5-8816-4b9b-8113-aea8984be301 None admin] PATH_INFO: `/v3/services` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:55.787638 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f779d2e5-8816-4b9b-8113-aea8984be301 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:55.787947 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f779d2e5-8816-4b9b-8113-aea8984be301 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:55.789350 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f779d2e5-8816-4b9b-8113-aea8984be301 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:55.794440 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 469/929] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Jul 18 10:23:55 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:55.799751 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779d2e5-8816-4b9b-8113-aea8984be301 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:55.809513 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:55.868044 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:55.875540 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec1a7c8-e3a3-4658-8934-248d5976f276 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:55.908214 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779d2e5-8816-4b9b-8113-aea8984be301 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:55.913261 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a35f93d-f7d3-46cb-b7d1-c23b8c1bbbe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:55.914053 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35f93d-f7d3-46cb-b7d1-c23b8c1bbbe9 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:55.914332 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35f93d-f7d3-46cb-b7d1-c23b8c1bbbe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:55.914601 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35f93d-f7d3-46cb-b7d1-c23b8c1bbbe9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:55.921326 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a35f93d-f7d3-46cb-b7d1-c23b8c1bbbe9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:55.922755 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a35f93d-f7d3-46cb-b7d1-c23b8c1bbbe9 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:55.938546 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-1a35f93d-f7d3-46cb-b7d1-c23b8c1bbbe9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:23:55.938546 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:55.938546 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:55.938546 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:55.938546 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:55.938546 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:55.938546 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:55.938546 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:55.938546 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:55.938546 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:55.938546 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:55.938546 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:55.938546 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:23:55.938546 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:23:55.938546 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:23:55.939467 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:23:55.939467 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:55.939467 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:55.939467 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:55.939467 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:55.939467 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:55.939467 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:55.939467 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:55.939467 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:55.939467 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:55.939467 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:55.939467 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:55.939467 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:55.939467 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:55.939467 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:55.939467 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:55.939467 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:55.940380 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:23:55.940380 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:23:55.940380 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:23:55.940380 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:23:55.940380 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:23:55.940380 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:23:55.940380 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:23:55.940380 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:55.940380 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 461/930] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 10:23:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:55.941561 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a35f93d-f7d3-46cb-b7d1-c23b8c1bbbe9 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:55.951453 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9428fd-5c60-4953-aabf-f0f30e29c0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:55.953132 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9428fd-5c60-4953-aabf-f0f30e29c0cf None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:55.953854 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9428fd-5c60-4953-aabf-f0f30e29c0cf None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:55.954954 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9428fd-5c60-4953-aabf-f0f30e29c0cf None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:55.956563 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9428fd-5c60-4953-aabf-f0f30e29c0cf None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:55.958963 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9428fd-5c60-4953-aabf-f0f30e29c0cf None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:55.975636 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-aa9428fd-5c60-4953-aabf-f0f30e29c0cf None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 10:23:55.975636 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:55.975636 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 10:23:55.975636 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 10:23:55.975636 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 10:23:55.975636 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 10:23:55.975636 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 10:23:55.975636 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:23:55.975636 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 10:23:55.975636 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:55.975636 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 10:23:55.975636 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:55.975636 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:55.975636 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:55.975636 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:55.975636 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:55.976588 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:55.976588 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:55.976588 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:55.976588 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:55.976588 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:55.976588 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:55.976588 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:55.976588 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 10:23:55.976588 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 10:23:55.976588 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 10:23:55.976588 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 10:23:55.976588 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:55.976588 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:55.976588 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:55.976588 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:55.976588 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:55.977555 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:55.977555 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:55.977555 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:55.977555 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:55.977555 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:55.977555 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:55.977555 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:55.977555 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:55.977555 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:55.977555 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:55.977555 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:55.977555 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 10:23:55.977555 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:23:55.977555 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 10:23:55.977555 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:55.978326 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 470/931] 10.222.0.39 () {56 vars in 1132 bytes} [Mon Jul 18 10:23:55 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:55.979030 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9428fd-5c60-4953-aabf-f0f30e29c0cf None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:56.055033 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:56.064777 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a35f93d-f7d3-46cb-b7d1-c23b8c1bbbe9 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:56.095123 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9428fd-5c60-4953-aabf-f0f30e29c0cf None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:56.107253 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea1b07b-4bc6-4711-b803-12aed72cfc48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:56.107253 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1b07b-4bc6-4711-b803-12aed72cfc48 None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:56.107571 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1b07b-4bc6-4711-b803-12aed72cfc48 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:56.107893 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1b07b-4bc6-4711-b803-12aed72cfc48 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:56.108641 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea1b07b-4bc6-4711-b803-12aed72cfc48 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:56.110062 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea1b07b-4bc6-4711-b803-12aed72cfc48 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:56.136289 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ab94d-49a0-41d3-a711-ed0f81a9ee96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:56.136289 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ab94d-49a0-41d3-a711-ed0f81a9ee96 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:56.136289 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ab94d-49a0-41d3-a711-ed0f81a9ee96 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:56.136289 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ab94d-49a0-41d3-a711-ed0f81a9ee96 None admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:56.136756 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418ab94d-49a0-41d3-a711-ed0f81a9ee96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:56.137153 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418ab94d-49a0-41d3-a711-ed0f81a9ee96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:56.138653 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418ab94d-49a0-41d3-a711-ed0f81a9ee96 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:56.150368 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 471/932] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 10:23:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:56.151148 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ab94d-49a0-41d3-a711-ed0f81a9ee96 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:56.200562 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 462/933] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Jul 18 10:23:55 2022] POST /identity/v3/endpoints => generated 346 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:23:56.201755 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea1b07b-4bc6-4711-b803-12aed72cfc48 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:56.223327 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:56.278390 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ab94d-49a0-41d3-a711-ed0f81a9ee96 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:56.314709 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:56.328146 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f4df34-cbf1-404d-9508-483894a5af0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:56.328845 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f4df34-cbf1-404d-9508-483894a5af0e None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:56.329157 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f4df34-cbf1-404d-9508-483894a5af0e None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:56.329434 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f4df34-cbf1-404d-9508-483894a5af0e None admin] PATH_INFO: `/v3/services` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:56.330272 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f4df34-cbf1-404d-9508-483894a5af0e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:56.330568 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f4df34-cbf1-404d-9508-483894a5af0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:56.331957 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f4df34-cbf1-404d-9508-483894a5af0e None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:56.343766 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 472/934] 10.222.0.39 () {56 vars in 1126 bytes} [Mon Jul 18 10:23:56 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:56.344982 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f4df34-cbf1-404d-9508-483894a5af0e None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:56.350204 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea1b07b-4bc6-4711-b803-12aed72cfc48 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:56.393804 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3165919-815e-48d3-be7a-f96fe17d6fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:56.395099 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3165919-815e-48d3-be7a-f96fe17d6fe2 None admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:56.395592 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3165919-815e-48d3-be7a-f96fe17d6fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:56.396055 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3165919-815e-48d3-be7a-f96fe17d6fe2 None admin] PATH_INFO: `/v3/projects/a6098fe56d304980aa14bd95b4b92c17/users/88ad60446c5447a8bbd0096fa2133efb/roles/e5d4d6eee014413ea5c24c2b65d09652` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:56.401755 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3165919-815e-48d3-be7a-f96fe17d6fe2 None admin] RBAC: Authorizing `identity:create_grant(project_id=a6098fe56d304980aa14bd95b4b92c17, user_id=88ad60446c5447a8bbd0096fa2133efb, role_id=e5d4d6eee014413ea5c24c2b65d09652)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:56.404160 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3165919-815e-48d3-be7a-f96fe17d6fe2 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:56.464760 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f4df34-cbf1-404d-9508-483894a5af0e None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:56.508074 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 463/935] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jul 18 10:23:56 2022] PUT /identity/v3/projects/a6098fe56d304980aa14bd95b4b92c17/users/88ad60446c5447a8bbd0096fa2133efb/roles/e5d4d6eee014413ea5c24c2b65d09652 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:23:56.508746 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e510b0c0-f11f-43e5-8431-b3aa46daf0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:56.509647 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e510b0c0-f11f-43e5-8431-b3aa46daf0d9 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:56.510122 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e510b0c0-f11f-43e5-8431-b3aa46daf0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:56.510574 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e510b0c0-f11f-43e5-8431-b3aa46daf0d9 None admin] PATH_INFO: `/v3/services` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:56.511486 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e510b0c0-f11f-43e5-8431-b3aa46daf0d9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:56.512695 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e510b0c0-f11f-43e5-8431-b3aa46daf0d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:56.514620 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e510b0c0-f11f-43e5-8431-b3aa46daf0d9 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:56.521565 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 473/936] 10.222.0.39 () {56 vars in 1126 bytes} [Mon Jul 18 10:23:56 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:56.529872 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3165919-815e-48d3-be7a-f96fe17d6fe2 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:56.610418 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:56.644127 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3165919-815e-48d3-be7a-f96fe17d6fe2 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:56.682647 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26377f40-7242-4b77-b4d0-c65c02cb9dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:56.683331 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26377f40-7242-4b77-b4d0-c65c02cb9dbe None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:56.683611 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26377f40-7242-4b77-b4d0-c65c02cb9dbe None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:56.683916 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26377f40-7242-4b77-b4d0-c65c02cb9dbe None admin] PATH_INFO: `/v3/endpoints` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:56.684699 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26377f40-7242-4b77-b4d0-c65c02cb9dbe None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:56.686227 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26377f40-7242-4b77-b4d0-c65c02cb9dbe None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:56.788928 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 464/937] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Jul 18 10:23:56 2022] POST /identity/v3/endpoints => generated 347 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:23:57.157640 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc13b1-2131-48ee-b437-7eb34db916bb None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:57.158617 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc13b1-2131-48ee-b437-7eb34db916bb None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:57.159110 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc13b1-2131-48ee-b437-7eb34db916bb None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:57.160943 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 474/938] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:23:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:23:57.165886 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c6d1b-1df6-4cc3-8571-344726665b50 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:57.166408 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c6d1b-1df6-4cc3-8571-344726665b50 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:57.166890 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c6d1b-1df6-4cc3-8571-344726665b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:57.184351 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-e73c6d1b-1df6-4cc3-8571-344726665b50 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:23:57.185911 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-e73c6d1b-1df6-4cc3-8571-344726665b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:23:57.265181 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 465/939] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:23:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:23:57.287985 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dc13b1-2131-48ee-b437-7eb34db916bb None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:57.348574 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:57.396523 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dc13b1-2131-48ee-b437-7eb34db916bb None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:57.433438 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d2edb-7746-45ad-8823-b9aa3a01b729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:57.434933 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d2edb-7746-45ad-8823-b9aa3a01b729 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:57.435220 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d2edb-7746-45ad-8823-b9aa3a01b729 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:57.435497 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d2edb-7746-45ad-8823-b9aa3a01b729 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:57.436165 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200d2edb-7746-45ad-8823-b9aa3a01b729 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:57.437585 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200d2edb-7746-45ad-8823-b9aa3a01b729 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:57.450862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-200d2edb-7746-45ad-8823-b9aa3a01b729 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 10:23:57.450862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:57.450862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 10:23:57.450862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 10:23:57.450862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 10:23:57.450862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 10:23:57.450862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 10:23:57.450862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:23:57.450862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 10:23:57.450862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:57.450862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 10:23:57.450862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:57.450862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:57.450862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:57.450862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:57.450862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:57.450862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:57.451845 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:57.451845 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:57.451845 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:57.451845 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:57.451845 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:57.451845 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:57.451845 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 10:23:57.451845 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 10:23:57.451845 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 10:23:57.451845 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 10:23:57.451845 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:57.451845 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:57.451845 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:57.451845 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:57.451845 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:57.451845 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:57.452689 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:57.452689 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:57.452689 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:57.452689 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:57.452689 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:57.452689 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:57.452689 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:57.452689 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:57.452689 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:57.452689 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:57.452689 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 10:23:57.452689 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:23:57.452689 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 10:23:57.452689 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:57.452689 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 475/940] 10.222.0.39 () {56 vars in 1126 bytes} [Mon Jul 18 10:23:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:57.458288 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c6d1b-1df6-4cc3-8571-344726665b50 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:57.515941 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:57.565963 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c6d1b-1df6-4cc3-8571-344726665b50 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:57.602266 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2262e634-d181-4c25-9d6c-e5e062770715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:57.602930 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262e634-d181-4c25-9d6c-e5e062770715 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:57.603210 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262e634-d181-4c25-9d6c-e5e062770715 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:57.603481 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262e634-d181-4c25-9d6c-e5e062770715 None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:57.604184 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2262e634-d181-4c25-9d6c-e5e062770715 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:57.604641 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2262e634-d181-4c25-9d6c-e5e062770715 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:57.606118 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2262e634-d181-4c25-9d6c-e5e062770715 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:57.611423 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 466/941] 10.222.0.39 () {56 vars in 1122 bytes} [Mon Jul 18 10:23:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:57.617169 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d2edb-7746-45ad-8823-b9aa3a01b729 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:57.724341 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d2edb-7746-45ad-8823-b9aa3a01b729 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:57.742213 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:57.759656 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5fdbb-b42d-4bb5-b9c8-295a672548cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:57.760331 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5fdbb-b42d-4bb5-b9c8-295a672548cf None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:57.760666 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5fdbb-b42d-4bb5-b9c8-295a672548cf None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:57.760952 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5fdbb-b42d-4bb5-b9c8-295a672548cf None admin] PATH_INFO: `/v3/services` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:57.761699 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a5fdbb-b42d-4bb5-b9c8-295a672548cf None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:57.762553 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a5fdbb-b42d-4bb5-b9c8-295a672548cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:57.763973 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a5fdbb-b42d-4bb5-b9c8-295a672548cf None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:57.769434 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 476/942] 10.222.0.39 () {56 vars in 1122 bytes} [Mon Jul 18 10:23:57 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:57.775423 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2262e634-d181-4c25-9d6c-e5e062770715 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:57.883176 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2262e634-d181-4c25-9d6c-e5e062770715 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:57.905121 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:57.922642 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ccd76e-39cd-42a7-8a67-fcc4ebc20562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:57.923303 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ccd76e-39cd-42a7-8a67-fcc4ebc20562 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:57.935302 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ccd76e-39cd-42a7-8a67-fcc4ebc20562 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:57.935302 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ccd76e-39cd-42a7-8a67-fcc4ebc20562 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:57.935302 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ccd76e-39cd-42a7-8a67-fcc4ebc20562 None admin] RBAC: Adding query filter params (interface=public, service_id=3bbca0529fcb4ec5bbd6b2367c28e91c, region_id=RegionOne) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:57.935302 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ccd76e-39cd-42a7-8a67-fcc4ebc20562 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:57.935302 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ccd76e-39cd-42a7-8a67-fcc4ebc20562 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:57.935302 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 467/943] 10.222.0.39 () {56 vars in 1251 bytes} [Mon Jul 18 10:23:57 2022] GET /identity/v3/endpoints?service_id=3bbca0529fcb4ec5bbd6b2367c28e91c&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:57.937978 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5fdbb-b42d-4bb5-b9c8-295a672548cf None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:58.052007 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5fdbb-b42d-4bb5-b9c8-295a672548cf None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:58.088338 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094b320-a991-430d-831e-ebdc73c4e5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:58.089429 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094b320-a991-430d-831e-ebdc73c4e5db None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:58.090456 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094b320-a991-430d-831e-ebdc73c4e5db None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:58.091008 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094b320-a991-430d-831e-ebdc73c4e5db None admin] PATH_INFO: `/v3/services` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:58.091958 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d094b320-a991-430d-831e-ebdc73c4e5db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:58.093580 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d094b320-a991-430d-831e-ebdc73c4e5db None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:58.103897 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 477/944] 10.222.0.39 () {56 vars in 1087 bytes} [Mon Jul 18 10:23:57 2022] GET /identity/v3/services => generated 1497 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:23:58.387916 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4531a-adf2-49c0-b863-3e76ae00557e None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:58.388767 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4531a-adf2-49c0-b863-3e76ae00557e None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:58.389244 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4531a-adf2-49c0-b863-3e76ae00557e None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:58.391035 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 468/945] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:23:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:23:58.396643 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f1b9a3-5d09-473e-b5be-44d8b253610d None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:58.397494 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f1b9a3-5d09-473e-b5be-44d8b253610d None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:58.397976 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f1b9a3-5d09-473e-b5be-44d8b253610d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:58.415520 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-d7f1b9a3-5d09-473e-b5be-44d8b253610d None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:23:58.417088 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-d7f1b9a3-5d09-473e-b5be-44d8b253610d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:23:58.466648 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:58.493127 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 478/946] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:23:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:23:58.518096 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b4531a-adf2-49c0-b863-3e76ae00557e None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:58.626655 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b4531a-adf2-49c0-b863-3e76ae00557e None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:58.639723 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81012b8e-989a-4bd3-9a74-b6e8c22052ed None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:58.639902 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81012b8e-989a-4bd3-9a74-b6e8c22052ed None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:58.640188 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81012b8e-989a-4bd3-9a74-b6e8c22052ed None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:58.642880 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 479/947] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:23:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:23:58.646869 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76072b7d-f5ff-4a56-bbf2-1702d73f45e9 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:58.647156 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76072b7d-f5ff-4a56-bbf2-1702d73f45e9 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:58.647435 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76072b7d-f5ff-4a56-bbf2-1702d73f45e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:58.666479 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff686ae-1e37-4ef6-ae9e-06b82f91b4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:58.667468 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff686ae-1e37-4ef6-ae9e-06b82f91b4df None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:58.667767 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-76072b7d-f5ff-4a56-bbf2-1702d73f45e9 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:23:58.668250 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff686ae-1e37-4ef6-ae9e-06b82f91b4df None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:58.668870 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff686ae-1e37-4ef6-ae9e-06b82f91b4df None admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:58.669368 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-76072b7d-f5ff-4a56-bbf2-1702d73f45e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:23:58.670430 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff686ae-1e37-4ef6-ae9e-06b82f91b4df None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:58.673727 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff686ae-1e37-4ef6-ae9e-06b82f91b4df None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:58.675174 dv-cinder-837546-3-smb devstack@keystone.service[80393]: WARNING keystone.server.flask.common [None req-6ff686ae-1e37-4ef6-ae9e-06b82f91b4df None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 18 10:23:58.730810 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.sql.core [None req-6ff686ae-1e37-4ef6-ae9e-06b82f91b4df None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 18 10:23:58.730810 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 18 10:23:58.730810 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [parameters: {'id': '2c324930bf7a468f8a7bb7ee3b78bb66', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 18 10:23:58.730810 dv-cinder-837546-3-smb devstack@keystone.service[80393]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80393) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 18 10:23:58.743330 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-6ff686ae-1e37-4ef6-ae9e-06b82f91b4df None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2c324930bf7a468f8a7bb7ee3b78bb66.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2c324930bf7a468f8a7bb7ee3b78bb66. Jul 18 10:23:58.743330 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:58.743330 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 10:23:58.743330 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 18 10:23:58.743330 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 10:23:58.743330 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 18 10:23:58.743330 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 10:23:58.743330 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application result = self._query(query) Jul 18 10:23:58.743330 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 10:23:58.743330 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application conn.query(q) Jul 18 10:23:58.743330 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 10:23:58.743330 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 10:23:58.743330 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 10:23:58.744154 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application result.read() Jul 18 10:23:58.744154 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 10:23:58.744154 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 18 10:23:58.744154 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 10:23:58.744154 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 18 10:23:58.744154 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 10:23:58.744154 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 18 10:23:58.744154 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 10:23:58.744154 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 18 10:23:58.744154 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 18 10:23:58.744154 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:58.744154 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 18 10:23:58.744154 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:58.744154 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:58.744154 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 18 10:23:58.744154 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 18 10:23:58.744154 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 18 10:23:58.744154 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 18 10:23:58.747538 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 18 10:23:58.747538 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application next(self.gen) Jul 18 10:23:58.747538 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 18 10:23:58.747538 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application yield resource Jul 18 10:23:58.747538 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 18 10:23:58.747538 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application next(self.gen) Jul 18 10:23:58.747538 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 18 10:23:58.747538 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self.session.rollback() Jul 18 10:23:58.747538 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 10:23:58.747538 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self.force_reraise() Jul 18 10:23:58.747538 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 10:23:58.747538 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise self.value Jul 18 10:23:58.747538 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 18 10:23:58.747538 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 18 10:23:58.747538 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 18 10:23:58.747538 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application session.commit() Jul 18 10:23:58.747538 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 18 10:23:58.748466 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 18 10:23:58.748466 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 18 10:23:58.748466 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._prepare_impl() Jul 18 10:23:58.748466 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 18 10:23:58.748466 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self.session.flush() Jul 18 10:23:58.748466 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 18 10:23:58.748466 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._flush(objects) Jul 18 10:23:58.748466 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 18 10:23:58.748466 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 18 10:23:58.748466 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 18 10:23:58.748466 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application compat.raise_( Jul 18 10:23:58.748466 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 10:23:58.748466 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception Jul 18 10:23:58.748466 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 18 10:23:58.748466 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application flush_context.execute() Jul 18 10:23:58.748466 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 18 10:23:58.748466 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rec.execute(self) Jul 18 10:23:58.749391 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 18 10:23:58.749391 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 18 10:23:58.749391 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 18 10:23:58.749391 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 18 10:23:58.749391 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 18 10:23:58.749391 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 18 10:23:58.749391 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 18 10:23:58.749391 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 18 10:23:58.749391 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 18 10:23:58.749391 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 18 10:23:58.749391 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 18 10:23:58.749391 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 18 10:23:58.749391 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 18 10:23:58.749391 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 18 10:23:58.749391 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 18 10:23:58.750175 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 18 10:23:58.750175 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 10:23:58.750175 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception Jul 18 10:23:58.750175 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 10:23:58.750175 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 18 10:23:58.750175 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 10:23:58.750175 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 18 10:23:58.750175 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 10:23:58.750175 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application result = self._query(query) Jul 18 10:23:58.750175 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 10:23:58.750175 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application conn.query(q) Jul 18 10:23:58.750175 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 10:23:58.750175 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 10:23:58.750175 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 10:23:58.750175 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application result.read() Jul 18 10:23:58.750175 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 10:23:58.750175 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 18 10:23:58.751072 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 10:23:58.751072 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 18 10:23:58.751072 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 10:23:58.751072 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 18 10:23:58.751072 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 10:23:58.751072 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 18 10:23:58.751072 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 18 10:23:58.751072 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 18 10:23:58.751072 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [parameters: {'id': '2c324930bf7a468f8a7bb7ee3b78bb66', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 18 10:23:58.751072 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 18 10:23:58.751072 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:58.751072 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 10:23:58.751072 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:58.751072 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:58.751072 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 18 10:23:58.751905 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 18 10:23:58.751905 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 18 10:23:58.751905 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 18 10:23:58.751905 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 18 10:23:58.751905 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:58.751905 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 10:23:58.751905 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:58.751905 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:58.751905 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:58.751905 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:58.751905 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:58.751905 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:58.751905 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:58.751905 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:58.751905 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:58.751905 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:58.751905 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:58.752782 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:58.752782 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 18 10:23:58.752782 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 18 10:23:58.752782 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:58.752782 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:58.752782 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 18 10:23:58.752782 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 18 10:23:58.752782 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2c324930bf7a468f8a7bb7ee3b78bb66. Jul 18 10:23:58.752782 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:58.754504 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 469/948] 10.222.0.39 () {60 vars in 1140 bytes} [Mon Jul 18 10:23:58 2022] POST /identity/v3/projects => generated 262 bytes in 236 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:58.756029 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 480/949] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:23:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 10:23:58.765082 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff686ae-1e37-4ef6-ae9e-06b82f91b4df None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:58.782658 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76072b7d-f5ff-4a56-bbf2-1702d73f45e9 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:58.809135 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:58.875095 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff686ae-1e37-4ef6-ae9e-06b82f91b4df None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:58.898785 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76072b7d-f5ff-4a56-bbf2-1702d73f45e9 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:58.907906 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:58.911358 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf2cce3-f979-4378-8dd9-c165ce1916fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:58.912175 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf2cce3-f979-4378-8dd9-c165ce1916fc None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:58.912462 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf2cce3-f979-4378-8dd9-c165ce1916fc None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:58.912741 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf2cce3-f979-4378-8dd9-c165ce1916fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:58.920164 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf2cce3-f979-4378-8dd9-c165ce1916fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:58.923211 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf2cce3-f979-4378-8dd9-c165ce1916fc None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:58.938007 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-6bf2cce3-f979-4378-8dd9-c165ce1916fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:23:58.938007 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:58.938007 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:58.938007 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:58.938007 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:58.938007 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:58.938007 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:58.938007 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:58.938007 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:58.938007 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:58.938007 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:58.938007 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:58.938007 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:23:58.938007 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:23:58.938007 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:23:58.938952 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:23:58.938952 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:58.938952 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:58.938952 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:58.938952 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:58.938952 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:58.938952 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:58.938952 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:58.938952 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:58.938952 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:58.938952 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:58.938952 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:58.938952 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:58.938952 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:58.938952 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:58.938952 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:58.938952 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:58.939854 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:23:58.939854 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:23:58.939854 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:23:58.939854 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:23:58.939854 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:23:58.939854 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:23:58.939854 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:23:58.939854 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:58.939854 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 470/950] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 10:23:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:23:58.942181 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ad629-26f4-450a-84d2-808cfb8ca860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:58.943258 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ad629-26f4-450a-84d2-808cfb8ca860 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:58.944027 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ad629-26f4-450a-84d2-808cfb8ca860 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:58.944452 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ad629-26f4-450a-84d2-808cfb8ca860 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:58.944996 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf2cce3-f979-4378-8dd9-c165ce1916fc None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:58.957065 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0ad629-26f4-450a-84d2-808cfb8ca860 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:23:58.966970 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-7d0ad629-26f4-450a-84d2-808cfb8ca860 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 10:23:58.966970 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:58.966970 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:58.966970 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:58.966970 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:58.966970 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:58.966970 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:58.966970 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:58.966970 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:58.966970 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:58.966970 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:58.966970 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:58.966970 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:23:58.966970 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:23:58.966970 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:23:58.966970 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:23:58.968118 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:23:58.968118 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:23:58.968118 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:23:58.968118 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:23:58.968118 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:58.968118 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:58.968118 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:58.968118 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:58.968118 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:58.968118 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:58.968118 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:58.968118 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:58.968118 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:58.968118 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:58.968118 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:58.968118 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:58.969395 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:58.969395 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:58.969395 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:58.969395 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:58.969395 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:23:58.969395 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:23:58.969395 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:23:58.969395 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:23:58.969395 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:23:58.969395 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:23:58.969395 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 10:23:58.969395 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:58.976985 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 481/951] 10.222.0.39 () {56 vars in 1120 bytes} [Mon Jul 18 10:23:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:23:58.978215 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ad629-26f4-450a-84d2-808cfb8ca860 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:59.052372 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:59.055811 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf2cce3-f979-4378-8dd9-c165ce1916fc None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:59.092920 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b25ec6-0374-42cc-b407-0eb4fc24e6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:59.094052 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b25ec6-0374-42cc-b407-0eb4fc24e6c5 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:59.094676 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b25ec6-0374-42cc-b407-0eb4fc24e6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:59.095433 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b25ec6-0374-42cc-b407-0eb4fc24e6c5 None admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:59.096106 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ad629-26f4-450a-84d2-808cfb8ca860 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:59.096228 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b25ec6-0374-42cc-b407-0eb4fc24e6c5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:59.096499 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b25ec6-0374-42cc-b407-0eb4fc24e6c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:59.098043 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b25ec6-0374-42cc-b407-0eb4fc24e6c5 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:59.137577 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 471/952] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Jul 18 10:23:58 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:23:59.138606 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a38f1-7aa0-4541-8aa8-aed0f0409c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:59.139325 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30487b3-3e22-4270-aae9-5174094a3c46 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:59.139627 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30487b3-3e22-4270-aae9-5174094a3c46 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:59.139780 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a38f1-7aa0-4541-8aa8-aed0f0409c65 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:59.139907 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30487b3-3e22-4270-aae9-5174094a3c46 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:59.140345 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a38f1-7aa0-4541-8aa8-aed0f0409c65 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:59.140770 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a38f1-7aa0-4541-8aa8-aed0f0409c65 None admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:59.141303 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 472/953] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:23:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:23:59.141877 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905a38f1-7aa0-4541-8aa8-aed0f0409c65 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:59.142323 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905a38f1-7aa0-4541-8aa8-aed0f0409c65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:59.143900 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905a38f1-7aa0-4541-8aa8-aed0f0409c65 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:59.146925 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e885a5-17fd-4c2b-a816-c52aca5c7dbb None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:59.147217 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e885a5-17fd-4c2b-a816-c52aca5c7dbb None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:59.147496 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e885a5-17fd-4c2b-a816-c52aca5c7dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:59.161471 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 482/954] 10.222.0.39 () {56 vars in 1115 bytes} [Mon Jul 18 10:23:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:59.162828 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a38f1-7aa0-4541-8aa8-aed0f0409c65 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:59.176100 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-b5e885a5-17fd-4c2b-a816-c52aca5c7dbb None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:23:59.178712 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-b5e885a5-17fd-4c2b-a816-c52aca5c7dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:23:59.199737 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:59.283849 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 473/955] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:23:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:23:59.296779 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a38f1-7aa0-4541-8aa8-aed0f0409c65 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:59.306163 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e885a5-17fd-4c2b-a816-c52aca5c7dbb None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:59.341314 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9bb4af-7e3c-4c84-a521-14b089193dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:59.342369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9bb4af-7e3c-4c84-a521-14b089193dac None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:59.342667 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9bb4af-7e3c-4c84-a521-14b089193dac None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:59.343045 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9bb4af-7e3c-4c84-a521-14b089193dac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:59.354555 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9bb4af-7e3c-4c84-a521-14b089193dac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:59.357293 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9bb4af-7e3c-4c84-a521-14b089193dac None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:59.377450 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-3a9bb4af-7e3c-4c84-a521-14b089193dac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:59.377450 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:59.377450 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:59.377450 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:59.377450 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:59.377450 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:59.377450 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:59.377450 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:59.377450 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:59.377450 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:59.377450 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:59.377450 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:59.377450 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:23:59.377450 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:23:59.377450 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:23:59.378599 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:23:59.378599 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:59.378599 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:59.378599 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:59.378599 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:59.378599 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:59.378599 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:59.378599 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:59.378599 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:59.378599 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:59.378599 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:59.378599 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:59.378599 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:59.378599 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:59.378599 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:59.378599 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:59.378599 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:59.379485 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:23:59.379485 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:23:59.379485 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:23:59.379485 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:59.379718 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 483/956] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:23:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:23:59.385401 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9bb4af-7e3c-4c84-a521-14b089193dac None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:59.437551 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:59.441579 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e885a5-17fd-4c2b-a816-c52aca5c7dbb None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:59.488270 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab26772-6cfd-485b-9944-a5fba5e3b820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:59.489122 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab26772-6cfd-485b-9944-a5fba5e3b820 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:59.489844 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:59.490276 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab26772-6cfd-485b-9944-a5fba5e3b820 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:59.490276 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab26772-6cfd-485b-9944-a5fba5e3b820 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:59.491509 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab26772-6cfd-485b-9944-a5fba5e3b820 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:59.493681 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab26772-6cfd-485b-9944-a5fba5e3b820 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:59.510890 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-2ab26772-6cfd-485b-9944-a5fba5e3b820 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 10:23:59.510890 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:59.510890 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 10:23:59.510890 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 10:23:59.510890 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 10:23:59.510890 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 10:23:59.510890 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 10:23:59.510890 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:23:59.510890 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 10:23:59.510890 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:59.510890 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 10:23:59.510890 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:59.510890 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:59.510890 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:59.510890 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:59.510890 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:59.510890 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:59.512602 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:59.512602 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:59.512602 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:59.512602 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:59.512602 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:59.512602 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:59.512602 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 10:23:59.512602 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 10:23:59.512602 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 10:23:59.512602 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 10:23:59.512602 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:59.512602 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:59.512602 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:59.512602 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:59.512602 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:59.512602 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:59.514143 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:59.514143 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:59.514143 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:59.514143 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:59.514143 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:59.514143 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:59.514143 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:59.514143 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:59.514143 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:59.514143 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:59.514143 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 10:23:59.514143 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:23:59.514143 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 10:23:59.514143 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:23:59.514143 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 474/957] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 10:23:59 2022] GET /identity/v3/services/compute => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:23:59.514985 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9bb4af-7e3c-4c84-a521-14b089193dac None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:59.518519 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab26772-6cfd-485b-9944-a5fba5e3b820 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:59.551650 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b36e47-a41e-480f-8a3e-1ed115d3da19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:59.552331 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b36e47-a41e-480f-8a3e-1ed115d3da19 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:59.552623 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b36e47-a41e-480f-8a3e-1ed115d3da19 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:59.552899 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b36e47-a41e-480f-8a3e-1ed115d3da19 None admin] PATH_INFO: `/v3/domains` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:59.553658 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b36e47-a41e-480f-8a3e-1ed115d3da19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:59.553968 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b36e47-a41e-480f-8a3e-1ed115d3da19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:59.555407 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b36e47-a41e-480f-8a3e-1ed115d3da19 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:59.572669 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 484/958] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:23:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:23:59.573762 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b36e47-a41e-480f-8a3e-1ed115d3da19 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:59.636219 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab26772-6cfd-485b-9944-a5fba5e3b820 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:59.675445 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dfedc0-0a46-4b83-b54e-b1772e5b2ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:59.676497 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dfedc0-0a46-4b83-b54e-b1772e5b2ba8 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:59.677138 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dfedc0-0a46-4b83-b54e-b1772e5b2ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:59.677723 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dfedc0-0a46-4b83-b54e-b1772e5b2ba8 None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:59.678636 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dfedc0-0a46-4b83-b54e-b1772e5b2ba8 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:59.679159 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dfedc0-0a46-4b83-b54e-b1772e5b2ba8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:59.680677 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b36e47-a41e-480f-8a3e-1ed115d3da19 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:59.680949 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dfedc0-0a46-4b83-b54e-b1772e5b2ba8 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:59.686980 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 475/959] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Jul 18 10:23:59 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:59.697316 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dfedc0-0a46-4b83-b54e-b1772e5b2ba8 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:59.715682 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:59.717163 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f28da3-68a1-441b-b82f-f7a9a16cb58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:59.718026 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f28da3-68a1-441b-b82f-f7a9a16cb58a None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:59.718313 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f28da3-68a1-441b-b82f-f7a9a16cb58a None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:59.718592 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f28da3-68a1-441b-b82f-f7a9a16cb58a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:59.727033 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f28da3-68a1-441b-b82f-f7a9a16cb58a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:59.728492 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f28da3-68a1-441b-b82f-f7a9a16cb58a None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:59.732188 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:23:59.745428 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-c5f28da3-68a1-441b-b82f-f7a9a16cb58a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 10:23:59.745428 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:23:59.745428 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:23:59.745428 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:23:59.745428 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:23:59.745428 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:23:59.745428 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:23:59.745428 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:23:59.745428 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:23:59.745428 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:23:59.745428 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:23:59.745428 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:23:59.745428 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:23:59.745428 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:23:59.745428 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:23:59.745428 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:23:59.746521 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:23:59.746521 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:23:59.746521 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:23:59.746521 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:23:59.746521 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:23:59.746521 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:23:59.746521 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:23:59.746521 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:23:59.746521 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:23:59.746521 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:23:59.746521 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:23:59.746521 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:23:59.746521 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:23:59.746521 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:23:59.746521 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:23:59.746521 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:23:59.746521 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:23:59.746521 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:23:59.747615 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:23:59.747615 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:23:59.747615 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:23:59.747615 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:23:59.747615 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:23:59.747615 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:23:59.747615 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:23:59.747615 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:23:59.747615 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 10:23:59.747615 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:23:59.751497 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 485/960] 10.222.0.39 () {56 vars in 1117 bytes} [Mon Jul 18 10:23:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:23:59.752342 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f28da3-68a1-441b-b82f-f7a9a16cb58a None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:23:59.827122 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dfedc0-0a46-4b83-b54e-b1772e5b2ba8 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:59.875734 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f28da3-68a1-441b-b82f-f7a9a16cb58a None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:23:59.875957 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a156b-2866-4f58-a70b-0968238bf1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:59.876527 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a156b-2866-4f58-a70b-0968238bf1e6 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:59.876811 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a156b-2866-4f58-a70b-0968238bf1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:59.877112 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a156b-2866-4f58-a70b-0968238bf1e6 None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:59.877826 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912a156b-2866-4f58-a70b-0968238bf1e6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:59.878137 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912a156b-2866-4f58-a70b-0968238bf1e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:59.879502 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912a156b-2866-4f58-a70b-0968238bf1e6 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:59.884875 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 476/961] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Jul 18 10:23:59 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:59.917769 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfadbea-cf22-4d8c-a212-d14a8156acf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:23:59.918803 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfadbea-cf22-4d8c-a212-d14a8156acf5 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:23:59.919095 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfadbea-cf22-4d8c-a212-d14a8156acf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:23:59.919377 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfadbea-cf22-4d8c-a212-d14a8156acf5 None admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:23:59.920240 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfadbea-cf22-4d8c-a212-d14a8156acf5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:23:59.920555 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfadbea-cf22-4d8c-a212-d14a8156acf5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:23:59.922142 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfadbea-cf22-4d8c-a212-d14a8156acf5 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:23:59.944173 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 486/962] 10.222.0.39 () {56 vars in 1149 bytes} [Mon Jul 18 10:23:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:23:59.950605 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a156b-2866-4f58-a70b-0968238bf1e6 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:00.046770 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:00.066527 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a156b-2866-4f58-a70b-0968238bf1e6 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:00.102882 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25864f3b-6a24-4a8c-b34f-1e73d894658d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:00.103525 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25864f3b-6a24-4a8c-b34f-1e73d894658d None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:00.103809 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25864f3b-6a24-4a8c-b34f-1e73d894658d None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:00.104086 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25864f3b-6a24-4a8c-b34f-1e73d894658d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:00.177213 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25864f3b-6a24-4a8c-b34f-1e73d894658d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:00.178954 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25864f3b-6a24-4a8c-b34f-1e73d894658d None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:00.221132 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59291e3-03dc-482d-a855-edfec800a647 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:00.221321 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59291e3-03dc-482d-a855-edfec800a647 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:00.221856 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59291e3-03dc-482d-a855-edfec800a647 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:00.223325 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 487/963] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:24:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:24:00.228781 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9fd01-d468-4e63-a327-186e3eb9b0f5 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:00.229368 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9fd01-d468-4e63-a327-186e3eb9b0f5 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:00.229943 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9fd01-d468-4e63-a327-186e3eb9b0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:00.249951 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-a1f9fd01-d468-4e63-a327-186e3eb9b0f5 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:24:00.251815 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-a1f9fd01-d468-4e63-a327-186e3eb9b0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:24:00.270674 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:00.301115 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 477/964] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 10:23:59 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 10:24:00.303776 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25864f3b-6a24-4a8c-b34f-1e73d894658d None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:00.329004 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:00.349121 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 488/965] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:24:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:24:00.376413 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f9fd01-d468-4e63-a327-186e3eb9b0f5 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:00.426515 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25864f3b-6a24-4a8c-b34f-1e73d894658d None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:00.467676 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae279b5-b1a8-4c00-984c-b34e605fd09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:00.469715 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae279b5-b1a8-4c00-984c-b34e605fd09e None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:00.470225 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae279b5-b1a8-4c00-984c-b34e605fd09e None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:00.470729 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae279b5-b1a8-4c00-984c-b34e605fd09e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:00.485283 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae279b5-b1a8-4c00-984c-b34e605fd09e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:00.486812 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f9fd01-d468-4e63-a327-186e3eb9b0f5 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:00.487532 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae279b5-b1a8-4c00-984c-b34e605fd09e None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:00.511219 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-0ae279b5-b1a8-4c00-984c-b34e605fd09e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:24:00.511219 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:24:00.511219 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:24:00.511219 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:24:00.511219 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:24:00.511219 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:24:00.511219 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:24:00.511219 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:24:00.511219 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:24:00.511219 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:24:00.511219 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:24:00.511219 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:24:00.511219 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:24:00.511219 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:24:00.511219 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:24:00.512755 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:24:00.512755 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:24:00.512755 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:24:00.512755 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:24:00.512755 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:24:00.512755 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:24:00.512755 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:24:00.512755 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:24:00.512755 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:24:00.512755 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:24:00.512755 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:24:00.512755 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:24:00.512755 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:24:00.512755 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:24:00.512755 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:24:00.512755 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:24:00.512755 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:24:00.513679 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:24:00.513679 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:24:00.513679 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:24:00.513679 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:24:00.514619 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 478/966] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:24:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:24:00.521520 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae279b5-b1a8-4c00-984c-b34e605fd09e None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:00.531077 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ac1d84-1dc0-477b-969b-5105b813515d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:00.532542 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac1d84-1dc0-477b-969b-5105b813515d None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:00.533019 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac1d84-1dc0-477b-969b-5105b813515d None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:00.533532 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac1d84-1dc0-477b-969b-5105b813515d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:00.534374 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ac1d84-1dc0-477b-969b-5105b813515d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:00.535958 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ac1d84-1dc0-477b-969b-5105b813515d None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:00.549592 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-59ac1d84-1dc0-477b-969b-5105b813515d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 10:24:00.549592 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:24:00.549592 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 10:24:00.549592 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 10:24:00.549592 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 10:24:00.549592 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 10:24:00.549592 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 10:24:00.549592 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:24:00.549592 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 10:24:00.549592 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:24:00.549592 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 10:24:00.549592 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:24:00.549592 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:24:00.549592 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:24:00.549592 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:24:00.549592 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:24:00.549592 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:24:00.550904 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:24:00.550904 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:24:00.550904 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:24:00.550904 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:24:00.550904 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:24:00.550904 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:24:00.550904 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 10:24:00.550904 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 10:24:00.550904 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 10:24:00.550904 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 10:24:00.550904 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:24:00.550904 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:24:00.550904 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:24:00.550904 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:24:00.550904 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:24:00.550904 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:24:00.551933 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:24:00.551933 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:24:00.551933 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:24:00.551933 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:24:00.551933 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:24:00.551933 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:24:00.551933 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:24:00.551933 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:24:00.551933 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:24:00.551933 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:24:00.551933 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 10:24:00.551933 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:24:00.551933 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 10:24:00.551933 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:24:00.559391 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 489/967] 10.222.0.39 () {56 vars in 1126 bytes} [Mon Jul 18 10:24:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:24:00.561126 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ac1d84-1dc0-477b-969b-5105b813515d None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:00.566048 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:00.619062 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:00.656295 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae279b5-b1a8-4c00-984c-b34e605fd09e None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:00.677832 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ac1d84-1dc0-477b-969b-5105b813515d None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:00.694363 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3cde0-4949-424f-aea7-975f93c83eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:00.695143 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3cde0-4949-424f-aea7-975f93c83eb1 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:00.695433 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3cde0-4949-424f-aea7-975f93c83eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:00.695711 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3cde0-4949-424f-aea7-975f93c83eb1 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:00.696617 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc3cde0-4949-424f-aea7-975f93c83eb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:24:00.696842 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc3cde0-4949-424f-aea7-975f93c83eb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:00.698228 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc3cde0-4949-424f-aea7-975f93c83eb1 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:00.715603 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 479/968] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:24:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:24:00.717264 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3cde0-4949-424f-aea7-975f93c83eb1 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:00.720215 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa83ee-0c15-4d31-9669-a4b0570270df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:00.721216 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa83ee-0c15-4d31-9669-a4b0570270df None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:00.722530 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa83ee-0c15-4d31-9669-a4b0570270df None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:00.722971 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaa83ee-0c15-4d31-9669-a4b0570270df None admin] PATH_INFO: `/v3/services` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:00.723837 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa83ee-0c15-4d31-9669-a4b0570270df None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:24:00.724293 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa83ee-0c15-4d31-9669-a4b0570270df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:00.725827 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaa83ee-0c15-4d31-9669-a4b0570270df None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:00.737626 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 490/969] 10.222.0.39 () {56 vars in 1122 bytes} [Mon Jul 18 10:24:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:24:00.738753 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa83ee-0c15-4d31-9669-a4b0570270df None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:00.827434 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:00.836511 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3cde0-4949-424f-aea7-975f93c83eb1 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:00.878302 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659fdea8-1653-447f-ae49-2d38158ef0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:00.879194 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaa83ee-0c15-4d31-9669-a4b0570270df None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:00.879723 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659fdea8-1653-447f-ae49-2d38158ef0cd None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:00.880214 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659fdea8-1653-447f-ae49-2d38158ef0cd None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:00.880933 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659fdea8-1653-447f-ae49-2d38158ef0cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:00.891026 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659fdea8-1653-447f-ae49-2d38158ef0cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:00.893180 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659fdea8-1653-447f-ae49-2d38158ef0cd None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:00.896708 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:00.911982 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-659fdea8-1653-447f-ae49-2d38158ef0cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:24:00.911982 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:24:00.911982 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:24:00.911982 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:24:00.911982 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:24:00.911982 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:24:00.911982 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:24:00.911982 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:24:00.911982 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:24:00.911982 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:24:00.911982 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:24:00.911982 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:24:00.911982 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:24:00.911982 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:24:00.911982 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:24:00.913168 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:24:00.913168 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:24:00.913168 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:24:00.913168 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:24:00.913168 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:24:00.913168 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:24:00.913168 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:24:00.913168 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:24:00.913168 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:24:00.913168 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:24:00.913168 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:24:00.913168 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:24:00.913168 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:24:00.913168 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:24:00.913168 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:24:00.913168 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:24:00.913168 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:24:00.914176 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:24:00.914176 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:24:00.914176 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:24:00.914176 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:24:00.914176 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:24:00.914176 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:24:00.914176 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:24:00.914176 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:24:00.916358 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 480/970] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 10:24:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:24:00.921028 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e0eca-5b25-4e98-8a91-2d585dec3e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:00.922578 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e0eca-5b25-4e98-8a91-2d585dec3e84 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:00.923170 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e0eca-5b25-4e98-8a91-2d585dec3e84 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:00.923289 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659fdea8-1653-447f-ae49-2d38158ef0cd None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:00.923862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e0eca-5b25-4e98-8a91-2d585dec3e84 None admin] PATH_INFO: `/v3/services` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:00.924816 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8e0eca-5b25-4e98-8a91-2d585dec3e84 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:24:00.925474 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8e0eca-5b25-4e98-8a91-2d585dec3e84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:00.928403 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8e0eca-5b25-4e98-8a91-2d585dec3e84 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:00.940160 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 491/971] 10.222.0.39 () {56 vars in 1122 bytes} [Mon Jul 18 10:24:00 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:24:00.941279 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e0eca-5b25-4e98-8a91-2d585dec3e84 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:01.051415 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659fdea8-1653-447f-ae49-2d38158ef0cd None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:01.078393 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e0eca-5b25-4e98-8a91-2d585dec3e84 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:01.100440 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2de0337-60f1-4a01-818c-891f5898d54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:01.101174 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de0337-60f1-4a01-818c-891f5898d54d None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:01.101461 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de0337-60f1-4a01-818c-891f5898d54d None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:01.101739 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de0337-60f1-4a01-818c-891f5898d54d None admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:01.102540 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2de0337-60f1-4a01-818c-891f5898d54d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:24:01.102855 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2de0337-60f1-4a01-818c-891f5898d54d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:01.105213 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2de0337-60f1-4a01-818c-891f5898d54d None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:01.122848 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06919560-0c42-4d2c-a070-87619ba8935e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:01.123875 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06919560-0c42-4d2c-a070-87619ba8935e None admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:01.124391 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06919560-0c42-4d2c-a070-87619ba8935e None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:01.124896 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06919560-0c42-4d2c-a070-87619ba8935e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:01.125865 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06919560-0c42-4d2c-a070-87619ba8935e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:01.127417 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06919560-0c42-4d2c-a070-87619ba8935e None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:01.127525 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 481/972] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 10:24:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:24:01.128861 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2de0337-60f1-4a01-818c-891f5898d54d None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:01.147149 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:01.213826 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 492/973] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Jul 18 10:24:00 2022] POST /identity/v3/endpoints => generated 349 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:24:01.243297 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2de0337-60f1-4a01-818c-891f5898d54d None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:01.289248 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08cf9f-276a-461f-8fdb-810d3f27e0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:01.289971 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08cf9f-276a-461f-8fdb-810d3f27e0fc None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:01.290256 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08cf9f-276a-461f-8fdb-810d3f27e0fc None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:01.290530 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08cf9f-276a-461f-8fdb-810d3f27e0fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:01.291423 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b08cf9f-276a-461f-8fdb-810d3f27e0fc None admin] RBAC: Adding query filter params (role.id=e5d4d6eee014413ea5c24c2b65d09652, scope.project.id=a6098fe56d304980aa14bd95b4b92c17, user.id=88ad60446c5447a8bbd0096fa2133efb) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:24:01.291786 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b08cf9f-276a-461f-8fdb-810d3f27e0fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:01.293938 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b08cf9f-276a-461f-8fdb-810d3f27e0fc None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:01.305428 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 482/974] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 10:24:01 2022] GET /identity/v3/role_assignments?user.id=88ad60446c5447a8bbd0096fa2133efb&scope.project.id=a6098fe56d304980aa14bd95b4b92c17&role.id=e5d4d6eee014413ea5c24c2b65d09652 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:24:01.336339 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bee8d7-33a9-4f63-ab9d-39831495c1a1 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:01.336681 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bee8d7-33a9-4f63-ab9d-39831495c1a1 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:01.336902 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bee8d7-33a9-4f63-ab9d-39831495c1a1 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:01.338703 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 493/975] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:24:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:24:01.345305 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974c3ca-b516-4910-ad9c-90493956f7e4 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:01.345639 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974c3ca-b516-4910-ad9c-90493956f7e4 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:01.345875 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974c3ca-b516-4910-ad9c-90493956f7e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:01.365789 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-5974c3ca-b516-4910-ad9c-90493956f7e4 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:24:01.367072 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-5974c3ca-b516-4910-ad9c-90493956f7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:24:01.448280 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 483/976] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:24:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:24:01.473660 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bee8d7-33a9-4f63-ab9d-39831495c1a1 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:01.522610 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:01.588384 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bee8d7-33a9-4f63-ab9d-39831495c1a1 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:01.627444 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a639599b-efcb-4272-912e-bf2c76ee334f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:01.628498 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639599b-efcb-4272-912e-bf2c76ee334f None admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:01.629006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639599b-efcb-4272-912e-bf2c76ee334f None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:01.629516 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639599b-efcb-4272-912e-bf2c76ee334f None admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:01.630418 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a639599b-efcb-4272-912e-bf2c76ee334f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:01.632059 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a639599b-efcb-4272-912e-bf2c76ee334f None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:01.633625 dv-cinder-837546-3-smb devstack@keystone.service[80392]: WARNING keystone.server.flask.common [None req-a639599b-efcb-4272-912e-bf2c76ee334f None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 18 10:24:01.685066 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.sql.core [None req-a639599b-efcb-4272-912e-bf2c76ee334f None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 18 10:24:01.685066 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 18 10:24:01.685066 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [parameters: {'user_id': '854615e3e5df44b1ac4678b9e49f8c86', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 18 10:24:01.685066 dv-cinder-837546-3-smb devstack@keystone.service[80392]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80392) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 18 10:24:01.703982 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-a639599b-efcb-4272-912e-bf2c76ee334f None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 18 10:24:01.703982 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:24:01.703982 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 10:24:01.703982 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 18 10:24:01.703982 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 10:24:01.703982 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 18 10:24:01.703982 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 10:24:01.703982 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application result = self._query(query) Jul 18 10:24:01.703982 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 10:24:01.703982 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application conn.query(q) Jul 18 10:24:01.703982 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 10:24:01.703982 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 10:24:01.703982 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 10:24:01.703982 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application result.read() Jul 18 10:24:01.703982 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 10:24:01.704949 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 18 10:24:01.704949 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 10:24:01.704949 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 18 10:24:01.704949 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 10:24:01.704949 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 18 10:24:01.704949 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 10:24:01.704949 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 18 10:24:01.704949 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 18 10:24:01.704949 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:24:01.704949 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 18 10:24:01.704949 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:24:01.704949 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:24:01.704949 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 18 10:24:01.704949 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 18 10:24:01.704949 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 18 10:24:01.704949 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 18 10:24:01.704949 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 18 10:24:01.704949 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application next(self.gen) Jul 18 10:24:01.705913 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 18 10:24:01.705913 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application yield resource Jul 18 10:24:01.705913 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 18 10:24:01.705913 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application next(self.gen) Jul 18 10:24:01.705913 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 18 10:24:01.705913 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application self.session.rollback() Jul 18 10:24:01.705913 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 10:24:01.705913 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application self.force_reraise() Jul 18 10:24:01.705913 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 10:24:01.705913 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise self.value Jul 18 10:24:01.705913 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 18 10:24:01.705913 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 18 10:24:01.705913 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 18 10:24:01.705913 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application session.commit() Jul 18 10:24:01.705913 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 18 10:24:01.705913 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 18 10:24:01.705913 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 18 10:24:01.706806 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application self._prepare_impl() Jul 18 10:24:01.706806 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 18 10:24:01.706806 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application self.session.flush() Jul 18 10:24:01.706806 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 18 10:24:01.706806 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application self._flush(objects) Jul 18 10:24:01.706806 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 18 10:24:01.706806 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 18 10:24:01.706806 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 18 10:24:01.706806 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application compat.raise_( Jul 18 10:24:01.706806 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 10:24:01.706806 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception Jul 18 10:24:01.706806 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 18 10:24:01.706806 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application flush_context.execute() Jul 18 10:24:01.706806 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 18 10:24:01.706806 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rec.execute(self) Jul 18 10:24:01.706806 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 18 10:24:01.706806 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 18 10:24:01.708449 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 18 10:24:01.708449 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 18 10:24:01.708449 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 18 10:24:01.708449 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 18 10:24:01.708449 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 18 10:24:01.708449 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 18 10:24:01.708449 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 18 10:24:01.708449 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 18 10:24:01.708449 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 18 10:24:01.708449 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 18 10:24:01.708449 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 18 10:24:01.708449 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 18 10:24:01.708449 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 18 10:24:01.708449 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 18 10:24:01.708449 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 10:24:01.708449 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception Jul 18 10:24:01.710006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 10:24:01.710006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 18 10:24:01.710006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 10:24:01.710006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 18 10:24:01.710006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 10:24:01.710006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application result = self._query(query) Jul 18 10:24:01.710006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 10:24:01.710006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application conn.query(q) Jul 18 10:24:01.710006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 10:24:01.710006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 10:24:01.710006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 10:24:01.710006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application result.read() Jul 18 10:24:01.710006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 10:24:01.710006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 18 10:24:01.710006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 10:24:01.710006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 18 10:24:01.712094 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 10:24:01.712094 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 18 10:24:01.712094 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 10:24:01.712094 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 18 10:24:01.712094 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 18 10:24:01.712094 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 18 10:24:01.712094 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [parameters: {'user_id': '854615e3e5df44b1ac4678b9e49f8c86', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 18 10:24:01.712094 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 18 10:24:01.712094 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:24:01.712094 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 10:24:01.712094 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:24:01.712094 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:24:01.712094 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:24:01.712094 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:24:01.712094 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:24:01.714046 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:24:01.714046 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:24:01.714046 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:24:01.714046 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:24:01.714046 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:24:01.714046 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:24:01.714046 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:24:01.714046 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 18 10:24:01.714046 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 18 10:24:01.714046 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:24:01.714046 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:24:01.714046 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:24:01.714046 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:24:01.714046 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:24:01.714046 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:24:01.714046 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 18 10:24:01.714046 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 18 10:24:01.716426 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 18 10:24:01.716426 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 18 10:24:01.716426 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 18 10:24:01.716426 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 18 10:24:01.716426 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 18 10:24:01.716426 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:24:01.719146 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 494/977] 10.222.0.39 () {60 vars in 1131 bytes} [Mon Jul 18 10:24:01 2022] POST /identity/v3/users => generated 160 bytes in 246 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:24:01.724836 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5974c3ca-b516-4910-ad9c-90493956f7e4 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:01.727260 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:01.836980 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5974c3ca-b516-4910-ad9c-90493956f7e4 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:01.875715 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb62ac-337b-42fa-b00d-b6c7815e516c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:01.876849 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb62ac-337b-42fa-b00d-b6c7815e516c None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:01.877356 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb62ac-337b-42fa-b00d-b6c7815e516c None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:01.877836 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb62ac-337b-42fa-b00d-b6c7815e516c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:01.885825 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fb62ac-337b-42fa-b00d-b6c7815e516c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:01.888278 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fb62ac-337b-42fa-b00d-b6c7815e516c None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:01.905147 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-38fb62ac-337b-42fa-b00d-b6c7815e516c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 10:24:01.905147 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:24:01.905147 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:24:01.905147 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:24:01.905147 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:24:01.905147 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:24:01.905147 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:24:01.905147 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:24:01.905147 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:24:01.905147 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:24:01.905147 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:24:01.905147 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:24:01.905147 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:24:01.905147 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:24:01.905147 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:24:01.905147 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:24:01.906160 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:24:01.906160 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:24:01.906160 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:24:01.906160 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:24:01.906160 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:24:01.906160 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:24:01.906160 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:24:01.906160 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:24:01.906160 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:24:01.906160 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:24:01.906160 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:24:01.906160 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:24:01.906160 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:24:01.906160 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:24:01.906160 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:24:01.906160 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:24:01.906160 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:24:01.906160 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:24:01.907077 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:24:01.907077 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:24:01.907077 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:24:01.907077 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:24:01.907077 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:24:01.907077 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:24:01.907077 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:24:01.907077 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:24:01.907077 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 10:24:01.907077 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:24:01.910836 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 484/978] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 10:24:01 2022] GET /identity/v3/users/cinder => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:24:01.916713 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a639599b-efcb-4272-912e-bf2c76ee334f None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:02.028580 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:02.033609 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a639599b-efcb-4272-912e-bf2c76ee334f None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:02.035992 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3034ec-7299-4ba2-9b36-23f426a5bfe8 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:02.036283 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3034ec-7299-4ba2-9b36-23f426a5bfe8 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:02.036583 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3034ec-7299-4ba2-9b36-23f426a5bfe8 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:02.038472 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 485/979] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:24:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:24:02.044204 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fdad27-b8f8-4de3-9b6e-a9e4a1c4f8be None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:02.044463 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fdad27-b8f8-4de3-9b6e-a9e4a1c4f8be None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:02.044692 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fdad27-b8f8-4de3-9b6e-a9e4a1c4f8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:02.062297 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-e3fdad27-b8f8-4de3-9b6e-a9e4a1c4f8be None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:24:02.063516 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-e3fdad27-b8f8-4de3-9b6e-a9e4a1c4f8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:24:02.080703 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f98bab-ee34-4ee2-9f53-1b4b68bb2945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:02.081879 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f98bab-ee34-4ee2-9f53-1b4b68bb2945 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:02.082678 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f98bab-ee34-4ee2-9f53-1b4b68bb2945 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:02.083239 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f98bab-ee34-4ee2-9f53-1b4b68bb2945 None admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:02.084216 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f98bab-ee34-4ee2-9f53-1b4b68bb2945 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:24:02.084675 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f98bab-ee34-4ee2-9f53-1b4b68bb2945 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:02.086501 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f98bab-ee34-4ee2-9f53-1b4b68bb2945 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:02.137988 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:02.140031 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 495/980] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Jul 18 10:24:01 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:24:02.150165 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 486/981] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:24:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 10:24:02.173803 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f98bab-ee34-4ee2-9f53-1b4b68bb2945 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:02.295520 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f98bab-ee34-4ee2-9f53-1b4b68bb2945 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:02.334979 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f0ff8b-73a9-42f8-83d8-0f377726c9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:02.336035 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0ff8b-73a9-42f8-83d8-0f377726c9e7 None admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:02.336551 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0ff8b-73a9-42f8-83d8-0f377726c9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:02.337056 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f0ff8b-73a9-42f8-83d8-0f377726c9e7 None admin] PATH_INFO: `/v3/services` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:02.338003 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f0ff8b-73a9-42f8-83d8-0f377726c9e7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:02.339583 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f0ff8b-73a9-42f8-83d8-0f377726c9e7 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:02.436117 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 496/982] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Jul 18 10:24:02 2022] POST /identity/v3/services => generated 242 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:24:03.325821 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5b94f-e10a-4913-b28f-cac5d8470237 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:03.326339 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5b94f-e10a-4913-b28f-cac5d8470237 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:03.326415 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5b94f-e10a-4913-b28f-cac5d8470237 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:03.327786 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 487/983] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:24:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:24:03.333215 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4791a5-a756-44f6-8439-29d6eb2fbede None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:03.333620 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4791a5-a756-44f6-8439-29d6eb2fbede None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:03.333783 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4791a5-a756-44f6-8439-29d6eb2fbede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:03.350871 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-5c4791a5-a756-44f6-8439-29d6eb2fbede None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:24:03.352395 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-5c4791a5-a756-44f6-8439-29d6eb2fbede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:24:03.364154 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:03.426681 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 497/984] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:24:03 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:24:03.450400 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b5b94f-e10a-4913-b28f-cac5d8470237 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:03.464142 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141e3c4-12c6-4341-b1cf-fef1456c9469 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:03.464442 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141e3c4-12c6-4341-b1cf-fef1456c9469 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:03.465449 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141e3c4-12c6-4341-b1cf-fef1456c9469 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:03.469471 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 498/985] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:24:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:24:03.471848 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a6402-585a-4a7d-adb9-a82e75fd1eda None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:03.472140 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a6402-585a-4a7d-adb9-a82e75fd1eda None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:03.472421 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a6402-585a-4a7d-adb9-a82e75fd1eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:03.489520 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-d86a6402-585a-4a7d-adb9-a82e75fd1eda None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:24:03.490719 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-d86a6402-585a-4a7d-adb9-a82e75fd1eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:24:03.560920 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b5b94f-e10a-4913-b28f-cac5d8470237 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:03.576264 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 499/986] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:24:03 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 10:24:03.598302 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f9b25-1b27-41b4-82da-0fff5db173ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:03.599098 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a6402-585a-4a7d-adb9-a82e75fd1eda None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:03.599210 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f9b25-1b27-41b4-82da-0fff5db173ea None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:03.599404 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f9b25-1b27-41b4-82da-0fff5db173ea None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:03.599648 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f9b25-1b27-41b4-82da-0fff5db173ea None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:03.600303 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f9b25-1b27-41b4-82da-0fff5db173ea None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:03.601689 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f9b25-1b27-41b4-82da-0fff5db173ea None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:03.614685 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-3f4f9b25-1b27-41b4-82da-0fff5db173ea None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 10:24:03.614685 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:24:03.614685 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 10:24:03.614685 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 10:24:03.614685 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 10:24:03.614685 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 10:24:03.614685 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 10:24:03.614685 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:24:03.614685 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 10:24:03.614685 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:24:03.614685 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 10:24:03.614685 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:24:03.614685 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:24:03.614685 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:24:03.614685 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:24:03.614685 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:24:03.614685 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:24:03.615684 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:24:03.615684 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:24:03.615684 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:24:03.615684 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:24:03.615684 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:24:03.615684 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:24:03.615684 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 10:24:03.615684 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 10:24:03.615684 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 10:24:03.615684 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 10:24:03.615684 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:24:03.615684 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:24:03.615684 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:24:03.615684 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:24:03.615684 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:24:03.615684 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:24:03.616939 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:24:03.616939 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:24:03.616939 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:24:03.616939 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:24:03.616939 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:24:03.616939 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:24:03.616939 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:24:03.616939 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:24:03.616939 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:24:03.616939 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:24:03.616939 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 10:24:03.616939 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:24:03.616939 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 10:24:03.616939 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:24:03.616939 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 488/987] 10.222.0.39 () {56 vars in 1126 bytes} [Mon Jul 18 10:24:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:24:03.621946 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f9b25-1b27-41b4-82da-0fff5db173ea None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:03.679779 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:03.680347 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:03.709171 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a6402-585a-4a7d-adb9-a82e75fd1eda None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:03.726783 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f9b25-1b27-41b4-82da-0fff5db173ea None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:03.745642 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c92339-fb35-41f1-af5f-b0ac5d1de2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:03.746509 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c92339-fb35-41f1-af5f-b0ac5d1de2e4 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:03.746790 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c92339-fb35-41f1-af5f-b0ac5d1de2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:03.747062 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c92339-fb35-41f1-af5f-b0ac5d1de2e4 None admin] PATH_INFO: `/v3/services/image` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:03.747706 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c92339-fb35-41f1-af5f-b0ac5d1de2e4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:03.749072 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c92339-fb35-41f1-af5f-b0ac5d1de2e4 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:03.760631 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-93c92339-fb35-41f1-af5f-b0ac5d1de2e4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 10:24:03.760631 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:24:03.760631 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 10:24:03.760631 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 10:24:03.760631 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 10:24:03.760631 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 10:24:03.760631 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 10:24:03.760631 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:24:03.760631 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 10:24:03.760631 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:24:03.760631 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 10:24:03.760631 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:24:03.760631 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:24:03.760631 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:24:03.760631 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:24:03.760631 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:24:03.760631 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:24:03.762429 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:24:03.762429 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:24:03.762429 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:24:03.762429 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:24:03.762429 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:24:03.762429 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:24:03.762429 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 10:24:03.762429 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 10:24:03.762429 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 10:24:03.762429 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 10:24:03.762429 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:24:03.762429 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:24:03.762429 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:24:03.762429 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:24:03.762429 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:24:03.762429 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:24:03.763400 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:24:03.763400 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:24:03.763400 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:24:03.763400 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:24:03.763400 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:24:03.763400 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:24:03.763400 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:24:03.763400 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:24:03.763400 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:24:03.763400 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:24:03.763400 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 10:24:03.763400 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:24:03.763400 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 10:24:03.763400 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:24:03.763400 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 500/988] 10.222.0.39 () {56 vars in 1105 bytes} [Mon Jul 18 10:24:03 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:24:03.765561 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c430d3-16b0-4abe-8201-39ec53ce756b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:03.766236 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c430d3-16b0-4abe-8201-39ec53ce756b None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:03.766523 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c430d3-16b0-4abe-8201-39ec53ce756b None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:03.766802 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c430d3-16b0-4abe-8201-39ec53ce756b None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:03.767677 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c430d3-16b0-4abe-8201-39ec53ce756b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:24:03.767990 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c430d3-16b0-4abe-8201-39ec53ce756b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:03.768219 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c92339-fb35-41f1-af5f-b0ac5d1de2e4 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:03.769387 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c430d3-16b0-4abe-8201-39ec53ce756b None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:03.777115 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 489/989] 10.222.0.39 () {56 vars in 1122 bytes} [Mon Jul 18 10:24:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:24:03.781700 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c430d3-16b0-4abe-8201-39ec53ce756b None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:03.874378 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c92339-fb35-41f1-af5f-b0ac5d1de2e4 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:03.885562 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c430d3-16b0-4abe-8201-39ec53ce756b None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:03.906974 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:03.910434 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f4222-df1d-4199-9ae9-1bc030b1b2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:03.911103 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f4222-df1d-4199-9ae9-1bc030b1b2ce None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:03.911394 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f4222-df1d-4199-9ae9-1bc030b1b2ce None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:03.911675 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f4222-df1d-4199-9ae9-1bc030b1b2ce None admin] PATH_INFO: `/v3/services` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:03.912385 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9f4222-df1d-4199-9ae9-1bc030b1b2ce None admin] RBAC: Adding query filter params (name=image) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:24:03.912700 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9f4222-df1d-4199-9ae9-1bc030b1b2ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:03.914093 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9f4222-df1d-4199-9ae9-1bc030b1b2ce None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:03.916277 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:03.920636 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 501/990] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:24:03 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:24:03.926062 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f4222-df1d-4199-9ae9-1bc030b1b2ce None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:03.926529 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e231e07-c18f-43ea-ad5b-70d71b2552bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:03.927203 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e231e07-c18f-43ea-ad5b-70d71b2552bb None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:03.927480 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e231e07-c18f-43ea-ad5b-70d71b2552bb None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:03.927753 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e231e07-c18f-43ea-ad5b-70d71b2552bb None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:03.928619 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e231e07-c18f-43ea-ad5b-70d71b2552bb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:24:03.929133 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e231e07-c18f-43ea-ad5b-70d71b2552bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:03.930247 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e231e07-c18f-43ea-ad5b-70d71b2552bb None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:03.941789 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 490/991] 10.222.0.39 () {56 vars in 1122 bytes} [Mon Jul 18 10:24:03 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:24:03.943337 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e231e07-c18f-43ea-ad5b-70d71b2552bb None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:04.032836 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f4222-df1d-4199-9ae9-1bc030b1b2ce None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:04.065486 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e231e07-c18f-43ea-ad5b-70d71b2552bb None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:04.069178 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e863c-9f16-450a-9d76-113dbd5b7bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:04.069852 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e863c-9f16-450a-9d76-113dbd5b7bd7 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:04.070133 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e863c-9f16-450a-9d76-113dbd5b7bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:04.070405 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e863c-9f16-450a-9d76-113dbd5b7bd7 None admin] PATH_INFO: `/v3/services` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:04.071111 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85e863c-9f16-450a-9d76-113dbd5b7bd7 None admin] RBAC: Adding query filter params (type=image) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:24:04.071419 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85e863c-9f16-450a-9d76-113dbd5b7bd7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:04.073246 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85e863c-9f16-450a-9d76-113dbd5b7bd7 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:04.079225 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 502/992] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:24:03 2022] GET /identity/v3/services?type=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:24:04.109390 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560708a0-ebac-4fca-9f21-72c40dcbc38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:04.110082 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560708a0-ebac-4fca-9f21-72c40dcbc38f None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:04.110375 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560708a0-ebac-4fca-9f21-72c40dcbc38f None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:04.110661 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560708a0-ebac-4fca-9f21-72c40dcbc38f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:04.111768 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560708a0-ebac-4fca-9f21-72c40dcbc38f None admin] RBAC: Adding query filter params (interface=admin, service_id=3bbca0529fcb4ec5bbd6b2367c28e91c, region_id=RegionOne) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:24:04.112078 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560708a0-ebac-4fca-9f21-72c40dcbc38f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:04.113523 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560708a0-ebac-4fca-9f21-72c40dcbc38f None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:04.125193 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 491/993] 10.222.0.39 () {56 vars in 1249 bytes} [Mon Jul 18 10:24:03 2022] GET /identity/v3/endpoints?service_id=3bbca0529fcb4ec5bbd6b2367c28e91c&interface=admin®ion_id=RegionOne => generated 193 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:24:04.126456 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e863c-9f16-450a-9d76-113dbd5b7bd7 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:04.197922 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:04.240191 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e863c-9f16-450a-9d76-113dbd5b7bd7 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:04.276569 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f98c2-e93d-4464-aa26-291eb8ddeb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:04.278470 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f98c2-e93d-4464-aa26-291eb8ddeb47 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:04.278771 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f98c2-e93d-4464-aa26-291eb8ddeb47 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:04.279087 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f98c2-e93d-4464-aa26-291eb8ddeb47 None admin] PATH_INFO: `/v3/services` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:04.279777 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336f98c2-e93d-4464-aa26-291eb8ddeb47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:04.281179 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336f98c2-e93d-4464-aa26-291eb8ddeb47 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:04.287923 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 503/994] 10.222.0.39 () {56 vars in 1087 bytes} [Mon Jul 18 10:24:04 2022] GET /identity/v3/services => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:24:04.539855 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113005d4-6a30-4d6c-9b32-a5b298007f97 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:04.540403 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113005d4-6a30-4d6c-9b32-a5b298007f97 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:04.540403 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113005d4-6a30-4d6c-9b32-a5b298007f97 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:04.541966 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 492/995] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:24:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:24:04.547207 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478404f6-d45c-4e5b-bf7d-5cddcef8e61e None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:04.547601 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478404f6-d45c-4e5b-bf7d-5cddcef8e61e None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:04.547786 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478404f6-d45c-4e5b-bf7d-5cddcef8e61e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:04.564527 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-478404f6-d45c-4e5b-bf7d-5cddcef8e61e None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:24:04.565733 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-478404f6-d45c-4e5b-bf7d-5cddcef8e61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:24:04.635407 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 504/996] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:24:04 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:24:04.658249 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113005d4-6a30-4d6c-9b32-a5b298007f97 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:04.709389 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:04.765232 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113005d4-6a30-4d6c-9b32-a5b298007f97 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:04.798817 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2274596f-9f26-45f6-b9ff-a232d7c2e37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:04.799532 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2274596f-9f26-45f6-b9ff-a232d7c2e37c None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:04.799810 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2274596f-9f26-45f6-b9ff-a232d7c2e37c None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:04.800078 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2274596f-9f26-45f6-b9ff-a232d7c2e37c None admin] PATH_INFO: `/v3/services/compute` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:04.800721 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2274596f-9f26-45f6-b9ff-a232d7c2e37c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:04.802182 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2274596f-9f26-45f6-b9ff-a232d7c2e37c None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:04.814861 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-2274596f-9f26-45f6-b9ff-a232d7c2e37c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 10:24:04.814861 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:24:04.814861 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 10:24:04.814861 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 10:24:04.814861 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 10:24:04.814861 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 10:24:04.814861 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 10:24:04.814861 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:24:04.814861 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 10:24:04.814861 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:24:04.814861 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 10:24:04.814861 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:24:04.814861 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:24:04.814861 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:24:04.814861 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:24:04.814861 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:24:04.814861 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:24:04.815849 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:24:04.815849 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:24:04.815849 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:24:04.815849 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:24:04.815849 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:24:04.815849 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:24:04.815849 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 10:24:04.815849 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 10:24:04.815849 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 10:24:04.815849 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 10:24:04.815849 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:24:04.815849 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:24:04.815849 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:24:04.815849 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:24:04.815849 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:24:04.815849 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:24:04.816662 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:24:04.816662 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:24:04.816662 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:24:04.816662 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:24:04.816662 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:24:04.816662 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:24:04.816662 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:24:04.816662 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:24:04.816662 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:24:04.816662 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:24:04.816662 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 10:24:04.816662 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:24:04.816662 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 10:24:04.816662 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:24:04.816662 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 493/997] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 10:24:04 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:24:04.823538 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478404f6-d45c-4e5b-bf7d-5cddcef8e61e None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:04.882543 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:04.925881 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478404f6-d45c-4e5b-bf7d-5cddcef8e61e None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:04.960278 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091965f3-9eee-490f-bb46-53acba635dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:04.961036 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091965f3-9eee-490f-bb46-53acba635dd2 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:04.961338 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091965f3-9eee-490f-bb46-53acba635dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:04.961608 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091965f3-9eee-490f-bb46-53acba635dd2 None admin] PATH_INFO: `/v3/services` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:04.962301 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091965f3-9eee-490f-bb46-53acba635dd2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:24:04.962657 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091965f3-9eee-490f-bb46-53acba635dd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:04.964066 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091965f3-9eee-490f-bb46-53acba635dd2 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:04.969193 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 505/998] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Jul 18 10:24:04 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:24:04.974621 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2274596f-9f26-45f6-b9ff-a232d7c2e37c None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:05.075944 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2274596f-9f26-45f6-b9ff-a232d7c2e37c None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:05.091639 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:05.115641 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d7322a-0cc5-492d-b466-a52b9410e863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:05.116318 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d7322a-0cc5-492d-b466-a52b9410e863 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:05.116601 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d7322a-0cc5-492d-b466-a52b9410e863 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:05.116876 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d7322a-0cc5-492d-b466-a52b9410e863 None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:05.117662 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d7322a-0cc5-492d-b466-a52b9410e863 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:24:05.117976 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d7322a-0cc5-492d-b466-a52b9410e863 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:05.119344 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d7322a-0cc5-492d-b466-a52b9410e863 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:05.130170 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 494/999] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Jul 18 10:24:04 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:24:05.131159 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091965f3-9eee-490f-bb46-53acba635dd2 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:05.238187 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091965f3-9eee-490f-bb46-53acba635dd2 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:05.261405 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:05.272995 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d1672-3a4c-4983-9e4e-c39083056b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:05.274013 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d1672-3a4c-4983-9e4e-c39083056b37 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:05.274111 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d1672-3a4c-4983-9e4e-c39083056b37 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:05.274381 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d1672-3a4c-4983-9e4e-c39083056b37 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:05.275176 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4d1672-3a4c-4983-9e4e-c39083056b37 None admin] RBAC: Adding query filter params (interface=public, service_id=56c3f1b483ee4565a0afda2b5ea5402f, region_id=RegionOne) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:24:05.275491 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4d1672-3a4c-4983-9e4e-c39083056b37 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:05.276857 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4d1672-3a4c-4983-9e4e-c39083056b37 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:05.282262 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 506/1000] 10.222.0.39 () {56 vars in 1251 bytes} [Mon Jul 18 10:24:05 2022] GET /identity/v3/endpoints?service_id=56c3f1b483ee4565a0afda2b5ea5402f&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:24:05.287467 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d7322a-0cc5-492d-b466-a52b9410e863 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:05.389358 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d7322a-0cc5-492d-b466-a52b9410e863 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:05.424718 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77527a46-0f52-4b77-a900-b18195c14bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:05.425406 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77527a46-0f52-4b77-a900-b18195c14bc4 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:05.425683 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77527a46-0f52-4b77-a900-b18195c14bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:05.425951 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77527a46-0f52-4b77-a900-b18195c14bc4 None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:05.426628 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77527a46-0f52-4b77-a900-b18195c14bc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:05.427979 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77527a46-0f52-4b77-a900-b18195c14bc4 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:05.434431 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 495/1001] 10.222.0.39 () {56 vars in 1087 bytes} [Mon Jul 18 10:24:05 2022] GET /identity/v3/services => generated 1727 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:24:06.142282 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467c383-f729-42ae-b24e-53208017b6be None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:06.142778 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467c383-f729-42ae-b24e-53208017b6be None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:06.142878 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467c383-f729-42ae-b24e-53208017b6be None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:06.144388 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 507/1002] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:24:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:24:06.149341 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d475e23-ce5b-4a5b-a7c8-ada294502295 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:06.149730 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d475e23-ce5b-4a5b-a7c8-ada294502295 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:06.149903 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d475e23-ce5b-4a5b-a7c8-ada294502295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:06.168397 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-9d475e23-ce5b-4a5b-a7c8-ada294502295 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:24:06.169821 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-9d475e23-ce5b-4a5b-a7c8-ada294502295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:24:06.207613 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:06.240889 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 496/1003] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:24:06 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:24:06.262986 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8467c383-f729-42ae-b24e-53208017b6be None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:06.314576 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771aafd9-3dd6-4af2-91e4-881c81cfae0a None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:06.314865 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771aafd9-3dd6-4af2-91e4-881c81cfae0a None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:06.315144 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771aafd9-3dd6-4af2-91e4-881c81cfae0a None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:06.316630 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 497/1004] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:24:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:24:06.321376 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30c024-0140-4d71-a4e2-0f98c9bb9cd7 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:06.321664 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30c024-0140-4d71-a4e2-0f98c9bb9cd7 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:06.321937 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30c024-0140-4d71-a4e2-0f98c9bb9cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:06.338476 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-fa30c024-0140-4d71-a4e2-0f98c9bb9cd7 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:24:06.340181 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-fa30c024-0140-4d71-a4e2-0f98c9bb9cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:24:06.377913 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8467c383-f729-42ae-b24e-53208017b6be None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:06.411635 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 498/1005] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:24:06 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 10:24:06.420893 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b753047-8fe4-49a5-939f-136f9014019a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:06.421768 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b753047-8fe4-49a5-939f-136f9014019a None admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:06.422209 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b753047-8fe4-49a5-939f-136f9014019a None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:06.422664 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b753047-8fe4-49a5-939f-136f9014019a None admin] PATH_INFO: `/v3/services` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:06.423552 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b753047-8fe4-49a5-939f-136f9014019a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:06.425107 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b753047-8fe4-49a5-939f-136f9014019a None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:06.434069 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa30c024-0140-4d71-a4e2-0f98c9bb9cd7 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:06.530956 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:06.534686 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa30c024-0140-4d71-a4e2-0f98c9bb9cd7 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:06.538915 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 508/1006] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Jul 18 10:24:06 2022] POST /identity/v3/services => generated 242 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:24:06.581381 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe2af07-24b9-4459-a554-9926c8e514a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:06.582220 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2af07-24b9-4459-a554-9926c8e514a4 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:06.582508 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2af07-24b9-4459-a554-9926c8e514a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:06.582787 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe2af07-24b9-4459-a554-9926c8e514a4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:06.586504 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe2af07-24b9-4459-a554-9926c8e514a4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:06.586504 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe2af07-24b9-4459-a554-9926c8e514a4 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:06.598619 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-ffe2af07-24b9-4459-a554-9926c8e514a4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 10:24:06.598619 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:24:06.598619 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 10:24:06.598619 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 10:24:06.598619 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 10:24:06.598619 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 10:24:06.598619 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 10:24:06.598619 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:24:06.598619 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 10:24:06.598619 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:24:06.598619 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 10:24:06.598619 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:24:06.598619 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:24:06.598619 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:24:06.598619 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:24:06.598619 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:24:06.598619 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:24:06.599738 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:24:06.599738 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:24:06.599738 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:24:06.599738 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:24:06.599738 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:24:06.599738 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:24:06.599738 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 10:24:06.599738 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 10:24:06.599738 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 10:24:06.599738 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 10:24:06.599738 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:24:06.599738 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:24:06.599738 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:24:06.599738 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:24:06.599738 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:24:06.599738 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:24:06.606414 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:24:06.606414 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:24:06.606414 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:24:06.606414 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:24:06.606414 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:24:06.606414 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:24:06.606414 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:24:06.606414 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:24:06.606414 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:24:06.606414 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:24:06.606414 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 10:24:06.606414 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:24:06.606414 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 10:24:06.606414 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:24:06.606414 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 499/1007] 10.222.0.39 () {56 vars in 1126 bytes} [Mon Jul 18 10:24:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:24:06.609311 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b753047-8fe4-49a5-939f-136f9014019a None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:06.663347 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:06.721300 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b753047-8fe4-49a5-939f-136f9014019a None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:06.758114 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce889cdd-3c8e-40a2-9fd4-d47a7fb7f9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:06.758777 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce889cdd-3c8e-40a2-9fd4-d47a7fb7f9a0 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:06.759057 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce889cdd-3c8e-40a2-9fd4-d47a7fb7f9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:06.759329 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce889cdd-3c8e-40a2-9fd4-d47a7fb7f9a0 None admin] PATH_INFO: `/v3/services` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:06.760029 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce889cdd-3c8e-40a2-9fd4-d47a7fb7f9a0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:24:06.760334 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce889cdd-3c8e-40a2-9fd4-d47a7fb7f9a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:06.762041 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce889cdd-3c8e-40a2-9fd4-d47a7fb7f9a0 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:06.768291 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 509/1008] 10.222.0.39 () {56 vars in 1122 bytes} [Mon Jul 18 10:24:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:24:06.773263 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe2af07-24b9-4459-a554-9926c8e514a4 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:06.880580 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe2af07-24b9-4459-a554-9926c8e514a4 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:06.915301 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd0a556-4760-4dcd-a105-d82f1cfd342e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:06.918313 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0a556-4760-4dcd-a105-d82f1cfd342e None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:06.918313 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0a556-4760-4dcd-a105-d82f1cfd342e None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:06.918313 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0a556-4760-4dcd-a105-d82f1cfd342e None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:06.918313 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd0a556-4760-4dcd-a105-d82f1cfd342e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:24:06.918313 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd0a556-4760-4dcd-a105-d82f1cfd342e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:06.920895 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd0a556-4760-4dcd-a105-d82f1cfd342e None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:06.930245 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 500/1009] 10.222.0.39 () {56 vars in 1122 bytes} [Mon Jul 18 10:24:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:24:06.932157 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce889cdd-3c8e-40a2-9fd4-d47a7fb7f9a0 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:07.045861 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce889cdd-3c8e-40a2-9fd4-d47a7fb7f9a0 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:07.056870 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:07.080208 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014cea1b-fbc5-43af-ab84-9d20c1f3b993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:07.080928 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014cea1b-fbc5-43af-ab84-9d20c1f3b993 None admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:07.081236 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014cea1b-fbc5-43af-ab84-9d20c1f3b993 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:07.081514 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014cea1b-fbc5-43af-ab84-9d20c1f3b993 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:07.082259 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014cea1b-fbc5-43af-ab84-9d20c1f3b993 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:07.083611 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014cea1b-fbc5-43af-ab84-9d20c1f3b993 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:07.157077 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 510/1010] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Jul 18 10:24:06 2022] POST /identity/v3/endpoints => generated 325 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:24:07.466544 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea412b41-dc76-44b0-88a6-005c350bc207 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:07.467077 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea412b41-dc76-44b0-88a6-005c350bc207 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:07.467077 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea412b41-dc76-44b0-88a6-005c350bc207 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:07.468467 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 501/1011] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:24:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:24:07.473645 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517cbfc6-cf7b-49ad-a139-0ddda04bc99c None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:07.473940 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517cbfc6-cf7b-49ad-a139-0ddda04bc99c None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:07.474223 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517cbfc6-cf7b-49ad-a139-0ddda04bc99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:07.496612 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-517cbfc6-cf7b-49ad-a139-0ddda04bc99c None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:24:07.498322 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-517cbfc6-cf7b-49ad-a139-0ddda04bc99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:24:07.573083 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 511/1012] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:24:07 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:24:07.595577 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea412b41-dc76-44b0-88a6-005c350bc207 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:07.624003 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:07.701410 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea412b41-dc76-44b0-88a6-005c350bc207 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:07.738762 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3438b675-5393-462e-ac11-ffc29f7b7169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:07.739563 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438b675-5393-462e-ac11-ffc29f7b7169 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:07.739845 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438b675-5393-462e-ac11-ffc29f7b7169 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:07.740115 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438b675-5393-462e-ac11-ffc29f7b7169 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:07.740762 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3438b675-5393-462e-ac11-ffc29f7b7169 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:07.742142 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3438b675-5393-462e-ac11-ffc29f7b7169 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:07.754782 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-3438b675-5393-462e-ac11-ffc29f7b7169 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 10:24:07.754782 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:24:07.754782 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 10:24:07.754782 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 10:24:07.754782 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 10:24:07.754782 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 10:24:07.754782 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 10:24:07.754782 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:24:07.754782 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 10:24:07.754782 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:24:07.754782 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 10:24:07.754782 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:24:07.754782 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:24:07.754782 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:24:07.754782 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:24:07.754782 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:24:07.754782 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:24:07.755755 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:24:07.755755 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:24:07.755755 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:24:07.755755 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:24:07.755755 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:24:07.755755 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:24:07.755755 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 10:24:07.755755 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 10:24:07.755755 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 10:24:07.755755 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 10:24:07.755755 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:24:07.755755 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:24:07.755755 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:24:07.755755 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:24:07.755755 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:24:07.755755 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:24:07.756613 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:24:07.756613 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:24:07.756613 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:24:07.756613 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:24:07.756613 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:24:07.756613 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:24:07.756613 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:24:07.756613 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:24:07.756613 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:24:07.756613 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:24:07.756613 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 10:24:07.756613 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:24:07.756613 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 10:24:07.756613 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:24:07.764700 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 502/1013] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 10:24:07 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:24:07.764851 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517cbfc6-cf7b-49ad-a139-0ddda04bc99c None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:07.858448 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:07.864821 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517cbfc6-cf7b-49ad-a139-0ddda04bc99c None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:07.899486 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc28c6ff-8d6d-42c2-95d3-83031c186d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:07.900168 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28c6ff-8d6d-42c2-95d3-83031c186d92 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:07.900830 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28c6ff-8d6d-42c2-95d3-83031c186d92 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:07.901347 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc28c6ff-8d6d-42c2-95d3-83031c186d92 None admin] PATH_INFO: `/v3/services` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:07.902483 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc28c6ff-8d6d-42c2-95d3-83031c186d92 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:24:07.903353 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc28c6ff-8d6d-42c2-95d3-83031c186d92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:07.905029 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc28c6ff-8d6d-42c2-95d3-83031c186d92 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:07.914444 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 512/1014] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Jul 18 10:24:07 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:24:07.915671 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3438b675-5393-462e-ac11-ffc29f7b7169 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:08.005669 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:08.018202 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3438b675-5393-462e-ac11-ffc29f7b7169 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:08.052422 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c513a72-0d0a-47ca-affc-7553dd0a71b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:08.053112 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c513a72-0d0a-47ca-affc-7553dd0a71b7 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:08.053395 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c513a72-0d0a-47ca-affc-7553dd0a71b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:08.053668 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c513a72-0d0a-47ca-affc-7553dd0a71b7 None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:08.054418 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c513a72-0d0a-47ca-affc-7553dd0a71b7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:24:08.054727 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c513a72-0d0a-47ca-affc-7553dd0a71b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:08.056077 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c513a72-0d0a-47ca-affc-7553dd0a71b7 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:08.066808 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 503/1015] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Jul 18 10:24:07 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:24:08.068034 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc28c6ff-8d6d-42c2-95d3-83031c186d92 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:08.178997 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc28c6ff-8d6d-42c2-95d3-83031c186d92 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:08.213485 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eac810-fa2d-45e2-8e0b-282890cdb294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:08.214145 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eac810-fa2d-45e2-8e0b-282890cdb294 None admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:08.214459 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eac810-fa2d-45e2-8e0b-282890cdb294 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:08.214735 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eac810-fa2d-45e2-8e0b-282890cdb294 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:08.215468 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eac810-fa2d-45e2-8e0b-282890cdb294 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:08.216816 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eac810-fa2d-45e2-8e0b-282890cdb294 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:08.352664 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 513/1016] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Jul 18 10:24:08 2022] POST /identity/v3/endpoints => generated 334 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:24:08.628221 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6c452-bdd0-427f-90c0-33475effa3e4 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:08.628705 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6c452-bdd0-427f-90c0-33475effa3e4 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:08.628705 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6c452-bdd0-427f-90c0-33475effa3e4 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:08.630112 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 504/1017] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:24:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:24:08.635694 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1dc304-7e20-4aaf-8eac-f87593d64052 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:08.635993 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1dc304-7e20-4aaf-8eac-f87593d64052 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:08.637568 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1dc304-7e20-4aaf-8eac-f87593d64052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:08.653816 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-0d1dc304-7e20-4aaf-8eac-f87593d64052 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:24:08.655034 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-0d1dc304-7e20-4aaf-8eac-f87593d64052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:24:08.667461 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:08.737276 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 514/1018] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:24:08 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:24:08.760273 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e6c452-bdd0-427f-90c0-33475effa3e4 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:08.879852 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e6c452-bdd0-427f-90c0-33475effa3e4 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:08.920037 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e29e1c-7135-45d9-8acf-3e9fd1afa241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:08.921264 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e29e1c-7135-45d9-8acf-3e9fd1afa241 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:08.921752 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e29e1c-7135-45d9-8acf-3e9fd1afa241 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:08.922224 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e29e1c-7135-45d9-8acf-3e9fd1afa241 None admin] PATH_INFO: `/v3/services/image` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:08.923074 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e29e1c-7135-45d9-8acf-3e9fd1afa241 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:08.924661 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e29e1c-7135-45d9-8acf-3e9fd1afa241 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:08.939201 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-49e29e1c-7135-45d9-8acf-3e9fd1afa241 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 10:24:08.939201 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:24:08.939201 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 10:24:08.939201 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 10:24:08.939201 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 10:24:08.939201 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 10:24:08.939201 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 10:24:08.939201 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:24:08.939201 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 10:24:08.939201 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:24:08.939201 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 10:24:08.939201 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:24:08.939201 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:24:08.939201 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:24:08.939201 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:24:08.939201 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:24:08.939201 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:24:08.940239 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:24:08.940239 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:24:08.940239 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:24:08.940239 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:24:08.940239 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:24:08.940239 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:24:08.940239 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 10:24:08.940239 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 10:24:08.940239 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 10:24:08.940239 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 10:24:08.940239 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:24:08.940239 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:24:08.940239 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:24:08.940239 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:24:08.940239 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:24:08.940239 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:24:08.941152 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:24:08.941152 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:24:08.941152 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:24:08.941152 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:24:08.941152 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:24:08.941152 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:24:08.941152 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:24:08.941152 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:24:08.941152 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:24:08.941152 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:24:08.941152 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 10:24:08.941152 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:24:08.941152 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 10:24:08.941152 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:24:08.943618 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 505/1019] 10.222.0.39 () {56 vars in 1105 bytes} [Mon Jul 18 10:24:08 2022] GET /identity/v3/services/image => generated 86 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:24:08.950081 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1dc304-7e20-4aaf-8eac-f87593d64052 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:09.060393 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1dc304-7e20-4aaf-8eac-f87593d64052 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:09.103631 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9407a7-64cb-45c2-9ac3-612e75df835b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:09.104744 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9407a7-64cb-45c2-9ac3-612e75df835b None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:09.104744 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9407a7-64cb-45c2-9ac3-612e75df835b None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:09.105515 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9407a7-64cb-45c2-9ac3-612e75df835b None admin] PATH_INFO: `/v3/services` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:09.106455 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9407a7-64cb-45c2-9ac3-612e75df835b None admin] RBAC: Adding query filter params (name=image) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:24:09.106908 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9407a7-64cb-45c2-9ac3-612e75df835b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:09.108425 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9407a7-64cb-45c2-9ac3-612e75df835b None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:09.119125 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 515/1020] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:24:08 2022] GET /identity/v3/services?name=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:24:09.122927 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e29e1c-7135-45d9-8acf-3e9fd1afa241 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:09.144065 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:09.237713 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e29e1c-7135-45d9-8acf-3e9fd1afa241 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:09.274179 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2978d950-ae00-4161-b01d-206580448dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:09.275128 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978d950-ae00-4161-b01d-206580448dde None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:09.275417 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978d950-ae00-4161-b01d-206580448dde None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:09.275696 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978d950-ae00-4161-b01d-206580448dde None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:09.276408 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2978d950-ae00-4161-b01d-206580448dde None admin] RBAC: Adding query filter params (type=image) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:24:09.276738 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2978d950-ae00-4161-b01d-206580448dde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:09.279016 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2978d950-ae00-4161-b01d-206580448dde None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:09.284826 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 506/1021] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:24:09 2022] GET /identity/v3/services?type=image => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:24:09.290463 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9407a7-64cb-45c2-9ac3-612e75df835b None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:09.301081 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:09.322744 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9ade4-14dd-4d24-917d-6ce17662be8d None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:09.323074 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9ade4-14dd-4d24-917d-6ce17662be8d None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:09.323305 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9ade4-14dd-4d24-917d-6ce17662be8d None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:09.324969 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 507/1022] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:24:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:24:09.331729 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a1a6a-8217-4657-9dc3-380ac5930ed4 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:09.332012 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a1a6a-8217-4657-9dc3-380ac5930ed4 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:09.332307 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a1a6a-8217-4657-9dc3-380ac5930ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:09.353550 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-c07a1a6a-8217-4657-9dc3-380ac5930ed4 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:24:09.356080 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c07a1a6a-8217-4657-9dc3-380ac5930ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:24:09.417326 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9407a7-64cb-45c2-9ac3-612e75df835b None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:09.437334 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 508/1023] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:24:09 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:24:09.453089 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd09ae85-0100-4b0c-b0d5-a4aea79acf33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:09.453739 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd09ae85-0100-4b0c-b0d5-a4aea79acf33 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:09.454026 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd09ae85-0100-4b0c-b0d5-a4aea79acf33 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:09.454302 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd09ae85-0100-4b0c-b0d5-a4aea79acf33 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:09.455088 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd09ae85-0100-4b0c-b0d5-a4aea79acf33 None admin] RBAC: Adding query filter params (interface=public, service_id=acea069168844eb9a7a2352a2d5e7be3, region_id=RegionOne) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:24:09.455348 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a1a6a-8217-4657-9dc3-380ac5930ed4 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:09.455474 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd09ae85-0100-4b0c-b0d5-a4aea79acf33 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:09.456738 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd09ae85-0100-4b0c-b0d5-a4aea79acf33 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:09.462412 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 516/1024] 10.222.0.39 () {56 vars in 1251 bytes} [Mon Jul 18 10:24:09 2022] GET /identity/v3/endpoints?service_id=acea069168844eb9a7a2352a2d5e7be3&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:24:09.467637 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:09.468299 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd09ae85-0100-4b0c-b0d5-a4aea79acf33 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:09.559285 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a1a6a-8217-4657-9dc3-380ac5930ed4 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:09.563349 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:09.595900 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897954f9-e145-448a-8d37-9a0cc501f970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:09.596706 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897954f9-e145-448a-8d37-9a0cc501f970 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:09.597032 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897954f9-e145-448a-8d37-9a0cc501f970 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:09.597383 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897954f9-e145-448a-8d37-9a0cc501f970 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:09.598618 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897954f9-e145-448a-8d37-9a0cc501f970 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:09.599049 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd09ae85-0100-4b0c-b0d5-a4aea79acf33 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:09.600053 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897954f9-e145-448a-8d37-9a0cc501f970 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:09.601983 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 509/1025] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:24:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:24:09.608196 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897954f9-e145-448a-8d37-9a0cc501f970 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:09.647127 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cecd7c-6fa0-4989-bf8b-f37885a76801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:09.647803 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cecd7c-6fa0-4989-bf8b-f37885a76801 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:09.648102 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cecd7c-6fa0-4989-bf8b-f37885a76801 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:09.648363 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cecd7c-6fa0-4989-bf8b-f37885a76801 None admin] PATH_INFO: `/v3/services` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:09.649061 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cecd7c-6fa0-4989-bf8b-f37885a76801 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:09.650448 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cecd7c-6fa0-4989-bf8b-f37885a76801 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:09.658657 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 517/1026] 10.222.0.39 () {56 vars in 1087 bytes} [Mon Jul 18 10:24:09 2022] GET /identity/v3/services => generated 1957 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 10:24:09.721545 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:09.748002 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897954f9-e145-448a-8d37-9a0cc501f970 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:09.789285 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d7228-4601-492d-96fb-f5e98101c5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:09.789968 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d7228-4601-492d-96fb-f5e98101c5d0 None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:09.790251 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d7228-4601-492d-96fb-f5e98101c5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:09.790527 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d7228-4601-492d-96fb-f5e98101c5d0 None admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:09.791246 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8d7228-4601-492d-96fb-f5e98101c5d0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:09.793397 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8d7228-4601-492d-96fb-f5e98101c5d0 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:09.880505 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 510/1027] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Jul 18 10:24:09 2022] POST /identity/v3/projects => generated 311 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:24:10.541721 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943535d1-6067-4913-b350-cb38ccfa067c None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:10.542833 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943535d1-6067-4913-b350-cb38ccfa067c None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:10.542833 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943535d1-6067-4913-b350-cb38ccfa067c None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:10.544408 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 518/1028] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:24:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:24:10.549509 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08b1de-9048-4edc-a652-7dfa9077e0e2 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:10.549803 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08b1de-9048-4edc-a652-7dfa9077e0e2 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:10.550081 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08b1de-9048-4edc-a652-7dfa9077e0e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:10.567379 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-db08b1de-9048-4edc-a652-7dfa9077e0e2 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:24:10.568558 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-db08b1de-9048-4edc-a652-7dfa9077e0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:24:10.641200 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 511/1029] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:24:10 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:24:10.660534 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943535d1-6067-4913-b350-cb38ccfa067c None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:10.763567 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943535d1-6067-4913-b350-cb38ccfa067c None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:10.800681 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9713269-12ad-4f09-a8a1-144f2c6607cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:10.801442 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9713269-12ad-4f09-a8a1-144f2c6607cd None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:10.801723 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9713269-12ad-4f09-a8a1-144f2c6607cd None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:10.801989 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9713269-12ad-4f09-a8a1-144f2c6607cd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:10.803850 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:10.813592 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9713269-12ad-4f09-a8a1-144f2c6607cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:24:10.821723 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-c9713269-12ad-4f09-a8a1-144f2c6607cd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 10:24:10.821723 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:24:10.821723 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:24:10.821723 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:24:10.821723 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:24:10.821723 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:24:10.821723 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:24:10.821723 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:24:10.821723 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:24:10.821723 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:24:10.821723 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:24:10.821723 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:24:10.821723 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:24:10.821723 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:24:10.821723 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:24:10.821723 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:24:10.822695 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:24:10.822695 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:24:10.822695 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:24:10.822695 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:24:10.822695 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:24:10.822695 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:24:10.822695 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:24:10.822695 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:24:10.822695 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:24:10.822695 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:24:10.822695 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:24:10.822695 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:24:10.822695 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:24:10.822695 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:24:10.822695 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:24:10.822695 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:24:10.823550 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:24:10.823550 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:24:10.823550 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:24:10.823550 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:24:10.823550 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:24:10.823550 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:24:10.823550 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:24:10.823550 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:24:10.823550 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:24:10.823550 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:24:10.823550 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 10:24:10.823550 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:24:10.823550 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 519/1030] 10.222.0.39 () {56 vars in 1120 bytes} [Mon Jul 18 10:24:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:24:10.828970 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db08b1de-9048-4edc-a652-7dfa9077e0e2 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:10.889219 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:10.930231 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db08b1de-9048-4edc-a652-7dfa9077e0e2 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:10.965171 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9674240-ec62-4c96-91d5-a4a8042487be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:10.965842 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9674240-ec62-4c96-91d5-a4a8042487be None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:10.966121 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9674240-ec62-4c96-91d5-a4a8042487be None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:10.966396 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9674240-ec62-4c96-91d5-a4a8042487be None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:10.967137 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9674240-ec62-4c96-91d5-a4a8042487be None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:24:10.967444 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9674240-ec62-4c96-91d5-a4a8042487be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:10.968808 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9674240-ec62-4c96-91d5-a4a8042487be None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:10.982351 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 512/1031] 10.222.0.39 () {56 vars in 1115 bytes} [Mon Jul 18 10:24:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:24:10.984037 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9713269-12ad-4f09-a8a1-144f2c6607cd None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:11.093537 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9713269-12ad-4f09-a8a1-144f2c6607cd None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:11.130269 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a8463-3420-47be-a0c4-7f5b4b5c09b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:11.131057 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a8463-3420-47be-a0c4-7f5b4b5c09b9 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:11.131336 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a8463-3420-47be-a0c4-7f5b4b5c09b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:11.131605 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a8463-3420-47be-a0c4-7f5b4b5c09b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:11.141883 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469a8463-3420-47be-a0c4-7f5b4b5c09b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:11.143313 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469a8463-3420-47be-a0c4-7f5b4b5c09b9 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:11.160844 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-469a8463-3420-47be-a0c4-7f5b4b5c09b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:24:11.160844 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:24:11.160844 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:24:11.160844 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:24:11.160844 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:24:11.160844 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:24:11.160844 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:24:11.160844 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:24:11.160844 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:24:11.160844 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:24:11.160844 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:24:11.160844 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:24:11.160844 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:24:11.160844 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:24:11.160844 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:24:11.161760 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:24:11.161760 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:24:11.161760 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:24:11.161760 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:24:11.161760 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:24:11.161760 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:24:11.161760 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:24:11.161760 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:24:11.161760 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:24:11.161760 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:24:11.161760 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:24:11.161760 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:24:11.161760 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:24:11.161760 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:24:11.161760 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:24:11.161760 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:24:11.161760 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:24:11.162684 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:24:11.162684 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:24:11.162684 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:24:11.162684 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:24:11.165361 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 520/1032] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:24:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:24:11.168483 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9674240-ec62-4c96-91d5-a4a8042487be None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:11.269495 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9674240-ec62-4c96-91d5-a4a8042487be None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:11.291208 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:11.303561 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c8859c-2a53-45b2-a389-07a44dc5fb0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:11.304227 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8859c-2a53-45b2-a389-07a44dc5fb0f None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:11.305618 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8859c-2a53-45b2-a389-07a44dc5fb0f None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:11.305618 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8859c-2a53-45b2-a389-07a44dc5fb0f None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:11.305618 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c8859c-2a53-45b2-a389-07a44dc5fb0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:24:11.305825 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c8859c-2a53-45b2-a389-07a44dc5fb0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:11.307133 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c8859c-2a53-45b2-a389-07a44dc5fb0f None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:11.320202 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 513/1033] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:24:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:24:11.325976 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a8463-3420-47be-a0c4-7f5b4b5c09b9 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:11.374511 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:11.432211 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a8463-3420-47be-a0c4-7f5b4b5c09b9 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:11.466147 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26292a0e-22a7-4816-bb5c-a9fea0e31bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:11.466950 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26292a0e-22a7-4816-bb5c-a9fea0e31bd8 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:11.467233 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26292a0e-22a7-4816-bb5c-a9fea0e31bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:11.467506 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26292a0e-22a7-4816-bb5c-a9fea0e31bd8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:11.475140 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26292a0e-22a7-4816-bb5c-a9fea0e31bd8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:11.476569 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26292a0e-22a7-4816-bb5c-a9fea0e31bd8 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:11.491629 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-26292a0e-22a7-4816-bb5c-a9fea0e31bd8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 10:24:11.491629 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:24:11.491629 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:24:11.491629 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:24:11.491629 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:24:11.491629 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:24:11.491629 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:24:11.491629 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:24:11.491629 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:24:11.491629 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:24:11.491629 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:24:11.491629 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:24:11.491629 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:24:11.491629 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:24:11.491629 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:24:11.491629 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:24:11.492633 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:24:11.492633 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:24:11.492633 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:24:11.492633 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:24:11.492633 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:24:11.492633 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:24:11.492633 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:24:11.492633 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:24:11.492633 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:24:11.492633 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:24:11.492633 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:24:11.492633 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:24:11.492633 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:24:11.492633 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:24:11.492633 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:24:11.492633 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:24:11.492633 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:24:11.492633 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:24:11.493986 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:24:11.493986 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:24:11.493986 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:24:11.493986 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:24:11.493986 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:24:11.493986 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:24:11.493986 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:24:11.493986 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:24:11.493986 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 10:24:11.493986 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:24:11.497539 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 521/1034] 10.222.0.39 () {56 vars in 1093 bytes} [Mon Jul 18 10:24:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:24:11.499470 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c8859c-2a53-45b2-a389-07a44dc5fb0f None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:11.602549 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c8859c-2a53-45b2-a389-07a44dc5fb0f None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:11.641997 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ae4d3-6a58-4d3b-b32d-da0bf740228b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:11.642589 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ae4d3-6a58-4d3b-b32d-da0bf740228b None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:11.642869 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ae4d3-6a58-4d3b-b32d-da0bf740228b None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:11.643141 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ae4d3-6a58-4d3b-b32d-da0bf740228b None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:11.643972 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585ae4d3-6a58-4d3b-b32d-da0bf740228b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:24:11.644282 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585ae4d3-6a58-4d3b-b32d-da0bf740228b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:11.645722 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585ae4d3-6a58-4d3b-b32d-da0bf740228b None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:11.668209 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 514/1035] 10.222.0.39 () {56 vars in 1133 bytes} [Mon Jul 18 10:24:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:24:11.669493 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26292a0e-22a7-4816-bb5c-a9fea0e31bd8 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:11.729487 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2fc6f-c3d6-4de4-8ca1-ca2b06654b6c None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:11.729865 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2fc6f-c3d6-4de4-8ca1-ca2b06654b6c None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:11.730301 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2fc6f-c3d6-4de4-8ca1-ca2b06654b6c None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:11.731897 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 515/1036] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:24:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:24:11.736980 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337be63-6eb3-471d-a30d-bdb91328ab8a None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:11.737503 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337be63-6eb3-471d-a30d-bdb91328ab8a None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:11.737787 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337be63-6eb3-471d-a30d-bdb91328ab8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:11.755309 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-3337be63-6eb3-471d-a30d-bdb91328ab8a None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:24:11.756511 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-3337be63-6eb3-471d-a30d-bdb91328ab8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:24:11.779539 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26292a0e-22a7-4816-bb5c-a9fea0e31bd8 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:11.787176 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:11.796776 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:11.814858 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec52b045-4e1a-4f0a-b129-aeabd6bab1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:11.815514 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52b045-4e1a-4f0a-b129-aeabd6bab1e6 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:11.815794 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52b045-4e1a-4f0a-b129-aeabd6bab1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:11.816069 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52b045-4e1a-4f0a-b129-aeabd6bab1e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:11.831133 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 516/1037] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:24:11 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 10:24:11.854168 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3337be63-6eb3-471d-a30d-bdb91328ab8a None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:11.885888 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec52b045-4e1a-4f0a-b129-aeabd6bab1e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:11.887378 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec52b045-4e1a-4f0a-b129-aeabd6bab1e6 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:11.962936 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3337be63-6eb3-471d-a30d-bdb91328ab8a None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:11.987773 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 522/1038] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 10:24:11 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 10:24:11.989360 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c882c-9543-4646-a609-528b2eee980a None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:11.989652 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c882c-9543-4646-a609-528b2eee980a None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:11.989927 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c882c-9543-4646-a609-528b2eee980a None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:11.991205 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 523/1039] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:24:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:24:11.993374 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c882c-9543-4646-a609-528b2eee980a None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:12.002806 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:12.004246 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235ae28b-c6ba-4977-b909-e4ef03342ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:12.005054 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ae28b-c6ba-4977-b909-e4ef03342ac9 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:12.005349 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ae28b-c6ba-4977-b909-e4ef03342ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:12.005624 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ae28b-c6ba-4977-b909-e4ef03342ac9 None admin] PATH_INFO: `/v3/services/image` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:12.006270 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235ae28b-c6ba-4977-b909-e4ef03342ac9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:12.007617 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235ae28b-c6ba-4977-b909-e4ef03342ac9 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:12.019380 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-235ae28b-c6ba-4977-b909-e4ef03342ac9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 10:24:12.019380 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:24:12.019380 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 10:24:12.019380 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 10:24:12.019380 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 10:24:12.019380 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 10:24:12.019380 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 10:24:12.019380 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:24:12.019380 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 10:24:12.019380 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:24:12.019380 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 10:24:12.019380 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:24:12.019380 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:24:12.019380 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:24:12.019380 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:24:12.019380 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:24:12.019380 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:24:12.020356 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:24:12.020356 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:24:12.020356 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:24:12.020356 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:24:12.020356 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:24:12.020356 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:24:12.020356 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 10:24:12.020356 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 10:24:12.020356 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 10:24:12.020356 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 10:24:12.020356 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:24:12.020356 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:24:12.020356 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:24:12.020356 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:24:12.020356 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:24:12.020356 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:24:12.021268 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:24:12.021268 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:24:12.021268 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:24:12.021268 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:24:12.021268 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:24:12.021268 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:24:12.021268 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:24:12.021268 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:24:12.021268 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:24:12.021268 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:24:12.021268 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 10:24:12.021268 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:24:12.021268 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 10:24:12.021268 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:24:12.021268 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 517/1040] 10.222.0.39 () {56 vars in 1105 bytes} [Mon Jul 18 10:24:11 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:24:12.022076 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50e1a4-8244-4dd6-b816-93d8fc4f5c8a None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:12.022076 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50e1a4-8244-4dd6-b816-93d8fc4f5c8a None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:12.022249 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50e1a4-8244-4dd6-b816-93d8fc4f5c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:12.038693 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-bb50e1a4-8244-4dd6-b816-93d8fc4f5c8a None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:24:12.039898 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-bb50e1a4-8244-4dd6-b816-93d8fc4f5c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:24:12.067136 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:12.100428 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c882c-9543-4646-a609-528b2eee980a None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:12.112140 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 518/1041] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:24:12 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:24:12.113108 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb50e1a4-8244-4dd6-b816-93d8fc4f5c8a None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:12.139632 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2cd332-9ed9-402e-8712-d415de5fc4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:12.140433 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2cd332-9ed9-402e-8712-d415de5fc4b2 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:12.140717 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2cd332-9ed9-402e-8712-d415de5fc4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:12.140999 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2cd332-9ed9-402e-8712-d415de5fc4b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:12.151398 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2cd332-9ed9-402e-8712-d415de5fc4b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:12.153407 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2cd332-9ed9-402e-8712-d415de5fc4b2 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:12.171597 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-5f2cd332-9ed9-402e-8712-d415de5fc4b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:24:12.171597 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:24:12.171597 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:24:12.171597 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:24:12.171597 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:24:12.171597 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:24:12.171597 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:24:12.171597 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:24:12.171597 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:24:12.171597 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:24:12.171597 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:24:12.171597 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:24:12.171597 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:24:12.171597 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:24:12.171597 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:24:12.172637 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:24:12.172637 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:24:12.172637 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:24:12.172637 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:24:12.172637 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:24:12.172637 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:24:12.172637 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:24:12.172637 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:24:12.172637 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:24:12.172637 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:24:12.172637 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:24:12.172637 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:24:12.172637 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:24:12.172637 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:24:12.172637 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:24:12.172637 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:24:12.172637 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:24:12.173840 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:24:12.173840 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:24:12.173840 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:24:12.173840 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:24:12.173840 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 524/1042] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:24:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:24:12.173840 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2cd332-9ed9-402e-8712-d415de5fc4b2 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:12.218534 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb50e1a4-8244-4dd6-b816-93d8fc4f5c8a None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:12.230833 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:12.253506 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0062455-e1e2-4dec-88c0-8caf14188e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:12.254223 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0062455-e1e2-4dec-88c0-8caf14188e09 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:12.254507 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0062455-e1e2-4dec-88c0-8caf14188e09 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:12.254785 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0062455-e1e2-4dec-88c0-8caf14188e09 None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:12.255488 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0062455-e1e2-4dec-88c0-8caf14188e09 None admin] RBAC: Adding query filter params (name=image) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:24:12.255794 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0062455-e1e2-4dec-88c0-8caf14188e09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:12.257198 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0062455-e1e2-4dec-88c0-8caf14188e09 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:12.262202 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 519/1043] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:24:12 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:24:12.263094 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0062455-e1e2-4dec-88c0-8caf14188e09 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:12.272492 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2cd332-9ed9-402e-8712-d415de5fc4b2 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:12.291300 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:12.307018 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777ff733-1177-48d3-b0f4-0416dd752aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:12.307842 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ff733-1177-48d3-b0f4-0416dd752aed None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:12.308132 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ff733-1177-48d3-b0f4-0416dd752aed None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:12.308419 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ff733-1177-48d3-b0f4-0416dd752aed None admin] PATH_INFO: `/v3/domains/default` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:12.309692 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777ff733-1177-48d3-b0f4-0416dd752aed None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:12.311126 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777ff733-1177-48d3-b0f4-0416dd752aed None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:12.312820 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 525/1044] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:24:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:24:12.313730 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777ff733-1177-48d3-b0f4-0416dd752aed None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:12.365079 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0062455-e1e2-4dec-88c0-8caf14188e09 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:12.398778 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd8a03-3037-4425-a6dd-04c08c80e24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:12.399433 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd8a03-3037-4425-a6dd-04c08c80e24f None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:12.399716 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd8a03-3037-4425-a6dd-04c08c80e24f None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:12.399989 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd8a03-3037-4425-a6dd-04c08c80e24f None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:12.400698 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcd8a03-3037-4425-a6dd-04c08c80e24f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:24:12.401005 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcd8a03-3037-4425-a6dd-04c08c80e24f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:12.402506 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcd8a03-3037-4425-a6dd-04c08c80e24f None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:12.413327 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 520/1045] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:24:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:24:12.414080 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd8a03-3037-4425-a6dd-04c08c80e24f None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:12.420299 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777ff733-1177-48d3-b0f4-0416dd752aed None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:12.446543 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:12.456033 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93706b31-58b1-4b4f-b1c3-d130f12d364e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:12.461086 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93706b31-58b1-4b4f-b1c3-d130f12d364e None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:12.461086 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93706b31-58b1-4b4f-b1c3-d130f12d364e None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:12.461086 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93706b31-58b1-4b4f-b1c3-d130f12d364e None admin] PATH_INFO: `/v3/services` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:12.461086 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93706b31-58b1-4b4f-b1c3-d130f12d364e None admin] RBAC: Adding query filter params (type=image) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:24:12.461086 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93706b31-58b1-4b4f-b1c3-d130f12d364e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:12.461086 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93706b31-58b1-4b4f-b1c3-d130f12d364e None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:12.464548 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 526/1046] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:24:12 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:24:12.465408 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93706b31-58b1-4b4f-b1c3-d130f12d364e None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:12.503113 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:12.515125 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd8a03-3037-4425-a6dd-04c08c80e24f None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:12.549348 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eb35e5-b0e8-428f-acb4-6346ef0e9313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:12.550019 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb35e5-b0e8-428f-acb4-6346ef0e9313 None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:12.550300 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb35e5-b0e8-428f-acb4-6346ef0e9313 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:12.550576 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb35e5-b0e8-428f-acb4-6346ef0e9313 None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:12.551271 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eb35e5-b0e8-428f-acb4-6346ef0e9313 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:12.552691 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eb35e5-b0e8-428f-acb4-6346ef0e9313 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:12.568541 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93706b31-58b1-4b4f-b1c3-d130f12d364e None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:12.602056 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d431d8fb-4858-4cc8-badc-ce72797b222d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:12.602838 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d431d8fb-4858-4cc8-badc-ce72797b222d None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:12.603118 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d431d8fb-4858-4cc8-badc-ce72797b222d None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:12.603388 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d431d8fb-4858-4cc8-badc-ce72797b222d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:12.610419 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d431d8fb-4858-4cc8-badc-ce72797b222d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:12.612120 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d431d8fb-4858-4cc8-badc-ce72797b222d None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:12.626755 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-d431d8fb-4858-4cc8-badc-ce72797b222d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:24:12.626755 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:24:12.626755 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:24:12.626755 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:24:12.626755 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:24:12.626755 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:24:12.626755 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:24:12.626755 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:24:12.626755 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:24:12.626755 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:24:12.626755 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:24:12.626755 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:24:12.626755 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:24:12.626755 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:24:12.626755 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:24:12.627787 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:24:12.627787 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:24:12.627787 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:24:12.627787 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:24:12.627787 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:24:12.627787 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:24:12.627787 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:24:12.627787 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:24:12.627787 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:24:12.627787 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:24:12.627787 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:24:12.627787 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:24:12.627787 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:24:12.627787 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:24:12.627787 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:24:12.627787 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:24:12.627787 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:24:12.628889 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:24:12.628889 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:24:12.628889 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:24:12.628889 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:24:12.628889 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:24:12.628889 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:24:12.628889 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:24:12.628889 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:24:12.628889 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 527/1047] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 10:24:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:24:12.628889 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d431d8fb-4858-4cc8-badc-ce72797b222d None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:12.655463 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 521/1048] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Jul 18 10:24:12 2022] POST /identity/v3/users => generated 285 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:24:12.656211 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eb35e5-b0e8-428f-acb4-6346ef0e9313 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:12.692443 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:12.749766 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d431d8fb-4858-4cc8-badc-ce72797b222d None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:12.776465 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eb35e5-b0e8-428f-acb4-6346ef0e9313 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:12.795856 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7402d153-b7dc-4879-a8b3-e9c7b7d7d1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:12.796531 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402d153-b7dc-4879-a8b3-e9c7b7d7d1d6 None admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:12.796813 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402d153-b7dc-4879-a8b3-e9c7b7d7d1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:12.797110 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7402d153-b7dc-4879-a8b3-e9c7b7d7d1d6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:12.797862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7402d153-b7dc-4879-a8b3-e9c7b7d7d1d6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:12.799253 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7402d153-b7dc-4879-a8b3-e9c7b7d7d1d6 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:12.818050 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f004a5b-6a5a-49b6-a59e-f9202daa4d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:12.818725 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f004a5b-6a5a-49b6-a59e-f9202daa4d95 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:12.819004 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f004a5b-6a5a-49b6-a59e-f9202daa4d95 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:12.819282 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f004a5b-6a5a-49b6-a59e-f9202daa4d95 None admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:12.820062 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f004a5b-6a5a-49b6-a59e-f9202daa4d95 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:24:12.820375 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f004a5b-6a5a-49b6-a59e-f9202daa4d95 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:12.821802 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f004a5b-6a5a-49b6-a59e-f9202daa4d95 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:12.834529 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 522/1049] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 10:24:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:24:12.841728 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f004a5b-6a5a-49b6-a59e-f9202daa4d95 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:12.845425 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:12.894492 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 528/1050] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Jul 18 10:24:12 2022] POST /identity/v3/endpoints => generated 327 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:24:12.954895 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f004a5b-6a5a-49b6-a59e-f9202daa4d95 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:13.002697 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6628f205-ae56-4f37-bf13-07144ab1868a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:13.003375 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628f205-ae56-4f37-bf13-07144ab1868a None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:13.003660 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628f205-ae56-4f37-bf13-07144ab1868a None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:13.003936 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628f205-ae56-4f37-bf13-07144ab1868a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:13.004783 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6628f205-ae56-4f37-bf13-07144ab1868a None admin] RBAC: Adding query filter params (role.id=e5d4d6eee014413ea5c24c2b65d09652, scope.project.id=a6098fe56d304980aa14bd95b4b92c17, user.id=8bbebf16219943879df84bdc9a900516) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:24:13.005135 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6628f205-ae56-4f37-bf13-07144ab1868a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:13.006597 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6628f205-ae56-4f37-bf13-07144ab1868a None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:13.013528 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 523/1051] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 10:24:12 2022] GET /identity/v3/role_assignments?user.id=8bbebf16219943879df84bdc9a900516&scope.project.id=a6098fe56d304980aa14bd95b4b92c17&role.id=e5d4d6eee014413ea5c24c2b65d09652 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:24:14.765694 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f10dd1-0d5b-4d4f-a5f3-ebc7736d9cc2 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:14.766253 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f10dd1-0d5b-4d4f-a5f3-ebc7736d9cc2 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:14.766253 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f10dd1-0d5b-4d4f-a5f3-ebc7736d9cc2 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:14.767643 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 529/1052] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:24:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:24:14.772815 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf57c0-e5c0-4780-8317-5d229218d78a None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:14.773218 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf57c0-e5c0-4780-8317-5d229218d78a None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:14.773398 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf57c0-e5c0-4780-8317-5d229218d78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:14.791310 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-afcf57c0-e5c0-4780-8317-5d229218d78a None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:24:14.793163 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-afcf57c0-e5c0-4780-8317-5d229218d78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:24:14.854701 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:14.865090 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 524/1053] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:24:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:24:14.887548 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f10dd1-0d5b-4d4f-a5f3-ebc7736d9cc2 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:14.978470 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e355f1-ae61-4910-bf11-ba9ebe50bb86 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:14.978837 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e355f1-ae61-4910-bf11-ba9ebe50bb86 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:14.979037 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e355f1-ae61-4910-bf11-ba9ebe50bb86 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:14.981321 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 525/1054] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:24:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:24:14.986717 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2e4d8-ad62-4129-8400-6b3a6848f649 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:14.987608 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2e4d8-ad62-4129-8400-6b3a6848f649 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:14.987608 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2e4d8-ad62-4129-8400-6b3a6848f649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:14.996422 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f10dd1-0d5b-4d4f-a5f3-ebc7736d9cc2 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:15.004613 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:15.004827 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-c3a2e4d8-ad62-4129-8400-6b3a6848f649 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:24:15.006059 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c3a2e4d8-ad62-4129-8400-6b3a6848f649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:24:15.033028 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f394e3-5a5a-484b-bfa7-077737f01af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:15.033778 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f394e3-5a5a-484b-bfa7-077737f01af1 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:15.034057 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f394e3-5a5a-484b-bfa7-077737f01af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:15.034379 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f394e3-5a5a-484b-bfa7-077737f01af1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:15.045257 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f394e3-5a5a-484b-bfa7-077737f01af1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:24:15.052887 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-c1f394e3-5a5a-484b-bfa7-077737f01af1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:24:15.052887 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:24:15.052887 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:24:15.052887 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:24:15.052887 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:24:15.052887 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:24:15.052887 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:24:15.052887 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:24:15.052887 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:24:15.052887 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:24:15.052887 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:24:15.052887 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:24:15.052887 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:24:15.052887 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:24:15.052887 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:24:15.052887 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:24:15.053960 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:24:15.053960 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:24:15.053960 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:24:15.053960 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:24:15.053960 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:24:15.053960 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:24:15.053960 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:24:15.053960 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:24:15.053960 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:24:15.053960 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:24:15.053960 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:24:15.053960 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:24:15.053960 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:24:15.053960 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:24:15.053960 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:24:15.053960 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:24:15.054925 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:24:15.054925 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:24:15.054925 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:24:15.054925 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:24:15.054925 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:24:15.054925 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:24:15.054925 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:24:15.054925 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:24:15.054925 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:24:15.054925 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:24:15.054925 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:24:15.054925 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:24:15.054925 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 530/1055] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 10:24:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:24:15.055667 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f99ba2-d09f-45e8-80b2-a4d7c756c963 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:15.055667 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f99ba2-d09f-45e8-80b2-a4d7c756c963 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:15.056263 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f99ba2-d09f-45e8-80b2-a4d7c756c963 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:15.057269 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 531/1056] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:24:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:24:15.060677 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f99ba2-d09f-45e8-80b2-a4d7c756c963 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:15.075694 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 526/1057] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:24:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 10:24:15.076760 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10f261-6206-4c08-a294-d45b890fab0b None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:15.077058 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10f261-6206-4c08-a294-d45b890fab0b None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:15.077336 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10f261-6206-4c08-a294-d45b890fab0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:15.101147 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-da10f261-6206-4c08-a294-d45b890fab0b None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:24:15.102369 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-da10f261-6206-4c08-a294-d45b890fab0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:24:15.166045 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f99ba2-d09f-45e8-80b2-a4d7c756c963 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:15.171516 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 527/1058] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:24:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:24:15.172358 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da10f261-6206-4c08-a294-d45b890fab0b None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:15.203664 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e7796-e55a-463d-b042-95708d569f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:15.204335 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e7796-e55a-463d-b042-95708d569f6b None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:15.204647 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e7796-e55a-463d-b042-95708d569f6b None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:15.204924 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e7796-e55a-463d-b042-95708d569f6b None admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:15.205701 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6e7796-e55a-463d-b042-95708d569f6b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:24:15.206011 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6e7796-e55a-463d-b042-95708d569f6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:15.207376 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6e7796-e55a-463d-b042-95708d569f6b None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:15.216504 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 532/1059] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 10:24:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:24:15.217382 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e7796-e55a-463d-b042-95708d569f6b None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:15.235983 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:15.245979 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:15.280197 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da10f261-6206-4c08-a294-d45b890fab0b None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:15.313773 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f28d1f-0b01-403c-bb5b-7b20c229a157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:15.314349 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f28d1f-0b01-403c-bb5b-7b20c229a157 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:15.314635 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f28d1f-0b01-403c-bb5b-7b20c229a157 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:15.314899 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f28d1f-0b01-403c-bb5b-7b20c229a157 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:15.317580 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e7796-e55a-463d-b042-95708d569f6b None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:15.351751 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0859973-5e13-4c69-b9ff-08b447454570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:15.352569 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0859973-5e13-4c69-b9ff-08b447454570 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:15.352856 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0859973-5e13-4c69-b9ff-08b447454570 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:15.353164 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0859973-5e13-4c69-b9ff-08b447454570 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:15.363935 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0859973-5e13-4c69-b9ff-08b447454570 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:24:15.372889 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-b0859973-5e13-4c69-b9ff-08b447454570 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 10:24:15.372889 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:24:15.372889 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:24:15.372889 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:24:15.372889 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:24:15.372889 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:24:15.372889 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:24:15.372889 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:24:15.372889 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:24:15.372889 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:24:15.372889 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:24:15.372889 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:24:15.372889 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:24:15.372889 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:24:15.372889 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:24:15.372889 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:24:15.373937 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:24:15.373937 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:24:15.373937 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:24:15.373937 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:24:15.373937 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:24:15.373937 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:24:15.373937 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:24:15.373937 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:24:15.373937 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:24:15.373937 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:24:15.373937 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:24:15.373937 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:24:15.373937 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:24:15.373937 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:24:15.373937 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:24:15.373937 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:24:15.374766 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:24:15.374766 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:24:15.374766 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:24:15.374766 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:24:15.374766 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:24:15.374766 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:24:15.374766 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:24:15.374766 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:24:15.374766 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:24:15.374766 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:24:15.374766 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 10:24:15.374766 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:24:15.374766 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 533/1060] 10.222.0.39 () {56 vars in 1120 bytes} [Mon Jul 18 10:24:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:24:15.375441 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0859973-5e13-4c69-b9ff-08b447454570 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:15.383700 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f28d1f-0b01-403c-bb5b-7b20c229a157 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:15.385169 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f28d1f-0b01-403c-bb5b-7b20c229a157 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:15.439461 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:15.464916 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:15.476796 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0859973-5e13-4c69-b9ff-08b447454570 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:15.484819 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 528/1061] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 10:24:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 10:24:15.485923 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f28d1f-0b01-403c-bb5b-7b20c229a157 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:15.513136 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60924c6-9d6c-4528-b042-54d489f3d5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:15.514014 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60924c6-9d6c-4528-b042-54d489f3d5a7 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:15.514298 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60924c6-9d6c-4528-b042-54d489f3d5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:15.514572 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60924c6-9d6c-4528-b042-54d489f3d5a7 None admin] PATH_INFO: `/v3/users/91de9bd47e734f159aca4e85470cef5a` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:15.529531 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60924c6-9d6c-4528-b042-54d489f3d5a7 None admin] RBAC: Authorizing `identity:get_user(user_id=91de9bd47e734f159aca4e85470cef5a)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:15.530968 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60924c6-9d6c-4528-b042-54d489f3d5a7 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:15.532635 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 534/1062] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 10:24:15 2022] GET /identity/v3/users/91de9bd47e734f159aca4e85470cef5a => generated 285 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:24:15.533417 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60924c6-9d6c-4528-b042-54d489f3d5a7 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:15.585822 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f28d1f-0b01-403c-bb5b-7b20c229a157 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:15.619370 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d19431-7ef4-4ad2-87ac-9d84d8dcc6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:15.620047 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d19431-7ef4-4ad2-87ac-9d84d8dcc6a5 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:15.620331 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d19431-7ef4-4ad2-87ac-9d84d8dcc6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:15.620599 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d19431-7ef4-4ad2-87ac-9d84d8dcc6a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:15.621357 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d19431-7ef4-4ad2-87ac-9d84d8dcc6a5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:24:15.621665 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d19431-7ef4-4ad2-87ac-9d84d8dcc6a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:15.623000 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d19431-7ef4-4ad2-87ac-9d84d8dcc6a5 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:15.630691 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 529/1063] 10.222.0.39 () {56 vars in 1115 bytes} [Mon Jul 18 10:24:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:24:15.631459 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d19431-7ef4-4ad2-87ac-9d84d8dcc6a5 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:15.633019 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60924c6-9d6c-4528-b042-54d489f3d5a7 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:15.649928 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:15.668917 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50abacb-b45f-4da1-b595-4b452a9c2559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:15.669746 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50abacb-b45f-4da1-b595-4b452a9c2559 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:15.670027 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50abacb-b45f-4da1-b595-4b452a9c2559 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:15.670300 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50abacb-b45f-4da1-b595-4b452a9c2559 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:15.680443 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50abacb-b45f-4da1-b595-4b452a9c2559 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:15.682034 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50abacb-b45f-4da1-b595-4b452a9c2559 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:15.689763 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:15.701133 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-c50abacb-b45f-4da1-b595-4b452a9c2559 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:24:15.701133 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:24:15.701133 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:24:15.701133 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:24:15.701133 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:24:15.701133 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:24:15.701133 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:24:15.701133 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:24:15.701133 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:24:15.701133 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:24:15.701133 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:24:15.701133 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:24:15.701133 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:24:15.701133 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:24:15.701133 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:24:15.702180 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:24:15.702180 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:24:15.702180 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:24:15.702180 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:24:15.702180 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:24:15.702180 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:24:15.702180 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:24:15.702180 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:24:15.702180 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:24:15.702180 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:24:15.702180 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:24:15.702180 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:24:15.702180 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:24:15.702180 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:24:15.702180 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:24:15.702180 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:24:15.702180 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:24:15.703096 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:24:15.703096 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:24:15.703096 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:24:15.703096 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:24:15.703096 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 535/1064] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:24:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:24:15.703096 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50abacb-b45f-4da1-b595-4b452a9c2559 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:15.738227 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d19431-7ef4-4ad2-87ac-9d84d8dcc6a5 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:15.777358 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea5352-efcb-4ab5-8130-825e0b23188e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:15.778032 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea5352-efcb-4ab5-8130-825e0b23188e None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:15.778269 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea5352-efcb-4ab5-8130-825e0b23188e None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:15.778546 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea5352-efcb-4ab5-8130-825e0b23188e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:15.803075 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50abacb-b45f-4da1-b595-4b452a9c2559 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:15.837298 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f47e56d-8e2a-48a3-934c-a6128e7f042b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:15.838103 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47e56d-8e2a-48a3-934c-a6128e7f042b None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:15.838394 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47e56d-8e2a-48a3-934c-a6128e7f042b None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:15.838671 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47e56d-8e2a-48a3-934c-a6128e7f042b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:15.845172 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfea5352-efcb-4ab5-8130-825e0b23188e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:15.846637 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfea5352-efcb-4ab5-8130-825e0b23188e None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:15.848878 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f47e56d-8e2a-48a3-934c-a6128e7f042b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:15.850336 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f47e56d-8e2a-48a3-934c-a6128e7f042b None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:15.864070 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:15.868504 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-6f47e56d-8e2a-48a3-934c-a6128e7f042b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:24:15.868504 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:24:15.868504 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:24:15.868504 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:24:15.868504 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:24:15.868504 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:24:15.868504 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:24:15.868504 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:24:15.868504 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:24:15.868504 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:24:15.868504 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:24:15.868504 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:24:15.868504 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:24:15.868504 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:24:15.868504 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:24:15.869464 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:24:15.869464 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:24:15.869464 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:24:15.869464 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:24:15.869464 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:24:15.869464 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:24:15.869464 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:24:15.869464 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:24:15.869464 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:24:15.869464 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:24:15.869464 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:24:15.869464 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:24:15.869464 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:24:15.869464 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:24:15.869464 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:24:15.869464 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:24:15.869464 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:24:15.871057 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:24:15.871057 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:24:15.871057 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:24:15.871057 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:24:15.871057 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 536/1065] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:24:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:24:15.871870 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f47e56d-8e2a-48a3-934c-a6128e7f042b None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:15.920583 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:15.950504 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 530/1066] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 10:24:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 10:24:15.951354 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea5352-efcb-4ab5-8130-825e0b23188e None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:15.970607 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f47e56d-8e2a-48a3-934c-a6128e7f042b None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:16.004757 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e71eb0-19e7-4ec2-9bc8-f5f41cf24106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:16.005451 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e71eb0-19e7-4ec2-9bc8-f5f41cf24106 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:16.005740 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e71eb0-19e7-4ec2-9bc8-f5f41cf24106 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:16.006061 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e71eb0-19e7-4ec2-9bc8-f5f41cf24106 None admin] PATH_INFO: `/v3/domains` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:16.006788 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e71eb0-19e7-4ec2-9bc8-f5f41cf24106 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:24:16.007099 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e71eb0-19e7-4ec2-9bc8-f5f41cf24106 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:16.008470 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e71eb0-19e7-4ec2-9bc8-f5f41cf24106 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:16.020537 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 537/1067] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:24:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:24:16.021357 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e71eb0-19e7-4ec2-9bc8-f5f41cf24106 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:16.060217 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea5352-efcb-4ab5-8130-825e0b23188e None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:16.077884 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:16.098196 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4802d59-3172-455e-8c99-b341f8bdaf08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:16.098792 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4802d59-3172-455e-8c99-b341f8bdaf08 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:16.102053 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4802d59-3172-455e-8c99-b341f8bdaf08 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:16.102053 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4802d59-3172-455e-8c99-b341f8bdaf08 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:16.102053 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4802d59-3172-455e-8c99-b341f8bdaf08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:24:16.102053 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4802d59-3172-455e-8c99-b341f8bdaf08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:16.102053 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4802d59-3172-455e-8c99-b341f8bdaf08 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:16.121544 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 531/1068] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:24:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:24:16.123091 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4802d59-3172-455e-8c99-b341f8bdaf08 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:16.146994 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e71eb0-19e7-4ec2-9bc8-f5f41cf24106 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:16.158927 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:16.186619 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11cb40f-f590-45cb-b5db-3aefa730da38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:16.187500 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11cb40f-f590-45cb-b5db-3aefa730da38 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:16.187783 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11cb40f-f590-45cb-b5db-3aefa730da38 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:16.188058 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11cb40f-f590-45cb-b5db-3aefa730da38 None admin] PATH_INFO: `/v3/projects/d2490aa6415e41d69422ae0398e4b3b7` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:16.189306 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11cb40f-f590-45cb-b5db-3aefa730da38 None admin] RBAC: Authorizing `identity:get_project(project_id=d2490aa6415e41d69422ae0398e4b3b7)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:16.191097 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11cb40f-f590-45cb-b5db-3aefa730da38 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:16.194171 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 538/1069] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 10:24:16 2022] GET /identity/v3/projects/d2490aa6415e41d69422ae0398e4b3b7 => generated 311 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:24:16.200469 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11cb40f-f590-45cb-b5db-3aefa730da38 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:16.240938 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4802d59-3172-455e-8c99-b341f8bdaf08 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:16.285199 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a1e2a-664f-4431-8cd4-f6d21940b71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:16.286115 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a1e2a-664f-4431-8cd4-f6d21940b71b None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:16.286394 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a1e2a-664f-4431-8cd4-f6d21940b71b None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:16.286664 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a1e2a-664f-4431-8cd4-f6d21940b71b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:16.295136 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4a1e2a-664f-4431-8cd4-f6d21940b71b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:16.296608 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4a1e2a-664f-4431-8cd4-f6d21940b71b None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:16.313029 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-cb4a1e2a-664f-4431-8cd4-f6d21940b71b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 10:24:16.313029 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:24:16.313029 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:24:16.313029 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:24:16.313029 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:24:16.313029 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:24:16.313029 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:24:16.313029 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:24:16.313029 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:24:16.313029 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:24:16.313029 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:24:16.313029 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:24:16.313029 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:24:16.313029 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:24:16.313029 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:24:16.313029 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:24:16.314082 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:24:16.314082 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:24:16.314082 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:24:16.314082 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:24:16.314082 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:24:16.314082 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:24:16.314082 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:24:16.314082 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:24:16.314082 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:24:16.314082 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:24:16.314082 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:24:16.314082 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:24:16.314082 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:24:16.314082 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:24:16.314082 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:24:16.314082 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:24:16.314082 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:24:16.314082 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:24:16.315033 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:24:16.315033 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:24:16.315033 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:24:16.315033 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:24:16.315033 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:24:16.315033 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:24:16.315033 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:24:16.315033 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:24:16.315033 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 10:24:16.315033 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:24:16.315033 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 532/1070] 10.222.0.39 () {56 vars in 1093 bytes} [Mon Jul 18 10:24:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:24:16.318220 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11cb40f-f590-45cb-b5db-3aefa730da38 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:16.321495 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a1e2a-664f-4431-8cd4-f6d21940b71b None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:16.352195 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497b5f1-2e84-4941-84a3-832c9114222d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:16.352777 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497b5f1-2e84-4941-84a3-832c9114222d None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:16.353084 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497b5f1-2e84-4941-84a3-832c9114222d None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:16.353359 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497b5f1-2e84-4941-84a3-832c9114222d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:16.354175 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e497b5f1-2e84-4941-84a3-832c9114222d None admin] RBAC: Adding query filter params (role.id=e7b6a55ecf6c491487955aaefbf9c388, scope.project.id=d2490aa6415e41d69422ae0398e4b3b7, user.id=91de9bd47e734f159aca4e85470cef5a) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:24:16.355106 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e497b5f1-2e84-4941-84a3-832c9114222d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:16.356614 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e497b5f1-2e84-4941-84a3-832c9114222d None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:16.357702 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:16.362456 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 539/1071] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 10:24:16 2022] GET /identity/v3/role_assignments?user.id=91de9bd47e734f159aca4e85470cef5a&scope.project.id=d2490aa6415e41d69422ae0398e4b3b7&role.id=e7b6a55ecf6c491487955aaefbf9c388 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:24:16.427231 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a1e2a-664f-4431-8cd4-f6d21940b71b None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:16.464648 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d26d18e-45bb-4910-8da2-5052aa3c9dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:16.465353 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26d18e-45bb-4910-8da2-5052aa3c9dc0 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:16.465633 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26d18e-45bb-4910-8da2-5052aa3c9dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:16.465905 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26d18e-45bb-4910-8da2-5052aa3c9dc0 None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:16.466745 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d26d18e-45bb-4910-8da2-5052aa3c9dc0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:24:16.467052 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d26d18e-45bb-4910-8da2-5052aa3c9dc0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:16.468498 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d26d18e-45bb-4910-8da2-5052aa3c9dc0 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:16.488337 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 533/1072] 10.222.0.39 () {56 vars in 1133 bytes} [Mon Jul 18 10:24:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:24:16.494201 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497b5f1-2e84-4941-84a3-832c9114222d None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:16.538495 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:16.594950 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497b5f1-2e84-4941-84a3-832c9114222d None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:16.629451 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0565b29a-99f4-49fb-a493-794b950633ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:16.630162 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0565b29a-99f4-49fb-a493-794b950633ca None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:16.630442 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0565b29a-99f4-49fb-a493-794b950633ca None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:16.630711 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0565b29a-99f4-49fb-a493-794b950633ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:16.641549 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0565b29a-99f4-49fb-a493-794b950633ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:16.642971 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0565b29a-99f4-49fb-a493-794b950633ca None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:16.660100 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-0565b29a-99f4-49fb-a493-794b950633ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:24:16.660100 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:24:16.660100 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:24:16.660100 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:24:16.660100 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:24:16.660100 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:24:16.660100 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:24:16.660100 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:24:16.660100 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:24:16.660100 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:24:16.660100 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:24:16.660100 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:24:16.660100 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:24:16.660100 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:24:16.660100 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:24:16.661012 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:24:16.661012 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:24:16.661012 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:24:16.661012 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:24:16.661012 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:24:16.661012 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:24:16.661012 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:24:16.661012 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:24:16.661012 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:24:16.661012 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:24:16.661012 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:24:16.661012 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:24:16.661012 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:24:16.661012 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:24:16.661012 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:24:16.661012 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:24:16.661012 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:24:16.661936 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:24:16.661936 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:24:16.661936 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:24:16.661936 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:24:16.661936 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 540/1073] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:24:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:24:16.667434 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d26d18e-45bb-4910-8da2-5052aa3c9dc0 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:16.758628 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:16.766008 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d26d18e-45bb-4910-8da2-5052aa3c9dc0 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:16.799670 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8a9f1-1196-42da-a085-544a014aac3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:16.800327 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8a9f1-1196-42da-a085-544a014aac3c None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:16.800601 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8a9f1-1196-42da-a085-544a014aac3c None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:16.800877 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8a9f1-1196-42da-a085-544a014aac3c None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:16.801627 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e8a9f1-1196-42da-a085-544a014aac3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:24:16.801934 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e8a9f1-1196-42da-a085-544a014aac3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:16.803286 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e8a9f1-1196-42da-a085-544a014aac3c None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:16.815590 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 534/1074] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:24:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:24:16.821800 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0565b29a-99f4-49fb-a493-794b950633ca None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:16.916207 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:16.922925 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0565b29a-99f4-49fb-a493-794b950633ca None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:16.959680 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec6491-2360-44dd-aa51-c96cb971c340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:16.960809 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec6491-2360-44dd-aa51-c96cb971c340 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:16.961278 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec6491-2360-44dd-aa51-c96cb971c340 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:16.961712 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec6491-2360-44dd-aa51-c96cb971c340 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:16.969346 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ec6491-2360-44dd-aa51-c96cb971c340 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:16.971521 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ec6491-2360-44dd-aa51-c96cb971c340 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:16.988369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-e2ec6491-2360-44dd-aa51-c96cb971c340 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:24:16.988369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:24:16.988369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:24:16.988369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:24:16.988369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:24:16.988369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:24:16.988369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:24:16.988369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:24:16.988369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:24:16.988369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:24:16.988369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:24:16.988369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:24:16.988369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:24:16.988369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:24:16.988369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:24:16.989308 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:24:16.989308 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:24:16.989308 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:24:16.989308 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:24:16.989308 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:24:16.989308 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:24:16.989308 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:24:16.989308 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:24:16.989308 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:24:16.989308 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:24:16.989308 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:24:16.989308 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:24:16.989308 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:24:16.989308 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:24:16.989308 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:24:16.989308 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:24:16.989308 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:24:16.990213 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:24:16.990213 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:24:16.990213 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:24:16.990213 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:24:16.990213 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:24:16.990213 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:24:16.990213 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:24:16.990213 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:24:16.990213 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 541/1075] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 10:24:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:24:16.996107 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8a9f1-1196-42da-a085-544a014aac3c None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:17.093681 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8a9f1-1196-42da-a085-544a014aac3c None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:17.128324 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5895b6fc-c2f1-47ea-8635-b25bb7e13ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:17.128990 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5895b6fc-c2f1-47ea-8635-b25bb7e13ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:17.129301 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5895b6fc-c2f1-47ea-8635-b25bb7e13ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:17.129578 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5895b6fc-c2f1-47ea-8635-b25bb7e13ea5 None admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:17.130365 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5895b6fc-c2f1-47ea-8635-b25bb7e13ea5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:24:17.130677 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5895b6fc-c2f1-47ea-8635-b25bb7e13ea5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:17.132093 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5895b6fc-c2f1-47ea-8635-b25bb7e13ea5 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:17.144358 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 535/1076] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 10:24:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:24:17.150467 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec6491-2360-44dd-aa51-c96cb971c340 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:17.248322 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec6491-2360-44dd-aa51-c96cb971c340 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:17.281267 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f513b-ae00-4fb1-8fa2-1684f97a84f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:17.282137 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f513b-ae00-4fb1-8fa2-1684f97a84f3 None admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:17.282417 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f513b-ae00-4fb1-8fa2-1684f97a84f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:17.282686 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f513b-ae00-4fb1-8fa2-1684f97a84f3 None admin] PATH_INFO: `/v3/projects/a6098fe56d304980aa14bd95b4b92c17/users/8bbebf16219943879df84bdc9a900516/roles/e5d4d6eee014413ea5c24c2b65d09652` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:17.284821 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07f513b-ae00-4fb1-8fa2-1684f97a84f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=a6098fe56d304980aa14bd95b4b92c17, user_id=8bbebf16219943879df84bdc9a900516, role_id=e5d4d6eee014413ea5c24c2b65d09652)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:17.286271 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07f513b-ae00-4fb1-8fa2-1684f97a84f3 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:17.358054 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 542/1077] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jul 18 10:24:17 2022] PUT /identity/v3/projects/a6098fe56d304980aa14bd95b4b92c17/users/8bbebf16219943879df84bdc9a900516/roles/e5d4d6eee014413ea5c24c2b65d09652 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:24:18.393606 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db515cb9-688a-4f55-a863-db1a510f6146 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:18.394116 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db515cb9-688a-4f55-a863-db1a510f6146 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:18.394116 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db515cb9-688a-4f55-a863-db1a510f6146 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:18.395451 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 536/1078] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:24:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:24:18.400792 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffba8cb-446b-45b2-bcc6-dce0540751be None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:18.401223 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffba8cb-446b-45b2-bcc6-dce0540751be None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:18.401628 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffba8cb-446b-45b2-bcc6-dce0540751be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:18.418315 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-2ffba8cb-446b-45b2-bcc6-dce0540751be None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:24:18.419496 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-2ffba8cb-446b-45b2-bcc6-dce0540751be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:24:18.428765 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:18.487980 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 543/1079] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:24:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:24:18.511213 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db515cb9-688a-4f55-a863-db1a510f6146 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:18.527436 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:18.613915 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db515cb9-688a-4f55-a863-db1a510f6146 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:18.649166 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4fe9fb-91fa-411b-8f18-4c1564dd5bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:18.649894 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fe9fb-91fa-411b-8f18-4c1564dd5bc1 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:18.650177 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fe9fb-91fa-411b-8f18-4c1564dd5bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:18.650454 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fe9fb-91fa-411b-8f18-4c1564dd5bc1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:18.660327 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4fe9fb-91fa-411b-8f18-4c1564dd5bc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:24:18.668559 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-aa4fe9fb-91fa-411b-8f18-4c1564dd5bc1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:24:18.668559 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:24:18.668559 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:24:18.668559 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:24:18.668559 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:24:18.668559 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:24:18.668559 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:24:18.668559 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:24:18.668559 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:24:18.668559 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:24:18.668559 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:24:18.668559 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:24:18.668559 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:24:18.668559 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:24:18.668559 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:24:18.668559 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:24:18.669503 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:24:18.669503 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:24:18.669503 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:24:18.669503 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:24:18.669503 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:24:18.669503 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:24:18.669503 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:24:18.669503 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:24:18.669503 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:24:18.669503 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:24:18.669503 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:24:18.669503 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:24:18.669503 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:24:18.669503 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:24:18.669503 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:24:18.669503 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:24:18.670375 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:24:18.670375 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:24:18.670375 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:24:18.670375 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:24:18.670375 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:24:18.670375 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:24:18.670375 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:24:18.670375 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:24:18.670375 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:24:18.670375 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:24:18.670375 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:24:18.670375 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:24:18.673180 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 537/1080] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 10:24:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:24:18.675696 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffba8cb-446b-45b2-bcc6-dce0540751be None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:18.771635 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffba8cb-446b-45b2-bcc6-dce0540751be None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:18.805395 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e96277-8b6e-437b-9e9c-d103c3634200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:18.806058 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e96277-8b6e-437b-9e9c-d103c3634200 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:18.806337 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e96277-8b6e-437b-9e9c-d103c3634200 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:18.806608 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e96277-8b6e-437b-9e9c-d103c3634200 None admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:18.807932 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e96277-8b6e-437b-9e9c-d103c3634200 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:24:18.808278 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e96277-8b6e-437b-9e9c-d103c3634200 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:18.809696 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e96277-8b6e-437b-9e9c-d103c3634200 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:18.817648 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 544/1081] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 10:24:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:24:18.823566 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4fe9fb-91fa-411b-8f18-4c1564dd5bc1 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:18.901657 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:18.927014 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4fe9fb-91fa-411b-8f18-4c1564dd5bc1 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:18.960100 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f6a661-1b80-4ee0-8c45-8db1788ab42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:18.960969 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6a661-1b80-4ee0-8c45-8db1788ab42a None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:18.961275 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6a661-1b80-4ee0-8c45-8db1788ab42a None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:18.961546 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6a661-1b80-4ee0-8c45-8db1788ab42a None admin] PATH_INFO: `/v3/users/91de9bd47e734f159aca4e85470cef5a` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:18.962724 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f6a661-1b80-4ee0-8c45-8db1788ab42a None admin] RBAC: Authorizing `identity:get_user(user_id=91de9bd47e734f159aca4e85470cef5a)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:18.964754 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f6a661-1b80-4ee0-8c45-8db1788ab42a None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:18.966647 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 538/1082] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 10:24:18 2022] GET /identity/v3/users/91de9bd47e734f159aca4e85470cef5a => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:24:18.972385 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e96277-8b6e-437b-9e9c-d103c3634200 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:18.982538 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:19.073836 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e96277-8b6e-437b-9e9c-d103c3634200 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:19.107563 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2d1b09-72d1-471a-94c5-cb4057006c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:19.108432 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d1b09-72d1-471a-94c5-cb4057006c16 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:19.108715 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d1b09-72d1-471a-94c5-cb4057006c16 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:19.108985 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d1b09-72d1-471a-94c5-cb4057006c16 None admin] PATH_INFO: `/v3/projects/d2490aa6415e41d69422ae0398e4b3b7` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:19.110175 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2d1b09-72d1-471a-94c5-cb4057006c16 None admin] RBAC: Authorizing `identity:get_project(project_id=d2490aa6415e41d69422ae0398e4b3b7)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:19.111871 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2d1b09-72d1-471a-94c5-cb4057006c16 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:19.113607 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 545/1083] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 10:24:18 2022] GET /identity/v3/projects/d2490aa6415e41d69422ae0398e4b3b7 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:24:19.119705 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f6a661-1b80-4ee0-8c45-8db1788ab42a None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:19.218114 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f6a661-1b80-4ee0-8c45-8db1788ab42a None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:19.251316 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e6dea-cd15-4229-857e-5f4345395869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:19.252196 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e6dea-cd15-4229-857e-5f4345395869 None admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:19.252474 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e6dea-cd15-4229-857e-5f4345395869 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:19.252747 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e6dea-cd15-4229-857e-5f4345395869 None admin] PATH_INFO: `/v3/projects/d2490aa6415e41d69422ae0398e4b3b7/users/91de9bd47e734f159aca4e85470cef5a/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:19.254708 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7e6dea-cd15-4229-857e-5f4345395869 None admin] RBAC: Authorizing `identity:create_grant(project_id=d2490aa6415e41d69422ae0398e4b3b7, user_id=91de9bd47e734f159aca4e85470cef5a, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:19.256125 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7e6dea-cd15-4229-857e-5f4345395869 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:19.352423 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 539/1084] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jul 18 10:24:19 2022] PUT /identity/v3/projects/d2490aa6415e41d69422ae0398e4b3b7/users/91de9bd47e734f159aca4e85470cef5a/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:24:19.363164 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf2fa8-555a-483b-8235-6ebb971937c1 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:19.363452 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf2fa8-555a-483b-8235-6ebb971937c1 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:19.363730 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf2fa8-555a-483b-8235-6ebb971937c1 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:19.365203 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 546/1085] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:24:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:24:19.371724 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be88512-623a-4b81-ba65-1a340914449f None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:19.372010 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be88512-623a-4b81-ba65-1a340914449f None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:19.372289 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be88512-623a-4b81-ba65-1a340914449f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:19.377776 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:19.391098 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-9be88512-623a-4b81-ba65-1a340914449f None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:24:19.392349 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-9be88512-623a-4b81-ba65-1a340914449f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:24:19.466112 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 540/1086] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:24:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:24:19.490959 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf2fa8-555a-483b-8235-6ebb971937c1 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:19.570992 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:19.595690 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf2fa8-555a-483b-8235-6ebb971937c1 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:19.632292 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d823db-7023-4052-a999-5b57afc523d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:19.633145 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d823db-7023-4052-a999-5b57afc523d5 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:19.633432 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d823db-7023-4052-a999-5b57afc523d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:19.633708 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d823db-7023-4052-a999-5b57afc523d5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:19.643743 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d823db-7023-4052-a999-5b57afc523d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:24:19.652526 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-80d823db-7023-4052-a999-5b57afc523d5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 10:24:19.652526 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:24:19.652526 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:24:19.652526 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:24:19.652526 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:24:19.652526 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:24:19.652526 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:24:19.652526 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:24:19.652526 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:24:19.652526 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:24:19.652526 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:24:19.652526 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:24:19.652526 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:24:19.652526 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:24:19.652526 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:24:19.652526 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:24:19.653636 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:24:19.653636 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:24:19.653636 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:24:19.653636 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:24:19.653636 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:24:19.653636 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:24:19.653636 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:24:19.653636 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:24:19.653636 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:24:19.653636 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:24:19.653636 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:24:19.653636 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:24:19.653636 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:24:19.653636 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:24:19.653636 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:24:19.653636 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:24:19.654606 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:24:19.654606 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:24:19.654606 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:24:19.654606 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:24:19.654606 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:24:19.654606 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:24:19.654606 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:24:19.654606 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:24:19.654606 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:24:19.654606 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:24:19.654606 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 10:24:19.654606 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:24:19.654606 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 547/1087] 10.222.0.39 () {56 vars in 1120 bytes} [Mon Jul 18 10:24:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:24:19.659875 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be88512-623a-4b81-ba65-1a340914449f None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:19.755817 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be88512-623a-4b81-ba65-1a340914449f None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:19.784351 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:19.789178 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ca0452-13fb-467e-80ae-9946f3973125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:19.789842 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca0452-13fb-467e-80ae-9946f3973125 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:19.790120 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca0452-13fb-467e-80ae-9946f3973125 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:19.790393 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca0452-13fb-467e-80ae-9946f3973125 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:19.791128 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ca0452-13fb-467e-80ae-9946f3973125 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:24:19.791431 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ca0452-13fb-467e-80ae-9946f3973125 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:19.793501 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ca0452-13fb-467e-80ae-9946f3973125 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:19.801437 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 541/1088] 10.222.0.39 () {56 vars in 1115 bytes} [Mon Jul 18 10:24:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:24:19.807601 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d823db-7023-4052-a999-5b57afc523d5 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:19.907695 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d823db-7023-4052-a999-5b57afc523d5 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:19.942145 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4727ddc-10e2-4d9b-a37a-1a3fc02d5f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:19.942936 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4727ddc-10e2-4d9b-a37a-1a3fc02d5f30 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:19.943221 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4727ddc-10e2-4d9b-a37a-1a3fc02d5f30 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:19.943498 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4727ddc-10e2-4d9b-a37a-1a3fc02d5f30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:19.945446 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:19.954892 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4727ddc-10e2-4d9b-a37a-1a3fc02d5f30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:19.956391 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4727ddc-10e2-4d9b-a37a-1a3fc02d5f30 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:19.974677 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-e4727ddc-10e2-4d9b-a37a-1a3fc02d5f30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:24:19.974677 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:24:19.974677 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:24:19.974677 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:24:19.974677 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:24:19.974677 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:24:19.974677 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:24:19.974677 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:24:19.974677 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:24:19.974677 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:24:19.974677 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:24:19.974677 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:24:19.974677 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:24:19.974677 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:24:19.974677 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:24:19.975699 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:24:19.975699 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:24:19.975699 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:24:19.975699 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:24:19.975699 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:24:19.975699 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:24:19.975699 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:24:19.975699 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:24:19.975699 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:24:19.975699 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:24:19.975699 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:24:19.975699 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:24:19.975699 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:24:19.975699 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:24:19.975699 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:24:19.975699 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:24:19.975699 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:24:19.976577 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:24:19.976577 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:24:19.976577 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:24:19.976577 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:24:19.976577 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 548/1089] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:24:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:24:19.982828 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ca0452-13fb-467e-80ae-9946f3973125 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:20.081006 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ca0452-13fb-467e-80ae-9946f3973125 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:20.116564 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c244673e-a3c2-4435-8016-d20120d398c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:20.117260 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244673e-a3c2-4435-8016-d20120d398c6 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:20.117537 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244673e-a3c2-4435-8016-d20120d398c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:20.117808 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244673e-a3c2-4435-8016-d20120d398c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:20.118516 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c244673e-a3c2-4435-8016-d20120d398c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:24:20.118817 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c244673e-a3c2-4435-8016-d20120d398c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:20.120318 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c244673e-a3c2-4435-8016-d20120d398c6 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:20.131871 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 542/1090] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:24:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:24:20.138065 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4727ddc-10e2-4d9b-a37a-1a3fc02d5f30 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:20.234039 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4727ddc-10e2-4d9b-a37a-1a3fc02d5f30 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:20.266766 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca00d478-0e2e-4947-b06c-ab83041f168a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:20.267538 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00d478-0e2e-4947-b06c-ab83041f168a None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:20.267818 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00d478-0e2e-4947-b06c-ab83041f168a None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:20.268091 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00d478-0e2e-4947-b06c-ab83041f168a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:20.275289 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca00d478-0e2e-4947-b06c-ab83041f168a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:20.276949 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca00d478-0e2e-4947-b06c-ab83041f168a None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:20.290481 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-ca00d478-0e2e-4947-b06c-ab83041f168a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 10:24:20.290481 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:24:20.290481 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:24:20.290481 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:24:20.290481 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:24:20.290481 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:24:20.290481 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:24:20.290481 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:24:20.290481 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:24:20.290481 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:24:20.290481 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:24:20.290481 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:24:20.290481 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:24:20.290481 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:24:20.290481 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:24:20.290481 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:24:20.292074 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:24:20.292074 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:24:20.292074 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:24:20.292074 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:24:20.292074 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:24:20.292074 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:24:20.292074 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:24:20.292074 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:24:20.292074 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:24:20.292074 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:24:20.292074 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:24:20.292074 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:24:20.292074 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:24:20.292074 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:24:20.292074 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:24:20.292074 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:24:20.292074 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:24:20.292074 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:24:20.293497 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:24:20.293497 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:24:20.293497 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:24:20.293497 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:24:20.293497 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:24:20.293497 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:24:20.293497 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:24:20.293497 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:24:20.293497 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 10:24:20.293497 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:24:20.293497 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 549/1091] 10.222.0.39 () {56 vars in 1093 bytes} [Mon Jul 18 10:24:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:24:20.297959 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c244673e-a3c2-4435-8016-d20120d398c6 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:20.352307 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:20.395722 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c244673e-a3c2-4435-8016-d20120d398c6 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:20.428658 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cd7bd6-371b-4986-9f30-b409eb887287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:20.429353 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd7bd6-371b-4986-9f30-b409eb887287 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:20.429633 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd7bd6-371b-4986-9f30-b409eb887287 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:20.429907 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd7bd6-371b-4986-9f30-b409eb887287 None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:20.430725 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cd7bd6-371b-4986-9f30-b409eb887287 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:24:20.431031 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cd7bd6-371b-4986-9f30-b409eb887287 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:20.433021 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cd7bd6-371b-4986-9f30-b409eb887287 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:20.450909 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 543/1092] 10.222.0.39 () {56 vars in 1133 bytes} [Mon Jul 18 10:24:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:24:20.456906 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca00d478-0e2e-4947-b06c-ab83041f168a None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:20.504554 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:20.556899 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca00d478-0e2e-4947-b06c-ab83041f168a None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:20.589971 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b591644-f81e-4430-b01f-5f4879cefd2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:20.590616 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b591644-f81e-4430-b01f-5f4879cefd2d None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:20.590895 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b591644-f81e-4430-b01f-5f4879cefd2d None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:20.591166 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b591644-f81e-4430-b01f-5f4879cefd2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:20.655644 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b591644-f81e-4430-b01f-5f4879cefd2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:20.657021 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b591644-f81e-4430-b01f-5f4879cefd2d None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:20.699828 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:20.752117 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 550/1093] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 10:24:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 10:24:20.757962 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cd7bd6-371b-4986-9f30-b409eb887287 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:20.856397 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cd7bd6-371b-4986-9f30-b409eb887287 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:20.871164 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:20.891738 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a579bb-6312-4719-8883-299c176862d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:20.892537 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a579bb-6312-4719-8883-299c176862d1 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:20.892821 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a579bb-6312-4719-8883-299c176862d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:20.893127 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a579bb-6312-4719-8883-299c176862d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:20.903368 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a579bb-6312-4719-8883-299c176862d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:20.904807 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a579bb-6312-4719-8883-299c176862d1 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:20.923448 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-90a579bb-6312-4719-8883-299c176862d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:24:20.923448 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:24:20.923448 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:24:20.923448 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:24:20.923448 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:24:20.923448 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:24:20.923448 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:24:20.923448 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:24:20.923448 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:24:20.923448 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:24:20.923448 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:24:20.923448 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:24:20.923448 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:24:20.923448 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:24:20.923448 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:24:20.924394 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:24:20.924394 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:24:20.924394 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:24:20.924394 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:24:20.924394 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:24:20.924394 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:24:20.924394 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:24:20.924394 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:24:20.924394 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:24:20.924394 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:24:20.924394 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:24:20.924394 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:24:20.924394 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:24:20.924394 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:24:20.924394 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:24:20.924394 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:24:20.924394 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:24:20.925333 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:24:20.925333 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:24:20.925333 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:24:20.925333 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:24:20.925333 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 544/1094] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:24:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:24:20.930458 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b591644-f81e-4430-b01f-5f4879cefd2d None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:21.034453 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b591644-f81e-4430-b01f-5f4879cefd2d None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:21.069523 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038349a8-8336-4e13-91c3-db52a9b76469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:21.070192 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038349a8-8336-4e13-91c3-db52a9b76469 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:21.070476 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038349a8-8336-4e13-91c3-db52a9b76469 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:21.070751 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038349a8-8336-4e13-91c3-db52a9b76469 None admin] PATH_INFO: `/v3/domains` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:21.071482 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038349a8-8336-4e13-91c3-db52a9b76469 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:24:21.071793 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038349a8-8336-4e13-91c3-db52a9b76469 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:21.073241 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038349a8-8336-4e13-91c3-db52a9b76469 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:21.084544 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 551/1095] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:24:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:24:21.091603 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a579bb-6312-4719-8883-299c176862d1 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:21.191926 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a579bb-6312-4719-8883-299c176862d1 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:21.225979 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a2cb71-2567-4c7b-876b-c496363f5c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:21.226763 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a2cb71-2567-4c7b-876b-c496363f5c0a None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:21.227040 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a2cb71-2567-4c7b-876b-c496363f5c0a None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:21.227314 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a2cb71-2567-4c7b-876b-c496363f5c0a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:21.234765 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a2cb71-2567-4c7b-876b-c496363f5c0a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:21.236451 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a2cb71-2567-4c7b-876b-c496363f5c0a None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:21.250181 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-51a2cb71-2567-4c7b-876b-c496363f5c0a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:24:21.250181 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:24:21.250181 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:24:21.250181 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:24:21.250181 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:24:21.250181 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:24:21.250181 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:24:21.250181 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:24:21.250181 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:24:21.250181 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:24:21.250181 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:24:21.250181 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:24:21.250181 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:24:21.250181 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:24:21.250181 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:24:21.251215 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:24:21.251215 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:24:21.251215 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:24:21.251215 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:24:21.251215 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:24:21.251215 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:24:21.251215 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:24:21.251215 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:24:21.251215 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:24:21.251215 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:24:21.251215 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:24:21.251215 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:24:21.251215 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:24:21.251215 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:24:21.251215 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:24:21.251215 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:24:21.251215 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:24:21.252295 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:24:21.252295 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:24:21.252295 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:24:21.252295 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:24:21.252295 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:24:21.252295 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:24:21.252295 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:24:21.252295 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:24:21.252295 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 545/1096] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 10:24:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:24:21.257149 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038349a8-8336-4e13-91c3-db52a9b76469 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:21.266444 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:21.358043 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038349a8-8336-4e13-91c3-db52a9b76469 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:21.381754 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d3c6c-3e6a-4bbd-93c6-4de0413ad30b None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:21.382044 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d3c6c-3e6a-4bbd-93c6-4de0413ad30b None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:21.382331 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d3c6c-3e6a-4bbd-93c6-4de0413ad30b None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:21.383711 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 546/1097] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:24:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:24:21.388662 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f6a309-7e10-4c00-b16d-6e518c5f2fc4 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:21.388949 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f6a309-7e10-4c00-b16d-6e518c5f2fc4 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:21.389328 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f6a309-7e10-4c00-b16d-6e518c5f2fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:21.390835 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9325974-c0ad-42a5-a6de-36ac074165f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:21.391491 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9325974-c0ad-42a5-a6de-36ac074165f3 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:21.391771 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9325974-c0ad-42a5-a6de-36ac074165f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:21.392044 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9325974-c0ad-42a5-a6de-36ac074165f3 None admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:21.392819 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9325974-c0ad-42a5-a6de-36ac074165f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:24:21.393150 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9325974-c0ad-42a5-a6de-36ac074165f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:21.394563 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9325974-c0ad-42a5-a6de-36ac074165f3 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:21.406307 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-24f6a309-7e10-4c00-b16d-6e518c5f2fc4 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:24:21.407142 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 552/1098] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 10:24:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:24:21.407515 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-24f6a309-7e10-4c00-b16d-6e518c5f2fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:24:21.413195 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9325974-c0ad-42a5-a6de-36ac074165f3 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:21.425766 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:21.474992 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 547/1099] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:24:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 10:24:21.480497 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:21.499105 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f6a309-7e10-4c00-b16d-6e518c5f2fc4 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:21.515368 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9325974-c0ad-42a5-a6de-36ac074165f3 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:21.550080 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d88b5-9f4b-4394-a74e-f46de8282a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:21.550730 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d88b5-9f4b-4394-a74e-f46de8282a8d None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:21.551015 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d88b5-9f4b-4394-a74e-f46de8282a8d None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:21.551286 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d88b5-9f4b-4394-a74e-f46de8282a8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:21.552102 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0d88b5-9f4b-4394-a74e-f46de8282a8d None admin] RBAC: Adding query filter params (role.id=e5d4d6eee014413ea5c24c2b65d09652, scope.project.id=a6098fe56d304980aa14bd95b4b92c17, user.id=8bbebf16219943879df84bdc9a900516) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:24:21.552411 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0d88b5-9f4b-4394-a74e-f46de8282a8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:21.553859 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0d88b5-9f4b-4394-a74e-f46de8282a8d None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:21.559990 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 553/1100] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 10:24:21 2022] GET /identity/v3/role_assignments?user.id=8bbebf16219943879df84bdc9a900516&scope.project.id=a6098fe56d304980aa14bd95b4b92c17&role.id=e5d4d6eee014413ea5c24c2b65d09652 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:24:21.602291 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f6a309-7e10-4c00-b16d-6e518c5f2fc4 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:21.640471 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b6682e-4295-429b-a206-d38bd91239a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:21.641321 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b6682e-4295-429b-a206-d38bd91239a4 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:21.641603 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b6682e-4295-429b-a206-d38bd91239a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:21.641877 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b6682e-4295-429b-a206-d38bd91239a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:21.653458 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b6682e-4295-429b-a206-d38bd91239a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:24:21.661321 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-f6b6682e-4295-429b-a206-d38bd91239a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:24:21.661321 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:24:21.661321 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:24:21.661321 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:24:21.661321 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:24:21.661321 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:24:21.661321 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:24:21.661321 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:24:21.661321 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:24:21.661321 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:24:21.661321 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:24:21.661321 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:24:21.661321 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:24:21.661321 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:24:21.661321 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:24:21.661321 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:24:21.662464 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:24:21.662464 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:24:21.662464 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:24:21.662464 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:24:21.662464 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:24:21.662464 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:24:21.662464 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:24:21.662464 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:24:21.662464 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:24:21.662464 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:24:21.662464 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:24:21.662464 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:24:21.662464 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:24:21.662464 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:24:21.662464 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:24:21.662464 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:24:21.663328 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:24:21.663328 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:24:21.663328 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:24:21.663328 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:24:21.663328 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:24:21.663328 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:24:21.663328 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:24:21.663328 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:24:21.663328 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:24:21.663328 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:24:21.663328 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:24:21.663328 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:24:21.663328 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 548/1101] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 10:24:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:24:21.669638 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d88b5-9f4b-4394-a74e-f46de8282a8d None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:21.775376 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d88b5-9f4b-4394-a74e-f46de8282a8d None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:21.804006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:21.810029 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3304afd8-347c-41b3-a11d-415bfdfcc03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:21.810704 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3304afd8-347c-41b3-a11d-415bfdfcc03d None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:21.810992 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3304afd8-347c-41b3-a11d-415bfdfcc03d None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:21.811272 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3304afd8-347c-41b3-a11d-415bfdfcc03d None admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:21.812030 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3304afd8-347c-41b3-a11d-415bfdfcc03d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:24:21.812336 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3304afd8-347c-41b3-a11d-415bfdfcc03d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:21.813757 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3304afd8-347c-41b3-a11d-415bfdfcc03d None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:21.822112 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 554/1102] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 10:24:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:24:21.828792 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b6682e-4295-429b-a206-d38bd91239a4 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:21.846379 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:21.932003 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b6682e-4295-429b-a206-d38bd91239a4 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:21.968479 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffa16c9-b6a9-4890-b2a6-65bfc926912f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:21.969391 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa16c9-b6a9-4890-b2a6-65bfc926912f None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:21.969680 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa16c9-b6a9-4890-b2a6-65bfc926912f None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:21.969962 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffa16c9-b6a9-4890-b2a6-65bfc926912f None admin] PATH_INFO: `/v3/users/91de9bd47e734f159aca4e85470cef5a` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:21.971191 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffa16c9-b6a9-4890-b2a6-65bfc926912f None admin] RBAC: Authorizing `identity:get_user(user_id=91de9bd47e734f159aca4e85470cef5a)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:21.972619 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffa16c9-b6a9-4890-b2a6-65bfc926912f None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:21.974358 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 549/1103] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 10:24:21 2022] GET /identity/v3/users/91de9bd47e734f159aca4e85470cef5a => generated 285 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:24:21.980497 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3304afd8-347c-41b3-a11d-415bfdfcc03d None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:22.084374 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3304afd8-347c-41b3-a11d-415bfdfcc03d None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:22.120241 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25142259-4d54-46ee-b980-f59ece41ec8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:22.120994 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25142259-4d54-46ee-b980-f59ece41ec8b None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:22.121318 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25142259-4d54-46ee-b980-f59ece41ec8b None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:22.121601 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25142259-4d54-46ee-b980-f59ece41ec8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:22.180303 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:22.190180 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25142259-4d54-46ee-b980-f59ece41ec8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:22.191644 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25142259-4d54-46ee-b980-f59ece41ec8b None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:22.293582 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 555/1104] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 10:24:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 10:24:22.299447 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffa16c9-b6a9-4890-b2a6-65bfc926912f None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:22.382486 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:22.400227 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffa16c9-b6a9-4890-b2a6-65bfc926912f None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:22.436914 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec0cffb-76e9-4228-a135-79d6d6bec87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:22.437830 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0cffb-76e9-4228-a135-79d6d6bec87d None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:22.438107 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0cffb-76e9-4228-a135-79d6d6bec87d None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:22.438376 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec0cffb-76e9-4228-a135-79d6d6bec87d None admin] PATH_INFO: `/v3/projects/d2490aa6415e41d69422ae0398e4b3b7` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:22.439527 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec0cffb-76e9-4228-a135-79d6d6bec87d None admin] RBAC: Authorizing `identity:get_project(project_id=d2490aa6415e41d69422ae0398e4b3b7)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:22.440932 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec0cffb-76e9-4228-a135-79d6d6bec87d None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:22.442656 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 550/1105] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 10:24:22 2022] GET /identity/v3/projects/d2490aa6415e41d69422ae0398e4b3b7 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:24:22.449714 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25142259-4d54-46ee-b980-f59ece41ec8b None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:22.537709 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:22.546388 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25142259-4d54-46ee-b980-f59ece41ec8b None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:22.579414 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c08b7-f375-45ee-a5f7-af7a07c409ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:22.580048 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c08b7-f375-45ee-a5f7-af7a07c409ec None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:22.580328 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c08b7-f375-45ee-a5f7-af7a07c409ec None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:22.580601 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c08b7-f375-45ee-a5f7-af7a07c409ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:22.581447 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08c08b7-f375-45ee-a5f7-af7a07c409ec None admin] RBAC: Adding query filter params (role.id=e7b6a55ecf6c491487955aaefbf9c388, scope.project.id=d2490aa6415e41d69422ae0398e4b3b7, user.id=91de9bd47e734f159aca4e85470cef5a) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:24:22.581755 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08c08b7-f375-45ee-a5f7-af7a07c409ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:22.583161 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08c08b7-f375-45ee-a5f7-af7a07c409ec None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:22.589566 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 556/1106] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 10:24:22 2022] GET /identity/v3/role_assignments?user.id=91de9bd47e734f159aca4e85470cef5a&scope.project.id=d2490aa6415e41d69422ae0398e4b3b7&role.id=e7b6a55ecf6c491487955aaefbf9c388 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:24:24.590871 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67b95b-23a1-447a-825b-5bbbf80d8b9d None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:24.591433 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67b95b-23a1-447a-825b-5bbbf80d8b9d None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:24.591433 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea67b95b-23a1-447a-825b-5bbbf80d8b9d None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:24.592775 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 551/1107] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:24:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:24:24.598261 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7c094-8f97-46ba-8acb-b05c10b52362 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:24.598657 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7c094-8f97-46ba-8acb-b05c10b52362 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:24.598814 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7c094-8f97-46ba-8acb-b05c10b52362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:24.616435 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-cdc7c094-8f97-46ba-8acb-b05c10b52362 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:24:24.617684 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-cdc7c094-8f97-46ba-8acb-b05c10b52362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:24:24.682993 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 557/1108] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:24:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:24:24.707968 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea67b95b-23a1-447a-825b-5bbbf80d8b9d None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:24.808103 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea67b95b-23a1-447a-825b-5bbbf80d8b9d None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:24.840255 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb04671-dad2-4675-85f0-8abd553f5cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:24.841110 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb04671-dad2-4675-85f0-8abd553f5cf3 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:24.841346 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb04671-dad2-4675-85f0-8abd553f5cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:24.841621 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb04671-dad2-4675-85f0-8abd553f5cf3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:24.842811 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb04671-dad2-4675-85f0-8abd553f5cf3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:24.844233 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb04671-dad2-4675-85f0-8abd553f5cf3 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:24.845869 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 552/1109] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:24:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:24:24.851606 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc7c094-8f97-46ba-8acb-b05c10b52362 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:24.933576 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:24.947652 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc7c094-8f97-46ba-8acb-b05c10b52362 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:24.982274 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6cc7f-59ae-477d-8885-ef882638e219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:24.982940 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6cc7f-59ae-477d-8885-ef882638e219 None admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:24.983221 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6cc7f-59ae-477d-8885-ef882638e219 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:24.983492 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6cc7f-59ae-477d-8885-ef882638e219 None admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:24.984190 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e6cc7f-59ae-477d-8885-ef882638e219 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:24.985955 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e6cc7f-59ae-477d-8885-ef882638e219 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:25.095088 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 558/1110] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Jul 18 10:24:24 2022] POST /identity/v3/users => generated 286 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:24:27.152038 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd17ae3-9992-4ae2-9251-c27047252974 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:27.152554 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd17ae3-9992-4ae2-9251-c27047252974 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:27.152554 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd17ae3-9992-4ae2-9251-c27047252974 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:27.153948 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 553/1111] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:24:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:24:27.159022 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd700a4-2bcd-4668-8e77-93b4aefd5865 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:27.159463 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd700a4-2bcd-4668-8e77-93b4aefd5865 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:27.159562 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd700a4-2bcd-4668-8e77-93b4aefd5865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:27.177775 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-7fd700a4-2bcd-4668-8e77-93b4aefd5865 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:24:27.178996 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-7fd700a4-2bcd-4668-8e77-93b4aefd5865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:24:27.244556 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 559/1112] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:24:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:24:27.267218 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd17ae3-9992-4ae2-9251-c27047252974 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:27.286631 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:27.368536 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd17ae3-9992-4ae2-9251-c27047252974 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:27.401867 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32836c98-6a49-4a88-aa74-abb3648cfea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:27.402708 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32836c98-6a49-4a88-aa74-abb3648cfea4 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:27.402983 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32836c98-6a49-4a88-aa74-abb3648cfea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:27.403252 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32836c98-6a49-4a88-aa74-abb3648cfea4 None admin] PATH_INFO: `/v3/roles/45f8992b0f6941c7a64290b437d6bd5e` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:27.404688 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32836c98-6a49-4a88-aa74-abb3648cfea4 None admin] RBAC: Authorizing `identity:get_role(role_id=45f8992b0f6941c7a64290b437d6bd5e)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:27.406071 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32836c98-6a49-4a88-aa74-abb3648cfea4 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:27.407412 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 554/1113] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 10:24:27 2022] GET /identity/v3/roles/45f8992b0f6941c7a64290b437d6bd5e => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:24:27.413372 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd700a4-2bcd-4668-8e77-93b4aefd5865 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:27.480005 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:27.508527 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd700a4-2bcd-4668-8e77-93b4aefd5865 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:27.542513 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b49a1-089c-40ff-be82-3083024a1de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:27.543593 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b49a1-089c-40ff-be82-3083024a1de9 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:27.544066 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b49a1-089c-40ff-be82-3083024a1de9 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:27.544813 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b49a1-089c-40ff-be82-3083024a1de9 None admin] PATH_INFO: `/v3/users/ad2c38faeca7461a9b4a146643abec9a` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:27.558548 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b49a1-089c-40ff-be82-3083024a1de9 None admin] RBAC: Authorizing `identity:get_user(user_id=ad2c38faeca7461a9b4a146643abec9a)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:27.559981 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b49a1-089c-40ff-be82-3083024a1de9 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:27.561660 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 560/1114] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 10:24:27 2022] GET /identity/v3/users/ad2c38faeca7461a9b4a146643abec9a => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:24:27.567319 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32836c98-6a49-4a88-aa74-abb3648cfea4 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:27.648963 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:27.663747 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32836c98-6a49-4a88-aa74-abb3648cfea4 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:27.695931 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c7f52-9fb2-490d-9a47-d69ff162d860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:27.696559 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c7f52-9fb2-490d-9a47-d69ff162d860 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:27.696835 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c7f52-9fb2-490d-9a47-d69ff162d860 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:27.697131 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c7f52-9fb2-490d-9a47-d69ff162d860 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:27.762093 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4c7f52-9fb2-490d-9a47-d69ff162d860 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:27.763511 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4c7f52-9fb2-490d-9a47-d69ff162d860 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:27.843121 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:27.857881 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 555/1115] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 10:24:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 10:24:27.863912 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b49a1-089c-40ff-be82-3083024a1de9 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:27.962808 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b49a1-089c-40ff-be82-3083024a1de9 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:27.988610 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:27.994219 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fccade-8bcf-44ce-999c-fadde9d0d98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:28.006447 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fccade-8bcf-44ce-999c-fadde9d0d98e None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:28.006447 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fccade-8bcf-44ce-999c-fadde9d0d98e None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:28.006447 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fccade-8bcf-44ce-999c-fadde9d0d98e None admin] PATH_INFO: `/v3/projects/d2490aa6415e41d69422ae0398e4b3b7` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:28.006447 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fccade-8bcf-44ce-999c-fadde9d0d98e None admin] RBAC: Authorizing `identity:get_project(project_id=d2490aa6415e41d69422ae0398e4b3b7)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:28.006447 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fccade-8bcf-44ce-999c-fadde9d0d98e None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:28.006447 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 561/1116] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 10:24:27 2022] GET /identity/v3/projects/d2490aa6415e41d69422ae0398e4b3b7 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:24:28.006994 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c7f52-9fb2-490d-9a47-d69ff162d860 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:28.123642 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c7f52-9fb2-490d-9a47-d69ff162d860 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:28.156304 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb5e97d-41cc-4925-8682-a6df06525ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:28.163425 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5e97d-41cc-4925-8682-a6df06525ccd None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:28.163425 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5e97d-41cc-4925-8682-a6df06525ccd None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:28.163425 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5e97d-41cc-4925-8682-a6df06525ccd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:28.163425 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb5e97d-41cc-4925-8682-a6df06525ccd None admin] RBAC: Adding query filter params (role.id=45f8992b0f6941c7a64290b437d6bd5e, scope.project.id=d2490aa6415e41d69422ae0398e4b3b7, user.id=ad2c38faeca7461a9b4a146643abec9a) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:24:28.163425 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb5e97d-41cc-4925-8682-a6df06525ccd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:28.163425 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb5e97d-41cc-4925-8682-a6df06525ccd None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:28.165567 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 556/1117] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 10:24:28 2022] GET /identity/v3/role_assignments?user.id=ad2c38faeca7461a9b4a146643abec9a&scope.project.id=d2490aa6415e41d69422ae0398e4b3b7&role.id=45f8992b0f6941c7a64290b437d6bd5e => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:24:30.144319 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa7d73-d602-44ca-bc10-f89502f99c9b None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:30.144799 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa7d73-d602-44ca-bc10-f89502f99c9b None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:30.144900 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa7d73-d602-44ca-bc10-f89502f99c9b None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:30.146282 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 562/1118] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:24:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:24:30.152043 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880093f0-9b88-43b0-93c5-595a5dca9033 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:30.152481 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880093f0-9b88-43b0-93c5-595a5dca9033 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:30.152587 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880093f0-9b88-43b0-93c5-595a5dca9033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:30.170107 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-880093f0-9b88-43b0-93c5-595a5dca9033 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:24:30.171278 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-880093f0-9b88-43b0-93c5-595a5dca9033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:24:30.215049 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:30.235389 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 557/1119] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:24:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:24:30.258344 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaa7d73-d602-44ca-bc10-f89502f99c9b None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:30.358990 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaa7d73-d602-44ca-bc10-f89502f99c9b None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:30.392704 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f62c4f1-34c4-49e9-bcdb-4111ae6bd356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:30.393578 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62c4f1-34c4-49e9-bcdb-4111ae6bd356 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:30.393861 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62c4f1-34c4-49e9-bcdb-4111ae6bd356 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:30.394131 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62c4f1-34c4-49e9-bcdb-4111ae6bd356 None admin] PATH_INFO: `/v3/roles/45f8992b0f6941c7a64290b437d6bd5e` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:30.395599 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f62c4f1-34c4-49e9-bcdb-4111ae6bd356 None admin] RBAC: Authorizing `identity:get_role(role_id=45f8992b0f6941c7a64290b437d6bd5e)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:30.396951 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f62c4f1-34c4-49e9-bcdb-4111ae6bd356 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:30.398359 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 563/1120] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 10:24:30 2022] GET /identity/v3/roles/45f8992b0f6941c7a64290b437d6bd5e => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:24:30.404363 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880093f0-9b88-43b0-93c5-595a5dca9033 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:30.499485 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880093f0-9b88-43b0-93c5-595a5dca9033 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:30.532046 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54900931-6f60-4840-937e-b6a42edbc7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:30.532898 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54900931-6f60-4840-937e-b6a42edbc7e0 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:30.533202 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54900931-6f60-4840-937e-b6a42edbc7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:30.533474 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54900931-6f60-4840-937e-b6a42edbc7e0 None admin] PATH_INFO: `/v3/users/ad2c38faeca7461a9b4a146643abec9a` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:30.534626 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54900931-6f60-4840-937e-b6a42edbc7e0 None admin] RBAC: Authorizing `identity:get_user(user_id=ad2c38faeca7461a9b4a146643abec9a)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:30.536032 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54900931-6f60-4840-937e-b6a42edbc7e0 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:30.537686 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 558/1121] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 10:24:30 2022] GET /identity/v3/users/ad2c38faeca7461a9b4a146643abec9a => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:24:30.543922 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f62c4f1-34c4-49e9-bcdb-4111ae6bd356 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:30.606918 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:30.640218 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f62c4f1-34c4-49e9-bcdb-4111ae6bd356 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:30.672599 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb0cf7a-3580-45b6-96ba-abf4106298f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:30.673466 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0cf7a-3580-45b6-96ba-abf4106298f1 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:30.673748 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0cf7a-3580-45b6-96ba-abf4106298f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:30.674021 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0cf7a-3580-45b6-96ba-abf4106298f1 None admin] PATH_INFO: `/v3/projects/d2490aa6415e41d69422ae0398e4b3b7` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:30.675164 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb0cf7a-3580-45b6-96ba-abf4106298f1 None admin] RBAC: Authorizing `identity:get_project(project_id=d2490aa6415e41d69422ae0398e4b3b7)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:30.676574 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb0cf7a-3580-45b6-96ba-abf4106298f1 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:30.678265 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 564/1122] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 10:24:30 2022] GET /identity/v3/projects/d2490aa6415e41d69422ae0398e4b3b7 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:24:30.685233 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54900931-6f60-4840-937e-b6a42edbc7e0 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:30.732881 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:30.783134 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54900931-6f60-4840-937e-b6a42edbc7e0 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:30.816423 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a961b738-b894-4c15-9089-3893acdc6f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:30.817347 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961b738-b894-4c15-9089-3893acdc6f16 None admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:30.817631 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961b738-b894-4c15-9089-3893acdc6f16 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:30.817904 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961b738-b894-4c15-9089-3893acdc6f16 None admin] PATH_INFO: `/v3/projects/d2490aa6415e41d69422ae0398e4b3b7/users/ad2c38faeca7461a9b4a146643abec9a/roles/45f8992b0f6941c7a64290b437d6bd5e` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:30.820086 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a961b738-b894-4c15-9089-3893acdc6f16 None admin] RBAC: Authorizing `identity:create_grant(project_id=d2490aa6415e41d69422ae0398e4b3b7, user_id=ad2c38faeca7461a9b4a146643abec9a, role_id=45f8992b0f6941c7a64290b437d6bd5e)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:30.821536 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a961b738-b894-4c15-9089-3893acdc6f16 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:30.893978 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 559/1123] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jul 18 10:24:30 2022] PUT /identity/v3/projects/d2490aa6415e41d69422ae0398e4b3b7/users/ad2c38faeca7461a9b4a146643abec9a/roles/45f8992b0f6941c7a64290b437d6bd5e => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:24:32.927835 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7359b5-5bf4-4ce9-a03c-82ec717e232a None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:32.928387 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7359b5-5bf4-4ce9-a03c-82ec717e232a None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:32.928387 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7359b5-5bf4-4ce9-a03c-82ec717e232a None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:32.929787 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 565/1124] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:24:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:24:32.935900 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285d55c-1841-4761-82b8-7acdfdbac43b None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:32.936328 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285d55c-1841-4761-82b8-7acdfdbac43b None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:32.936483 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285d55c-1841-4761-82b8-7acdfdbac43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:32.953189 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-0285d55c-1841-4761-82b8-7acdfdbac43b None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:24:32.954398 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-0285d55c-1841-4761-82b8-7acdfdbac43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:24:33.019756 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 560/1125] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:24:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:24:33.043204 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7359b5-5bf4-4ce9-a03c-82ec717e232a None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:33.143360 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7359b5-5bf4-4ce9-a03c-82ec717e232a None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:33.177196 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff034df-4998-482f-b046-2a80f01852d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:33.178084 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff034df-4998-482f-b046-2a80f01852d7 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:33.178315 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff034df-4998-482f-b046-2a80f01852d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:33.178585 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff034df-4998-482f-b046-2a80f01852d7 None admin] PATH_INFO: `/v3/roles/45f8992b0f6941c7a64290b437d6bd5e` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:33.180028 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff034df-4998-482f-b046-2a80f01852d7 None admin] RBAC: Authorizing `identity:get_role(role_id=45f8992b0f6941c7a64290b437d6bd5e)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:33.182041 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff034df-4998-482f-b046-2a80f01852d7 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:33.183501 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 566/1126] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 10:24:33 2022] GET /identity/v3/roles/45f8992b0f6941c7a64290b437d6bd5e => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:24:33.189401 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0285d55c-1841-4761-82b8-7acdfdbac43b None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:33.227050 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:33.284692 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0285d55c-1841-4761-82b8-7acdfdbac43b None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:33.317923 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec9810-cd92-4781-bac4-76fae9237c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:33.318781 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec9810-cd92-4781-bac4-76fae9237c63 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:33.319058 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec9810-cd92-4781-bac4-76fae9237c63 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:33.319327 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec9810-cd92-4781-bac4-76fae9237c63 None admin] PATH_INFO: `/v3/users/ad2c38faeca7461a9b4a146643abec9a` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:33.320487 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ec9810-cd92-4781-bac4-76fae9237c63 None admin] RBAC: Authorizing `identity:get_user(user_id=ad2c38faeca7461a9b4a146643abec9a)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:33.321927 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ec9810-cd92-4781-bac4-76fae9237c63 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:33.324206 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 561/1127] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 10:24:33 2022] GET /identity/v3/users/ad2c38faeca7461a9b4a146643abec9a => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:24:33.329950 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff034df-4998-482f-b046-2a80f01852d7 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:33.332751 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:33.428065 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff034df-4998-482f-b046-2a80f01852d7 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:33.460112 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58db674-5958-492d-b805-42749724de64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:33.460686 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58db674-5958-492d-b805-42749724de64 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:33.460965 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58db674-5958-492d-b805-42749724de64 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:33.461265 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58db674-5958-492d-b805-42749724de64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:33.527618 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58db674-5958-492d-b805-42749724de64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:33.529082 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58db674-5958-492d-b805-42749724de64 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:33.530868 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:33.625535 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 567/1128] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 10:24:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 10:24:33.631447 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec9810-cd92-4781-bac4-76fae9237c63 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:33.728900 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec9810-cd92-4781-bac4-76fae9237c63 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:33.736232 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:33.763405 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bf9c2e-998a-432a-b2e2-5bc10d71f3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:33.764905 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf9c2e-998a-432a-b2e2-5bc10d71f3a1 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:33.765288 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf9c2e-998a-432a-b2e2-5bc10d71f3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:33.765574 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf9c2e-998a-432a-b2e2-5bc10d71f3a1 None admin] PATH_INFO: `/v3/projects/d2490aa6415e41d69422ae0398e4b3b7` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:33.766766 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bf9c2e-998a-432a-b2e2-5bc10d71f3a1 None admin] RBAC: Authorizing `identity:get_project(project_id=d2490aa6415e41d69422ae0398e4b3b7)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:33.768191 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bf9c2e-998a-432a-b2e2-5bc10d71f3a1 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:33.770027 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 562/1129] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 10:24:33 2022] GET /identity/v3/projects/d2490aa6415e41d69422ae0398e4b3b7 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:24:33.777216 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58db674-5958-492d-b805-42749724de64 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:33.876373 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58db674-5958-492d-b805-42749724de64 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:33.877891 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:33.909601 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bacca8-f71c-407b-b053-232ec61b9ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:33.910246 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bacca8-f71c-407b-b053-232ec61b9ce8 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:33.910530 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bacca8-f71c-407b-b053-232ec61b9ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:33.910805 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bacca8-f71c-407b-b053-232ec61b9ce8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:33.911633 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bacca8-f71c-407b-b053-232ec61b9ce8 None admin] RBAC: Adding query filter params (role.id=45f8992b0f6941c7a64290b437d6bd5e, scope.project.id=d2490aa6415e41d69422ae0398e4b3b7, user.id=ad2c38faeca7461a9b4a146643abec9a) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:24:33.911947 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bacca8-f71c-407b-b053-232ec61b9ce8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:33.913464 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bacca8-f71c-407b-b053-232ec61b9ce8 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:33.919267 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 568/1130] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 10:24:33 2022] GET /identity/v3/role_assignments?user.id=ad2c38faeca7461a9b4a146643abec9a&scope.project.id=d2490aa6415e41d69422ae0398e4b3b7&role.id=45f8992b0f6941c7a64290b437d6bd5e => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:24:35.933835 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a2073-5047-4ebb-91bf-dadde8819782 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:35.934391 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a2073-5047-4ebb-91bf-dadde8819782 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:35.934391 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a2073-5047-4ebb-91bf-dadde8819782 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:35.935795 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 563/1131] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:24:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:24:35.941022 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da509ed6-8fee-4486-b969-151b2895f3b6 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:35.941466 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da509ed6-8fee-4486-b969-151b2895f3b6 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:35.941605 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da509ed6-8fee-4486-b969-151b2895f3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:35.958978 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-da509ed6-8fee-4486-b969-151b2895f3b6 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:24:35.960186 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-da509ed6-8fee-4486-b969-151b2895f3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:24:36.027812 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 569/1132] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:24:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:24:36.050963 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788a2073-5047-4ebb-91bf-dadde8819782 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:36.152635 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788a2073-5047-4ebb-91bf-dadde8819782 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:36.186013 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1a1a2-4106-4282-bddc-10f80e8a9bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:36.186736 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1a1a2-4106-4282-bddc-10f80e8a9bb4 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:36.187014 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1a1a2-4106-4282-bddc-10f80e8a9bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:36.187285 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1a1a2-4106-4282-bddc-10f80e8a9bb4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:36.188441 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b1a1a2-4106-4282-bddc-10f80e8a9bb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:36.189882 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b1a1a2-4106-4282-bddc-10f80e8a9bb4 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:36.191491 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 564/1133] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:24:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:24:36.198169 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da509ed6-8fee-4486-b969-151b2895f3b6 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:36.286594 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:36.292211 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da509ed6-8fee-4486-b969-151b2895f3b6 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:36.325715 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2164cdad-e79b-471d-9b98-302fcba95947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:36.326362 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164cdad-e79b-471d-9b98-302fcba95947 None admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:36.326645 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164cdad-e79b-471d-9b98-302fcba95947 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:36.326919 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2164cdad-e79b-471d-9b98-302fcba95947 None admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:36.327612 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2164cdad-e79b-471d-9b98-302fcba95947 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:36.329024 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2164cdad-e79b-471d-9b98-302fcba95947 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:36.403635 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 570/1134] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Jul 18 10:24:36 2022] POST /identity/v3/projects => generated 311 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:24:38.426995 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68018b-701d-4329-a274-446988b0fcd4 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:38.427490 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68018b-701d-4329-a274-446988b0fcd4 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:38.427490 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68018b-701d-4329-a274-446988b0fcd4 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:38.428807 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 565/1135] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:24:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:24:38.434369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f2789-2d87-486d-bbfa-a51a982d2727 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:38.434777 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f2789-2d87-486d-bbfa-a51a982d2727 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:38.434933 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f2789-2d87-486d-bbfa-a51a982d2727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:38.452322 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-008f2789-2d87-486d-bbfa-a51a982d2727 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:24:38.453565 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-008f2789-2d87-486d-bbfa-a51a982d2727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:24:38.518583 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 571/1136] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:24:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:24:38.543741 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c68018b-701d-4329-a274-446988b0fcd4 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:38.586083 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:38.641265 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c68018b-701d-4329-a274-446988b0fcd4 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:38.674020 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60888ee7-506f-4f61-815e-1e4a06d8fa2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:38.674791 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60888ee7-506f-4f61-815e-1e4a06d8fa2d None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:38.675069 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60888ee7-506f-4f61-815e-1e4a06d8fa2d None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:38.675338 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60888ee7-506f-4f61-815e-1e4a06d8fa2d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:38.676479 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60888ee7-506f-4f61-815e-1e4a06d8fa2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:38.677969 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60888ee7-506f-4f61-815e-1e4a06d8fa2d None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:38.679502 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 566/1137] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:24:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:24:38.685506 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f2789-2d87-486d-bbfa-a51a982d2727 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:38.761716 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:38.782880 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f2789-2d87-486d-bbfa-a51a982d2727 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:38.816259 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458ee6be-ddd0-436b-976f-b02af836070c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:38.816911 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ee6be-ddd0-436b-976f-b02af836070c None admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:38.817222 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ee6be-ddd0-436b-976f-b02af836070c None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:38.817495 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ee6be-ddd0-436b-976f-b02af836070c None admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:38.818212 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458ee6be-ddd0-436b-976f-b02af836070c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:38.819664 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458ee6be-ddd0-436b-976f-b02af836070c None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:38.902977 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 572/1138] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Jul 18 10:24:38 2022] POST /identity/v3/users => generated 286 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:24:40.938063 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789086b6-032c-4355-b52b-555ff622d816 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:40.938591 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789086b6-032c-4355-b52b-555ff622d816 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:40.938591 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789086b6-032c-4355-b52b-555ff622d816 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:40.939947 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 567/1139] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:24:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:24:40.945416 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178da3b2-f90f-4c3f-ba17-dc7430a0d5e1 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:40.945854 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178da3b2-f90f-4c3f-ba17-dc7430a0d5e1 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:40.945977 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178da3b2-f90f-4c3f-ba17-dc7430a0d5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:40.962860 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-178da3b2-f90f-4c3f-ba17-dc7430a0d5e1 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:24:40.964053 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-178da3b2-f90f-4c3f-ba17-dc7430a0d5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:24:41.031840 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 573/1140] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:24:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:24:41.055087 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789086b6-032c-4355-b52b-555ff622d816 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:41.159864 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789086b6-032c-4355-b52b-555ff622d816 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:41.170238 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:41.192616 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2573e-bb0a-46c1-a1bc-4dc8283413c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:41.193493 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2573e-bb0a-46c1-a1bc-4dc8283413c2 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:41.193780 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2573e-bb0a-46c1-a1bc-4dc8283413c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:41.194054 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2573e-bb0a-46c1-a1bc-4dc8283413c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:41.205008 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b2573e-bb0a-46c1-a1bc-4dc8283413c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:24:41.213524 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-46b2573e-bb0a-46c1-a1bc-4dc8283413c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:24:41.213524 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:24:41.213524 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:24:41.213524 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:24:41.213524 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:24:41.213524 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:24:41.213524 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:24:41.213524 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:24:41.213524 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:24:41.213524 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:24:41.213524 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:24:41.213524 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:24:41.213524 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:24:41.213524 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:24:41.213524 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:24:41.213524 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:24:41.214679 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:24:41.214679 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:24:41.214679 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:24:41.214679 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:24:41.214679 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:24:41.214679 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:24:41.214679 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:24:41.214679 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:24:41.214679 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:24:41.214679 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:24:41.214679 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:24:41.214679 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:24:41.214679 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:24:41.214679 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:24:41.214679 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:24:41.214679 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:24:41.215935 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:24:41.215935 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:24:41.215935 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:24:41.215935 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:24:41.215935 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:24:41.215935 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:24:41.215935 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:24:41.215935 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:24:41.215935 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:24:41.215935 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:24:41.215935 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:24:41.215935 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:24:41.215935 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 568/1141] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 10:24:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:24:41.220898 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178da3b2-f90f-4c3f-ba17-dc7430a0d5e1 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:41.280746 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:41.316038 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178da3b2-f90f-4c3f-ba17-dc7430a0d5e1 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:41.349256 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4ce72-8387-4fa6-a5cc-2b554ff7358d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:41.349906 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4ce72-8387-4fa6-a5cc-2b554ff7358d None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:41.350189 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4ce72-8387-4fa6-a5cc-2b554ff7358d None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:41.350461 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4ce72-8387-4fa6-a5cc-2b554ff7358d None admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:41.351196 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef4ce72-8387-4fa6-a5cc-2b554ff7358d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:24:41.351501 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef4ce72-8387-4fa6-a5cc-2b554ff7358d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:41.352886 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef4ce72-8387-4fa6-a5cc-2b554ff7358d None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:41.361011 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 574/1142] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 10:24:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:24:41.366687 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2573e-bb0a-46c1-a1bc-4dc8283413c2 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:41.463740 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2573e-bb0a-46c1-a1bc-4dc8283413c2 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:41.496095 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e56d0-5e4d-4be8-bc2c-abcc75933b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:41.496948 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e56d0-5e4d-4be8-bc2c-abcc75933b02 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:41.497251 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e56d0-5e4d-4be8-bc2c-abcc75933b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:41.497519 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e56d0-5e4d-4be8-bc2c-abcc75933b02 None admin] PATH_INFO: `/v3/users/e4ab938980b64891a366c58f0c57f56b` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:41.510855 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456e56d0-5e4d-4be8-bc2c-abcc75933b02 None admin] RBAC: Authorizing `identity:get_user(user_id=e4ab938980b64891a366c58f0c57f56b)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:41.512265 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456e56d0-5e4d-4be8-bc2c-abcc75933b02 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:41.513920 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 569/1143] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 10:24:41 2022] GET /identity/v3/users/e4ab938980b64891a366c58f0c57f56b => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:24:41.519604 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4ce72-8387-4fa6-a5cc-2b554ff7358d None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:41.616633 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4ce72-8387-4fa6-a5cc-2b554ff7358d None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:41.641800 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:41.650654 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804b54e-3e7a-47e5-9827-9155de905ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:41.651291 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804b54e-3e7a-47e5-9827-9155de905ddd None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:41.651576 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804b54e-3e7a-47e5-9827-9155de905ddd None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:41.651847 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804b54e-3e7a-47e5-9827-9155de905ddd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:41.716727 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2804b54e-3e7a-47e5-9827-9155de905ddd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:41.718125 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2804b54e-3e7a-47e5-9827-9155de905ddd None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:41.813471 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 575/1144] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 10:24:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 10:24:41.819315 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e56d0-5e4d-4be8-bc2c-abcc75933b02 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:41.851549 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:41.920842 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e56d0-5e4d-4be8-bc2c-abcc75933b02 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:41.953659 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0039f848-bdb2-4c72-85c4-355bdeb0ace7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:41.954506 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039f848-bdb2-4c72-85c4-355bdeb0ace7 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:41.954786 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039f848-bdb2-4c72-85c4-355bdeb0ace7 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:41.955060 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039f848-bdb2-4c72-85c4-355bdeb0ace7 None admin] PATH_INFO: `/v3/projects/fefc24c3ab9f4461b5c612b8a4663f5d` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:41.956220 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0039f848-bdb2-4c72-85c4-355bdeb0ace7 None admin] RBAC: Authorizing `identity:get_project(project_id=fefc24c3ab9f4461b5c612b8a4663f5d)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:41.957679 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0039f848-bdb2-4c72-85c4-355bdeb0ace7 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:41.959369 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 570/1145] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 10:24:41 2022] GET /identity/v3/projects/fefc24c3ab9f4461b5c612b8a4663f5d => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:24:41.966030 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804b54e-3e7a-47e5-9827-9155de905ddd None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:41.992168 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:42.061088 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804b54e-3e7a-47e5-9827-9155de905ddd None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:42.093359 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f54310-18f6-40b3-b33f-e184874aa075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:42.094034 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f54310-18f6-40b3-b33f-e184874aa075 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:42.094320 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f54310-18f6-40b3-b33f-e184874aa075 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:42.094596 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f54310-18f6-40b3-b33f-e184874aa075 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:42.095425 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f54310-18f6-40b3-b33f-e184874aa075 None admin] RBAC: Adding query filter params (role.id=e7b6a55ecf6c491487955aaefbf9c388, scope.project.id=fefc24c3ab9f4461b5c612b8a4663f5d, user.id=e4ab938980b64891a366c58f0c57f56b) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:24:42.095738 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f54310-18f6-40b3-b33f-e184874aa075 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:42.097205 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f54310-18f6-40b3-b33f-e184874aa075 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:42.103336 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 576/1146] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 10:24:41 2022] GET /identity/v3/role_assignments?user.id=e4ab938980b64891a366c58f0c57f56b&scope.project.id=fefc24c3ab9f4461b5c612b8a4663f5d&role.id=e7b6a55ecf6c491487955aaefbf9c388 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:24:44.085177 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60b36f4-98f3-4126-9996-88fbbf69422a None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:44.085734 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60b36f4-98f3-4126-9996-88fbbf69422a None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:44.085734 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60b36f4-98f3-4126-9996-88fbbf69422a None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:44.087337 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 571/1147] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:24:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:24:44.092974 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f56018-04fd-4daf-84b5-529a87026021 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:44.093428 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f56018-04fd-4daf-84b5-529a87026021 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:44.093544 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f56018-04fd-4daf-84b5-529a87026021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:44.110788 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-b5f56018-04fd-4daf-84b5-529a87026021 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:24:44.111980 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-b5f56018-04fd-4daf-84b5-529a87026021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:24:44.175990 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 577/1148] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:24:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:24:44.198958 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60b36f4-98f3-4126-9996-88fbbf69422a None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:44.291664 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:44.298040 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60b36f4-98f3-4126-9996-88fbbf69422a None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:44.332235 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c08054-b6bc-4ad9-be61-b299256904a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:44.333130 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c08054-b6bc-4ad9-be61-b299256904a0 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:44.333606 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c08054-b6bc-4ad9-be61-b299256904a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:44.334088 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c08054-b6bc-4ad9-be61-b299256904a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:44.344851 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c08054-b6bc-4ad9-be61-b299256904a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:24:44.352322 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-f2c08054-b6bc-4ad9-be61-b299256904a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:24:44.352322 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:24:44.352322 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:24:44.352322 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:24:44.352322 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:24:44.352322 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:24:44.352322 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:24:44.352322 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:24:44.352322 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:24:44.352322 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:24:44.352322 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:24:44.352322 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:24:44.352322 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:24:44.352322 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:24:44.352322 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:24:44.352322 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:24:44.353449 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:24:44.353449 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:24:44.353449 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:24:44.353449 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:24:44.353449 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:24:44.353449 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:24:44.353449 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:24:44.353449 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:24:44.353449 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:24:44.353449 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:24:44.353449 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:24:44.353449 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:24:44.353449 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:24:44.353449 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:24:44.353449 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:24:44.353449 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:24:44.354589 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:24:44.354589 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:24:44.354589 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:24:44.354589 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:24:44.354589 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:24:44.354589 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:24:44.354589 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:24:44.354589 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:24:44.354589 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:24:44.354589 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:24:44.354589 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:24:44.354589 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:24:44.354589 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 572/1149] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 10:24:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:24:44.359918 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f56018-04fd-4daf-84b5-529a87026021 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:44.380111 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:44.456652 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f56018-04fd-4daf-84b5-529a87026021 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:44.489349 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed54b52-b37c-4d89-98f2-1441d247d002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:44.490001 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed54b52-b37c-4d89-98f2-1441d247d002 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:44.490280 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed54b52-b37c-4d89-98f2-1441d247d002 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:44.490547 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed54b52-b37c-4d89-98f2-1441d247d002 None admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:44.491282 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed54b52-b37c-4d89-98f2-1441d247d002 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:24:44.491583 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed54b52-b37c-4d89-98f2-1441d247d002 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:44.492930 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed54b52-b37c-4d89-98f2-1441d247d002 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:44.501514 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 578/1150] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 10:24:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:24:44.507189 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c08054-b6bc-4ad9-be61-b299256904a0 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:44.604790 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c08054-b6bc-4ad9-be61-b299256904a0 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:44.636694 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd11e33a-0882-4b95-9b6a-c44a2ffd05fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:44.637579 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd11e33a-0882-4b95-9b6a-c44a2ffd05fb None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:44.637865 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd11e33a-0882-4b95-9b6a-c44a2ffd05fb None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:44.638143 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd11e33a-0882-4b95-9b6a-c44a2ffd05fb None admin] PATH_INFO: `/v3/users/e4ab938980b64891a366c58f0c57f56b` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:44.639326 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd11e33a-0882-4b95-9b6a-c44a2ffd05fb None admin] RBAC: Authorizing `identity:get_user(user_id=e4ab938980b64891a366c58f0c57f56b)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:44.640775 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd11e33a-0882-4b95-9b6a-c44a2ffd05fb None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:44.642450 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 573/1151] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 10:24:44 2022] GET /identity/v3/users/e4ab938980b64891a366c58f0c57f56b => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:24:44.648083 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed54b52-b37c-4d89-98f2-1441d247d002 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:44.726964 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:44.745382 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed54b52-b37c-4d89-98f2-1441d247d002 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:44.779167 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f61308-04cf-4f67-a1ea-bd50cfeb9cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:44.780022 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f61308-04cf-4f67-a1ea-bd50cfeb9cd6 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:44.780302 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f61308-04cf-4f67-a1ea-bd50cfeb9cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:44.780576 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f61308-04cf-4f67-a1ea-bd50cfeb9cd6 None admin] PATH_INFO: `/v3/projects/fefc24c3ab9f4461b5c612b8a4663f5d` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:44.781773 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f61308-04cf-4f67-a1ea-bd50cfeb9cd6 None admin] RBAC: Authorizing `identity:get_project(project_id=fefc24c3ab9f4461b5c612b8a4663f5d)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:44.783192 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f61308-04cf-4f67-a1ea-bd50cfeb9cd6 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:44.784877 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 579/1152] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 10:24:44 2022] GET /identity/v3/projects/fefc24c3ab9f4461b5c612b8a4663f5d => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:24:44.791627 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd11e33a-0882-4b95-9b6a-c44a2ffd05fb None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:44.816614 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:44.891406 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd11e33a-0882-4b95-9b6a-c44a2ffd05fb None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:44.925952 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a0054a-4172-4ab5-8670-d7c5f89b2672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:44.927413 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0054a-4172-4ab5-8670-d7c5f89b2672 None admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:44.927904 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0054a-4172-4ab5-8670-d7c5f89b2672 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:44.928390 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a0054a-4172-4ab5-8670-d7c5f89b2672 None admin] PATH_INFO: `/v3/projects/fefc24c3ab9f4461b5c612b8a4663f5d/users/e4ab938980b64891a366c58f0c57f56b/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:44.931120 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a0054a-4172-4ab5-8670-d7c5f89b2672 None admin] RBAC: Authorizing `identity:create_grant(project_id=fefc24c3ab9f4461b5c612b8a4663f5d, user_id=e4ab938980b64891a366c58f0c57f56b, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:44.932534 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a0054a-4172-4ab5-8670-d7c5f89b2672 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:44.999412 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 574/1153] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jul 18 10:24:44 2022] PUT /identity/v3/projects/fefc24c3ab9f4461b5c612b8a4663f5d/users/e4ab938980b64891a366c58f0c57f56b/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:24:46.966395 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283ecaa-de34-4f63-8e4c-cbd081747c2d None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:46.966933 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283ecaa-de34-4f63-8e4c-cbd081747c2d None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:46.966933 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283ecaa-de34-4f63-8e4c-cbd081747c2d None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:46.968292 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 580/1154] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:24:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:24:46.973364 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80739af9-421e-4a5c-94aa-138a1cd6f4e6 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:46.973744 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80739af9-421e-4a5c-94aa-138a1cd6f4e6 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:46.973910 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80739af9-421e-4a5c-94aa-138a1cd6f4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:46.990978 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-80739af9-421e-4a5c-94aa-138a1cd6f4e6 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:24:46.992167 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-80739af9-421e-4a5c-94aa-138a1cd6f4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:24:47.056901 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 575/1155] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:24:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:24:47.084124 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0283ecaa-de34-4f63-8e4c-cbd081747c2d None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:47.182708 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0283ecaa-de34-4f63-8e4c-cbd081747c2d None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:47.215898 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328cdc1d-9bea-4c31-8955-75c3e9a21829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:47.216740 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328cdc1d-9bea-4c31-8955-75c3e9a21829 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:47.216974 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328cdc1d-9bea-4c31-8955-75c3e9a21829 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:47.217278 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328cdc1d-9bea-4c31-8955-75c3e9a21829 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:47.227170 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328cdc1d-9bea-4c31-8955-75c3e9a21829 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:24:47.235017 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-328cdc1d-9bea-4c31-8955-75c3e9a21829 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:24:47.235017 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:24:47.235017 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:24:47.235017 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:24:47.235017 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:24:47.235017 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:24:47.235017 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:24:47.235017 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:24:47.235017 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:24:47.235017 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:24:47.235017 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:24:47.235017 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:24:47.235017 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:24:47.235017 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:24:47.235017 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:24:47.235017 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:24:47.236162 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:24:47.236162 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:24:47.236162 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:24:47.236162 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:24:47.236162 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:24:47.236162 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:24:47.236162 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:24:47.236162 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:24:47.236162 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:24:47.236162 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:24:47.236162 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:24:47.236162 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:24:47.236162 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:24:47.236162 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:24:47.236162 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:24:47.236162 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:24:47.237408 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:24:47.237408 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:24:47.237408 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:24:47.237408 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:24:47.237408 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:24:47.237408 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:24:47.237408 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:24:47.237408 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:24:47.237408 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:24:47.237408 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:24:47.237408 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:24:47.237408 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:24:47.237408 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 581/1156] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 10:24:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:24:47.242243 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80739af9-421e-4a5c-94aa-138a1cd6f4e6 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:47.256859 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:47.338767 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80739af9-421e-4a5c-94aa-138a1cd6f4e6 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:47.371100 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff38ad-5300-487c-9f2f-eb8d3556e324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:47.371759 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff38ad-5300-487c-9f2f-eb8d3556e324 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:47.372041 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff38ad-5300-487c-9f2f-eb8d3556e324 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:47.372313 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff38ad-5300-487c-9f2f-eb8d3556e324 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:47.373087 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ff38ad-5300-487c-9f2f-eb8d3556e324 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:24:47.373378 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ff38ad-5300-487c-9f2f-eb8d3556e324 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:47.374724 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ff38ad-5300-487c-9f2f-eb8d3556e324 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:47.382482 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 576/1157] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 10:24:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:24:47.388730 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328cdc1d-9bea-4c31-8955-75c3e9a21829 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:47.402955 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:47.495544 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328cdc1d-9bea-4c31-8955-75c3e9a21829 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:47.528208 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c89140a-13dc-4d0d-aaf1-08cdc013a92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:47.529083 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89140a-13dc-4d0d-aaf1-08cdc013a92b None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:47.529369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89140a-13dc-4d0d-aaf1-08cdc013a92b None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:47.529636 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89140a-13dc-4d0d-aaf1-08cdc013a92b None admin] PATH_INFO: `/v3/users/e4ab938980b64891a366c58f0c57f56b` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:47.530791 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c89140a-13dc-4d0d-aaf1-08cdc013a92b None admin] RBAC: Authorizing `identity:get_user(user_id=e4ab938980b64891a366c58f0c57f56b)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:47.532202 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c89140a-13dc-4d0d-aaf1-08cdc013a92b None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:47.533877 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 582/1158] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 10:24:47 2022] GET /identity/v3/users/e4ab938980b64891a366c58f0c57f56b => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:24:47.539685 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff38ad-5300-487c-9f2f-eb8d3556e324 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:47.614022 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:47.635631 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff38ad-5300-487c-9f2f-eb8d3556e324 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:47.667732 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ee8148-01e8-4874-9e92-64d0a77d4398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:47.668363 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee8148-01e8-4874-9e92-64d0a77d4398 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:47.668641 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee8148-01e8-4874-9e92-64d0a77d4398 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:47.668915 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee8148-01e8-4874-9e92-64d0a77d4398 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:47.732801 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ee8148-01e8-4874-9e92-64d0a77d4398 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:47.734520 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ee8148-01e8-4874-9e92-64d0a77d4398 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:47.807184 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:47.832894 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 577/1159] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 10:24:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 10:24:47.838907 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c89140a-13dc-4d0d-aaf1-08cdc013a92b None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:47.920341 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:47.941522 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c89140a-13dc-4d0d-aaf1-08cdc013a92b None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:47.976936 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32339b42-98f1-4c61-9d57-a8b8f3177afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:47.978716 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32339b42-98f1-4c61-9d57-a8b8f3177afc None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:47.979002 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32339b42-98f1-4c61-9d57-a8b8f3177afc None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:47.979275 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32339b42-98f1-4c61-9d57-a8b8f3177afc None admin] PATH_INFO: `/v3/projects/fefc24c3ab9f4461b5c612b8a4663f5d` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:47.980447 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32339b42-98f1-4c61-9d57-a8b8f3177afc None admin] RBAC: Authorizing `identity:get_project(project_id=fefc24c3ab9f4461b5c612b8a4663f5d)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:47.981906 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32339b42-98f1-4c61-9d57-a8b8f3177afc None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:47.983595 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 583/1160] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 10:24:47 2022] GET /identity/v3/projects/fefc24c3ab9f4461b5c612b8a4663f5d => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:24:47.989988 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ee8148-01e8-4874-9e92-64d0a77d4398 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:48.086209 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ee8148-01e8-4874-9e92-64d0a77d4398 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:48.120830 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea08ab-e428-40ab-b4ef-2c73ea6f566e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:48.121512 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea08ab-e428-40ab-b4ef-2c73ea6f566e None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:48.121789 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea08ab-e428-40ab-b4ef-2c73ea6f566e None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:48.122059 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea08ab-e428-40ab-b4ef-2c73ea6f566e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:48.122878 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ea08ab-e428-40ab-b4ef-2c73ea6f566e None admin] RBAC: Adding query filter params (role.id=e7b6a55ecf6c491487955aaefbf9c388, scope.project.id=fefc24c3ab9f4461b5c612b8a4663f5d, user.id=e4ab938980b64891a366c58f0c57f56b) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:24:48.123186 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ea08ab-e428-40ab-b4ef-2c73ea6f566e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:48.124582 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ea08ab-e428-40ab-b4ef-2c73ea6f566e None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:48.130185 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 578/1161] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 10:24:47 2022] GET /identity/v3/role_assignments?user.id=e4ab938980b64891a366c58f0c57f56b&scope.project.id=fefc24c3ab9f4461b5c612b8a4663f5d&role.id=e7b6a55ecf6c491487955aaefbf9c388 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:24:50.131584 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec2e17-424b-4a97-8947-f499f864cd43 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:50.132063 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec2e17-424b-4a97-8947-f499f864cd43 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:50.132167 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec2e17-424b-4a97-8947-f499f864cd43 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:50.133894 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 584/1162] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:24:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:24:50.138697 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374dd324-3d42-4c98-acf0-38127e674357 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:50.139086 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374dd324-3d42-4c98-acf0-38127e674357 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:50.139255 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374dd324-3d42-4c98-acf0-38127e674357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:50.155509 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-374dd324-3d42-4c98-acf0-38127e674357 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:24:50.156683 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-374dd324-3d42-4c98-acf0-38127e674357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:24:50.193398 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:50.224379 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 579/1163] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:24:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:24:50.247653 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec2e17-424b-4a97-8947-f499f864cd43 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:50.346536 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec2e17-424b-4a97-8947-f499f864cd43 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:50.381056 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518393ab-9c13-4bd0-953e-26b1562c0a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:50.381643 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518393ab-9c13-4bd0-953e-26b1562c0a94 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:50.381929 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518393ab-9c13-4bd0-953e-26b1562c0a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:50.382210 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518393ab-9c13-4bd0-953e-26b1562c0a94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:50.397009 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:50.448823 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518393ab-9c13-4bd0-953e-26b1562c0a94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:50.450293 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518393ab-9c13-4bd0-953e-26b1562c0a94 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:50.545253 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 585/1164] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 10:24:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 10:24:50.551205 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374dd324-3d42-4c98-acf0-38127e674357 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:50.645473 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374dd324-3d42-4c98-acf0-38127e674357 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:50.678585 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58546365-12ef-48c7-b580-29aa548b579a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:50.679372 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58546365-12ef-48c7-b580-29aa548b579a None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:50.679649 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58546365-12ef-48c7-b580-29aa548b579a None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:50.679916 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58546365-12ef-48c7-b580-29aa548b579a None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:50.686498 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58546365-12ef-48c7-b580-29aa548b579a None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:50.687906 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58546365-12ef-48c7-b580-29aa548b579a None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:50.701748 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-58546365-12ef-48c7-b580-29aa548b579a None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 18 10:24:50.701748 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:24:50.701748 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 18 10:24:50.701748 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 18 10:24:50.701748 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:24:50.701748 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:24:50.701748 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:24:50.701748 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:24:50.701748 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 18 10:24:50.701748 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:24:50.701748 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 10:24:50.701748 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:24:50.701748 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:24:50.701748 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:24:50.701748 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:24:50.701748 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:24:50.701748 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:24:50.702972 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:24:50.702972 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:24:50.702972 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:24:50.702972 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:24:50.702972 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:24:50.702972 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:24:50.702972 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:24:50.702972 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:24:50.702972 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:24:50.702972 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:24:50.702972 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:24:50.702972 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:24:50.702972 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:24:50.702972 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:24:50.702972 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:24:50.702972 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:24:50.704186 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:24:50.704186 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:24:50.704186 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:24:50.704186 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:24:50.704186 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:24:50.704186 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:24:50.704186 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:24:50.704186 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:24:50.704186 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:24:50.704186 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:24:50.704186 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 18 10:24:50.704186 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:24:50.704186 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 18 10:24:50.704186 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:24:50.704186 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 580/1165] 10.222.0.39 () {56 vars in 1117 bytes} [Mon Jul 18 10:24:50 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:24:50.708815 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518393ab-9c13-4bd0-953e-26b1562c0a94 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:50.754597 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:50.807084 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518393ab-9c13-4bd0-953e-26b1562c0a94 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:50.840049 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0ec063-83b5-49e6-9140-1f019ddc6417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:50.840701 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ec063-83b5-49e6-9140-1f019ddc6417 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:50.840988 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ec063-83b5-49e6-9140-1f019ddc6417 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:50.841296 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ec063-83b5-49e6-9140-1f019ddc6417 None admin] PATH_INFO: `/v3/domains` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:50.842021 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0ec063-83b5-49e6-9140-1f019ddc6417 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:24:50.842327 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0ec063-83b5-49e6-9140-1f019ddc6417 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:50.843703 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0ec063-83b5-49e6-9140-1f019ddc6417 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:50.850710 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 586/1166] 10.222.0.39 () {56 vars in 1115 bytes} [Mon Jul 18 10:24:50 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:24:52.815838 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48ffba-2326-474d-80ea-be1938b555e3 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:52.816373 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48ffba-2326-474d-80ea-be1938b555e3 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:52.816373 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48ffba-2326-474d-80ea-be1938b555e3 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:52.817776 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 581/1167] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:24:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:24:52.823476 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a3542-d23a-49e5-9592-41d898bdc9b6 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:52.823922 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a3542-d23a-49e5-9592-41d898bdc9b6 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:52.824016 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a3542-d23a-49e5-9592-41d898bdc9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:52.841114 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-515a3542-d23a-49e5-9592-41d898bdc9b6 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:24:52.842301 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-515a3542-d23a-49e5-9592-41d898bdc9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:24:52.907667 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 587/1168] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:24:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 10:24:52.931139 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b48ffba-2326-474d-80ea-be1938b555e3 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:52.961185 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:53.029848 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b48ffba-2326-474d-80ea-be1938b555e3 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:53.063606 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfdf223-ae1d-4eb6-a151-91903945265a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:53.064254 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfdf223-ae1d-4eb6-a151-91903945265a None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:53.064535 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfdf223-ae1d-4eb6-a151-91903945265a None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:53.064807 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfdf223-ae1d-4eb6-a151-91903945265a None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:53.065566 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfdf223-ae1d-4eb6-a151-91903945265a None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:53.066998 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfdf223-ae1d-4eb6-a151-91903945265a None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:53.155075 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 582/1169] 10.222.0.39 () {60 vars in 1138 bytes} [Mon Jul 18 10:24:52 2022] POST /identity/v3/domains => generated 267 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:24:55.171140 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f674c4-ef94-4a4f-9ccc-0d76f274a9d3 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:55.171641 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f674c4-ef94-4a4f-9ccc-0d76f274a9d3 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:55.171730 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f674c4-ef94-4a4f-9ccc-0d76f274a9d3 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:55.173055 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 588/1170] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:24:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:24:55.178221 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe946f3-45f8-487e-a856-a06e1e3245fe None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:55.178646 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe946f3-45f8-487e-a856-a06e1e3245fe None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:55.178783 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe946f3-45f8-487e-a856-a06e1e3245fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:55.197153 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-fbe946f3-45f8-487e-a856-a06e1e3245fe None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:24:55.198401 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-fbe946f3-45f8-487e-a856-a06e1e3245fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:24:55.266679 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 583/1171] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:24:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:24:55.290579 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f674c4-ef94-4a4f-9ccc-0d76f274a9d3 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:55.332964 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:55.391318 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f674c4-ef94-4a4f-9ccc-0d76f274a9d3 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:55.424332 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa05432-74e4-4fc5-804e-140581a5ba8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:55.425214 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa05432-74e4-4fc5-804e-140581a5ba8a None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:55.425507 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa05432-74e4-4fc5-804e-140581a5ba8a None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:55.425781 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa05432-74e4-4fc5-804e-140581a5ba8a None admin] PATH_INFO: `/v3/domains/4529e37618804fc4b664343b0c30bf63` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:55.436659 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa05432-74e4-4fc5-804e-140581a5ba8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=4529e37618804fc4b664343b0c30bf63)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:55.438151 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa05432-74e4-4fc5-804e-140581a5ba8a None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:55.439818 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 589/1172] 10.222.0.39 () {56 vars in 1183 bytes} [Mon Jul 18 10:24:55 2022] GET /identity/v3/domains/4529e37618804fc4b664343b0c30bf63 => generated 267 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:24:55.445705 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe946f3-45f8-487e-a856-a06e1e3245fe None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:55.465957 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:55.542053 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe946f3-45f8-487e-a856-a06e1e3245fe None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:55.575323 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2def3c-85ac-486a-9467-4a56bec63625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:55.575972 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2def3c-85ac-486a-9467-4a56bec63625 None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:55.576249 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2def3c-85ac-486a-9467-4a56bec63625 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:55.576520 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2def3c-85ac-486a-9467-4a56bec63625 None admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:55.577242 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2def3c-85ac-486a-9467-4a56bec63625 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:55.578645 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2def3c-85ac-486a-9467-4a56bec63625 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:55.648211 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 584/1173] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Jul 18 10:24:55 2022] POST /identity/v3/projects => generated 361 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:24:57.697969 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2cbf7a-6e7f-46f7-9ecf-0249c8a3d175 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:57.698555 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2cbf7a-6e7f-46f7-9ecf-0249c8a3d175 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:57.698555 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2cbf7a-6e7f-46f7-9ecf-0249c8a3d175 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:57.699893 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 590/1174] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:24:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:24:57.705107 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecdd1b0-b142-413c-a20e-45005de4fad1 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:57.705501 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecdd1b0-b142-413c-a20e-45005de4fad1 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:57.705665 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecdd1b0-b142-413c-a20e-45005de4fad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:57.722123 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-3ecdd1b0-b142-413c-a20e-45005de4fad1 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:24:57.723310 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-3ecdd1b0-b142-413c-a20e-45005de4fad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:24:57.787860 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 585/1175] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:24:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:24:57.813194 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2cbf7a-6e7f-46f7-9ecf-0249c8a3d175 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:57.909140 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:57.912905 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2cbf7a-6e7f-46f7-9ecf-0249c8a3d175 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:57.945515 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ce928-b2be-4a72-a156-9e441ddf92c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:57.946972 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ce928-b2be-4a72-a156-9e441ddf92c2 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:57.947251 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ce928-b2be-4a72-a156-9e441ddf92c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:57.947524 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ce928-b2be-4a72-a156-9e441ddf92c2 None admin] PATH_INFO: `/v3/domains/4529e37618804fc4b664343b0c30bf63` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:57.948764 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870ce928-b2be-4a72-a156-9e441ddf92c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=4529e37618804fc4b664343b0c30bf63)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:57.950281 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870ce928-b2be-4a72-a156-9e441ddf92c2 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:57.952254 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 591/1176] 10.222.0.39 () {56 vars in 1183 bytes} [Mon Jul 18 10:24:57 2022] GET /identity/v3/domains/4529e37618804fc4b664343b0c30bf63 => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:24:57.957911 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecdd1b0-b142-413c-a20e-45005de4fad1 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:24:57.960078 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:24:58.054500 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecdd1b0-b142-413c-a20e-45005de4fad1 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:24:58.087436 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff0971b-0d58-426d-ae5e-3a96ab1ce88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:24:58.088103 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0971b-0d58-426d-ae5e-3a96ab1ce88b None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:24:58.088384 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0971b-0d58-426d-ae5e-3a96ab1ce88b None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:24:58.088659 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0971b-0d58-426d-ae5e-3a96ab1ce88b None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:24:58.089407 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff0971b-0d58-426d-ae5e-3a96ab1ce88b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:24:58.090820 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff0971b-0d58-426d-ae5e-3a96ab1ce88b None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:24:58.199689 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 586/1177] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Jul 18 10:24:57 2022] POST /identity/v3/users => generated 311 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:25:00.233830 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27bc3b-90d4-45da-b890-ba649dedbfa8 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:25:00.234365 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27bc3b-90d4-45da-b890-ba649dedbfa8 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:25:00.234365 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27bc3b-90d4-45da-b890-ba649dedbfa8 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:25:00.235729 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 592/1178] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:25:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:25:00.240873 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214624d0-027f-4cdb-818c-3aa2afebeb3e None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:25:00.241322 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214624d0-027f-4cdb-818c-3aa2afebeb3e None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:25:00.241460 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214624d0-027f-4cdb-818c-3aa2afebeb3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:25:00.258096 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-214624d0-027f-4cdb-818c-3aa2afebeb3e None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:25:00.259331 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-214624d0-027f-4cdb-818c-3aa2afebeb3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:25:00.310982 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:25:00.323656 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 587/1179] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:25:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:25:00.347047 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b27bc3b-90d4-45da-b890-ba649dedbfa8 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:25:00.444572 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b27bc3b-90d4-45da-b890-ba649dedbfa8 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:25:00.477973 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af972b93-d690-4984-91f7-ea5ccd6f0b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:25:00.478741 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af972b93-d690-4984-91f7-ea5ccd6f0b3c None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:25:00.479020 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af972b93-d690-4984-91f7-ea5ccd6f0b3c None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:25:00.479292 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af972b93-d690-4984-91f7-ea5ccd6f0b3c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:25:00.489202 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af972b93-d690-4984-91f7-ea5ccd6f0b3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:25:00.496806 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-af972b93-d690-4984-91f7-ea5ccd6f0b3c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:25:00.496806 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:25:00.496806 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:25:00.496806 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:25:00.496806 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:25:00.496806 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:25:00.496806 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:25:00.496806 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:25:00.496806 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:25:00.496806 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:25:00.496806 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:25:00.496806 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:25:00.496806 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:25:00.496806 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:25:00.496806 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:25:00.496806 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:25:00.498075 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:25:00.498075 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:25:00.498075 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:25:00.498075 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:25:00.498075 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:25:00.498075 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:25:00.498075 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:25:00.498075 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:25:00.498075 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:25:00.498075 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:25:00.498075 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:25:00.498075 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:25:00.498075 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:25:00.498075 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:25:00.498075 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:25:00.498075 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:25:00.499152 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:25:00.499152 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:25:00.499152 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:25:00.499152 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:25:00.499152 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:25:00.499152 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:25:00.499152 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:25:00.499152 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:25:00.499152 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:25:00.499152 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:25:00.499152 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:25:00.499152 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:25:00.499152 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 593/1180] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 10:25:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:25:00.503967 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214624d0-027f-4cdb-818c-3aa2afebeb3e None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:25:00.603644 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214624d0-027f-4cdb-818c-3aa2afebeb3e None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:25:00.637328 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b06f46-b9d7-47d1-b5fb-443c695883c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:25:00.637990 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b06f46-b9d7-47d1-b5fb-443c695883c6 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:25:00.638270 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b06f46-b9d7-47d1-b5fb-443c695883c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:25:00.638541 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b06f46-b9d7-47d1-b5fb-443c695883c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:25:00.639278 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b06f46-b9d7-47d1-b5fb-443c695883c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:25:00.639587 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b06f46-b9d7-47d1-b5fb-443c695883c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:25:00.640941 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b06f46-b9d7-47d1-b5fb-443c695883c6 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:25:00.649812 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 588/1181] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 10:25:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:25:00.655564 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af972b93-d690-4984-91f7-ea5ccd6f0b3c None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:25:00.683016 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:25:00.751607 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af972b93-d690-4984-91f7-ea5ccd6f0b3c None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:25:00.784749 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395800e8-86de-45f2-af9b-6caa317f411b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:25:00.785630 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395800e8-86de-45f2-af9b-6caa317f411b None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:25:00.785912 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395800e8-86de-45f2-af9b-6caa317f411b None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:25:00.786187 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395800e8-86de-45f2-af9b-6caa317f411b None admin] PATH_INFO: `/v3/users/d442b69f01264becac246211860caf66` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:25:00.799427 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395800e8-86de-45f2-af9b-6caa317f411b None admin] RBAC: Authorizing `identity:get_user(user_id=d442b69f01264becac246211860caf66)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:25:00.800840 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395800e8-86de-45f2-af9b-6caa317f411b None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:25:00.802488 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 594/1182] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 10:25:00 2022] GET /identity/v3/users/d442b69f01264becac246211860caf66 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:25:00.808374 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b06f46-b9d7-47d1-b5fb-443c695883c6 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:25:00.858226 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:25:00.907285 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b06f46-b9d7-47d1-b5fb-443c695883c6 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:25:00.939619 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a62dca-4327-4ab3-9364-14b712edc180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:25:00.940262 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a62dca-4327-4ab3-9364-14b712edc180 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:25:00.940545 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a62dca-4327-4ab3-9364-14b712edc180 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:25:00.940822 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a62dca-4327-4ab3-9364-14b712edc180 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:25:01.008029 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a62dca-4327-4ab3-9364-14b712edc180 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:25:01.009631 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a62dca-4327-4ab3-9364-14b712edc180 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:25:01.056312 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:25:01.106558 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 589/1183] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 10:25:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 10:25:01.112631 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395800e8-86de-45f2-af9b-6caa317f411b None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:25:01.195047 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:25:01.209311 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395800e8-86de-45f2-af9b-6caa317f411b None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:25:01.243425 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56827fe7-3eed-41e4-9881-04a796aabc0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:25:01.244275 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56827fe7-3eed-41e4-9881-04a796aabc0d None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:25:01.244557 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56827fe7-3eed-41e4-9881-04a796aabc0d None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:25:01.244831 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56827fe7-3eed-41e4-9881-04a796aabc0d None admin] PATH_INFO: `/v3/projects/f69d93dde37f42bf93ba0862ea43131f` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:25:01.246024 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56827fe7-3eed-41e4-9881-04a796aabc0d None admin] RBAC: Authorizing `identity:get_project(project_id=f69d93dde37f42bf93ba0862ea43131f)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:25:01.247440 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56827fe7-3eed-41e4-9881-04a796aabc0d None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:25:01.249135 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 595/1184] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 10:25:01 2022] GET /identity/v3/projects/f69d93dde37f42bf93ba0862ea43131f => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:25:01.255138 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a62dca-4327-4ab3-9364-14b712edc180 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:25:01.353368 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a62dca-4327-4ab3-9364-14b712edc180 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:25:01.387251 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da07362-480f-4ab7-845a-27f81e4b6e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:25:01.387893 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da07362-480f-4ab7-845a-27f81e4b6e83 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:25:01.388175 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da07362-480f-4ab7-845a-27f81e4b6e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:25:01.388449 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da07362-480f-4ab7-845a-27f81e4b6e83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:25:01.389295 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da07362-480f-4ab7-845a-27f81e4b6e83 None admin] RBAC: Adding query filter params (role.id=e7b6a55ecf6c491487955aaefbf9c388, scope.project.id=f69d93dde37f42bf93ba0862ea43131f, user.id=d442b69f01264becac246211860caf66) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:25:01.389605 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da07362-480f-4ab7-845a-27f81e4b6e83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:25:01.391005 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da07362-480f-4ab7-845a-27f81e4b6e83 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:25:01.396227 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 590/1185] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 10:25:01 2022] GET /identity/v3/role_assignments?user.id=d442b69f01264becac246211860caf66&scope.project.id=f69d93dde37f42bf93ba0862ea43131f&role.id=e7b6a55ecf6c491487955aaefbf9c388 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:25:03.349383 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281674ec-c15b-4f20-ae51-a63e70697373 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:25:03.349900 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281674ec-c15b-4f20-ae51-a63e70697373 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:25:03.350015 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281674ec-c15b-4f20-ae51-a63e70697373 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:25:03.351321 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 596/1186] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:25:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:25:03.356797 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45facccd-3071-429a-a9fc-ffbf9ae65ae8 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:25:03.357243 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45facccd-3071-429a-a9fc-ffbf9ae65ae8 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:25:03.357337 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45facccd-3071-429a-a9fc-ffbf9ae65ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:25:03.374554 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-45facccd-3071-429a-a9fc-ffbf9ae65ae8 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:25:03.375738 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-45facccd-3071-429a-a9fc-ffbf9ae65ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:25:03.385385 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:25:03.440021 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 591/1187] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:25:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 10:25:03.463179 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281674ec-c15b-4f20-ae51-a63e70697373 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:25:03.562339 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281674ec-c15b-4f20-ae51-a63e70697373 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:25:03.595935 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a99c87-1a7e-4ec3-ae68-e0113d9cdeef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:25:03.596706 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a99c87-1a7e-4ec3-ae68-e0113d9cdeef None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:25:03.596987 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a99c87-1a7e-4ec3-ae68-e0113d9cdeef None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:25:03.597288 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a99c87-1a7e-4ec3-ae68-e0113d9cdeef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:25:03.607282 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a99c87-1a7e-4ec3-ae68-e0113d9cdeef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:25:03.615168 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-44a99c87-1a7e-4ec3-ae68-e0113d9cdeef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:25:03.615168 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:25:03.615168 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:25:03.615168 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:25:03.615168 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:25:03.615168 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:25:03.615168 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:25:03.615168 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:25:03.615168 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:25:03.615168 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:25:03.615168 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:25:03.615168 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:25:03.615168 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:25:03.615168 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:25:03.615168 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:25:03.615168 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:25:03.616073 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:25:03.616073 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:25:03.616073 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:25:03.616073 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:25:03.616073 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:25:03.616073 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:25:03.616073 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:25:03.616073 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:25:03.616073 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:25:03.616073 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:25:03.616073 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:25:03.616073 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:25:03.616073 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:25:03.616073 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:25:03.616073 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:25:03.616073 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:25:03.616973 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:25:03.616973 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:25:03.616973 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:25:03.616973 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:25:03.616973 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:25:03.616973 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:25:03.616973 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:25:03.616973 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:25:03.616973 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:25:03.616973 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:25:03.616973 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:25:03.616973 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:25:03.616973 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 597/1188] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 10:25:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:25:03.623319 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45facccd-3071-429a-a9fc-ffbf9ae65ae8 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:25:03.726986 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45facccd-3071-429a-a9fc-ffbf9ae65ae8 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:25:03.759593 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c7004-9156-411d-be57-9b1dd2cfc751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:25:03.760238 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c7004-9156-411d-be57-9b1dd2cfc751 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:25:03.760518 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c7004-9156-411d-be57-9b1dd2cfc751 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:25:03.760788 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c7004-9156-411d-be57-9b1dd2cfc751 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:25:03.761548 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117c7004-9156-411d-be57-9b1dd2cfc751 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:25:03.761853 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117c7004-9156-411d-be57-9b1dd2cfc751 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:25:03.763197 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117c7004-9156-411d-be57-9b1dd2cfc751 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:25:03.770885 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 592/1189] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 10:25:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:25:03.777329 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a99c87-1a7e-4ec3-ae68-e0113d9cdeef None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:25:03.792982 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:25:03.873925 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a99c87-1a7e-4ec3-ae68-e0113d9cdeef None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:25:03.907840 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f464b89a-9a8c-4b01-a99d-0eb0ee930f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:25:03.908687 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464b89a-9a8c-4b01-a99d-0eb0ee930f7c None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:25:03.908966 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464b89a-9a8c-4b01-a99d-0eb0ee930f7c None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:25:03.909267 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464b89a-9a8c-4b01-a99d-0eb0ee930f7c None admin] PATH_INFO: `/v3/users/d442b69f01264becac246211860caf66` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:25:03.910418 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f464b89a-9a8c-4b01-a99d-0eb0ee930f7c None admin] RBAC: Authorizing `identity:get_user(user_id=d442b69f01264becac246211860caf66)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:25:03.911837 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f464b89a-9a8c-4b01-a99d-0eb0ee930f7c None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:25:03.913466 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 598/1190] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 10:25:03 2022] GET /identity/v3/users/d442b69f01264becac246211860caf66 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:25:03.919310 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c7004-9156-411d-be57-9b1dd2cfc751 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:25:03.928296 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:25:04.018732 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c7004-9156-411d-be57-9b1dd2cfc751 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:25:04.050921 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e7798-b13e-4ceb-965e-32bba2733ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:25:04.051769 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e7798-b13e-4ceb-965e-32bba2733ad0 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:25:04.052046 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e7798-b13e-4ceb-965e-32bba2733ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:25:04.052315 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e7798-b13e-4ceb-965e-32bba2733ad0 None admin] PATH_INFO: `/v3/projects/f69d93dde37f42bf93ba0862ea43131f` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:25:04.053495 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2e7798-b13e-4ceb-965e-32bba2733ad0 None admin] RBAC: Authorizing `identity:get_project(project_id=f69d93dde37f42bf93ba0862ea43131f)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:25:04.055497 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2e7798-b13e-4ceb-965e-32bba2733ad0 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:25:04.057180 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 593/1191] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 10:25:03 2022] GET /identity/v3/projects/f69d93dde37f42bf93ba0862ea43131f => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:25:04.063473 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f464b89a-9a8c-4b01-a99d-0eb0ee930f7c None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:25:04.145342 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:25:04.163230 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f464b89a-9a8c-4b01-a99d-0eb0ee930f7c None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:25:04.197897 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc035431-bbe6-41e0-ad6d-c54cf1ed125d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:25:04.198788 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc035431-bbe6-41e0-ad6d-c54cf1ed125d None admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:25:04.199071 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc035431-bbe6-41e0-ad6d-c54cf1ed125d None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:25:04.199347 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc035431-bbe6-41e0-ad6d-c54cf1ed125d None admin] PATH_INFO: `/v3/projects/f69d93dde37f42bf93ba0862ea43131f/users/d442b69f01264becac246211860caf66/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:25:04.201305 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc035431-bbe6-41e0-ad6d-c54cf1ed125d None admin] RBAC: Authorizing `identity:create_grant(project_id=f69d93dde37f42bf93ba0862ea43131f, user_id=d442b69f01264becac246211860caf66, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:25:04.202731 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc035431-bbe6-41e0-ad6d-c54cf1ed125d None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:25:04.315266 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 599/1192] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jul 18 10:25:04 2022] PUT /identity/v3/projects/f69d93dde37f42bf93ba0862ea43131f/users/d442b69f01264becac246211860caf66/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:25:06.293435 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985519c-bdbe-4903-84aa-43f18c969877 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:25:06.293985 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985519c-bdbe-4903-84aa-43f18c969877 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:25:06.293985 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985519c-bdbe-4903-84aa-43f18c969877 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:25:06.295333 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 594/1193] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:25:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:25:06.300421 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c612d-9d62-42be-a203-f65f32887c68 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:25:06.300792 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c612d-9d62-42be-a203-f65f32887c68 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:25:06.300990 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c612d-9d62-42be-a203-f65f32887c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:25:06.317653 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-462c612d-9d62-42be-a203-f65f32887c68 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:25:06.318846 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-462c612d-9d62-42be-a203-f65f32887c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:25:06.385576 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 600/1194] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:25:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:25:06.408438 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1985519c-bdbe-4903-84aa-43f18c969877 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:25:06.483037 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:25:06.508348 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1985519c-bdbe-4903-84aa-43f18c969877 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:25:06.540356 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b381856-a2d4-4733-9097-0ab302ed25a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:25:06.541153 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b381856-a2d4-4733-9097-0ab302ed25a0 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:25:06.541434 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b381856-a2d4-4733-9097-0ab302ed25a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:25:06.541704 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b381856-a2d4-4733-9097-0ab302ed25a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:25:06.551320 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b381856-a2d4-4733-9097-0ab302ed25a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:25:06.559557 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-3b381856-a2d4-4733-9097-0ab302ed25a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:25:06.559557 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:25:06.559557 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:25:06.559557 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:25:06.559557 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:25:06.559557 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:25:06.559557 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:25:06.559557 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:25:06.559557 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:25:06.559557 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:25:06.559557 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:25:06.559557 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:25:06.559557 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:25:06.559557 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:25:06.559557 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:25:06.559557 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:25:06.560671 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:25:06.560671 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:25:06.560671 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:25:06.560671 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:25:06.560671 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:25:06.560671 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:25:06.560671 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:25:06.560671 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:25:06.560671 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:25:06.560671 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:25:06.560671 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:25:06.560671 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:25:06.560671 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:25:06.560671 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:25:06.560671 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:25:06.560671 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:25:06.561775 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:25:06.561775 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:25:06.561775 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:25:06.561775 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:25:06.561775 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:25:06.561775 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:25:06.561775 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:25:06.561775 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:25:06.561775 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:25:06.561775 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:25:06.561775 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:25:06.561775 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:25:06.561775 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 595/1195] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 10:25:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:25:06.566749 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c612d-9d62-42be-a203-f65f32887c68 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:25:06.635171 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:25:06.662765 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c612d-9d62-42be-a203-f65f32887c68 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:25:06.697111 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d010f598-e1e5-4812-a868-9b6780bf1372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:25:06.697770 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010f598-e1e5-4812-a868-9b6780bf1372 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:25:06.698054 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010f598-e1e5-4812-a868-9b6780bf1372 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:25:06.698330 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010f598-e1e5-4812-a868-9b6780bf1372 None admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:25:06.699078 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d010f598-e1e5-4812-a868-9b6780bf1372 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:25:06.699388 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d010f598-e1e5-4812-a868-9b6780bf1372 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:25:06.700767 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d010f598-e1e5-4812-a868-9b6780bf1372 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:25:06.708688 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 601/1196] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 10:25:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:25:06.714931 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b381856-a2d4-4733-9097-0ab302ed25a0 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:25:06.813538 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b381856-a2d4-4733-9097-0ab302ed25a0 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:25:06.845385 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb13eee-2bc0-4ccc-adc0-085437ec90b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:25:06.846238 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb13eee-2bc0-4ccc-adc0-085437ec90b9 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:25:06.846516 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb13eee-2bc0-4ccc-adc0-085437ec90b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:25:06.846784 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb13eee-2bc0-4ccc-adc0-085437ec90b9 None admin] PATH_INFO: `/v3/users/d442b69f01264becac246211860caf66` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:25:06.847938 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb13eee-2bc0-4ccc-adc0-085437ec90b9 None admin] RBAC: Authorizing `identity:get_user(user_id=d442b69f01264becac246211860caf66)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:25:06.849357 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb13eee-2bc0-4ccc-adc0-085437ec90b9 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:25:06.851460 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 596/1197] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Jul 18 10:25:06 2022] GET /identity/v3/users/d442b69f01264becac246211860caf66 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:25:06.857220 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d010f598-e1e5-4812-a868-9b6780bf1372 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:25:06.956017 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d010f598-e1e5-4812-a868-9b6780bf1372 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:25:06.990388 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d25f0-792e-4965-bb54-a1d369102fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:25:06.991079 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d25f0-792e-4965-bb54-a1d369102fd7 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:25:06.991877 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d25f0-792e-4965-bb54-a1d369102fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:25:06.992352 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d25f0-792e-4965-bb54-a1d369102fd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:25:06.995608 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:25:07.060087 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09d25f0-792e-4965-bb54-a1d369102fd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:25:07.061543 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09d25f0-792e-4965-bb54-a1d369102fd7 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:25:07.157007 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 602/1198] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 10:25:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 10:25:07.162835 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb13eee-2bc0-4ccc-adc0-085437ec90b9 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:25:07.166394 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:25:07.259744 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb13eee-2bc0-4ccc-adc0-085437ec90b9 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:25:07.292245 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded3944a-cbcd-46ff-863e-c8c7ba66bf81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:25:07.293123 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded3944a-cbcd-46ff-863e-c8c7ba66bf81 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:25:07.293408 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded3944a-cbcd-46ff-863e-c8c7ba66bf81 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:25:07.293681 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded3944a-cbcd-46ff-863e-c8c7ba66bf81 None admin] PATH_INFO: `/v3/projects/f69d93dde37f42bf93ba0862ea43131f` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:25:07.294862 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded3944a-cbcd-46ff-863e-c8c7ba66bf81 None admin] RBAC: Authorizing `identity:get_project(project_id=f69d93dde37f42bf93ba0862ea43131f)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:25:07.296277 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded3944a-cbcd-46ff-863e-c8c7ba66bf81 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:25:07.298002 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 597/1199] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Jul 18 10:25:07 2022] GET /identity/v3/projects/f69d93dde37f42bf93ba0862ea43131f => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:25:07.303989 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d25f0-792e-4965-bb54-a1d369102fd7 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:25:07.337377 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:25:07.401931 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d25f0-792e-4965-bb54-a1d369102fd7 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:25:07.434075 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb694f-7424-48f7-abe2-521341283929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:25:07.434712 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb694f-7424-48f7-abe2-521341283929 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:25:07.434991 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb694f-7424-48f7-abe2-521341283929 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:25:07.435260 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb694f-7424-48f7-abe2-521341283929 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:25:07.436069 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbb694f-7424-48f7-abe2-521341283929 None admin] RBAC: Adding query filter params (role.id=e7b6a55ecf6c491487955aaefbf9c388, scope.project.id=f69d93dde37f42bf93ba0862ea43131f, user.id=d442b69f01264becac246211860caf66) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:25:07.436375 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbb694f-7424-48f7-abe2-521341283929 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:25:07.437809 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbb694f-7424-48f7-abe2-521341283929 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:25:07.443396 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 603/1200] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 10:25:07 2022] GET /identity/v3/role_assignments?user.id=d442b69f01264becac246211860caf66&scope.project.id=f69d93dde37f42bf93ba0862ea43131f&role.id=e7b6a55ecf6c491487955aaefbf9c388 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:25:17.288334 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=65 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:25:17.440918 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=51 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:26:20.665322 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea390b-09aa-47bd-840f-e745d5e9b779 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:20.665914 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea390b-09aa-47bd-840f-e745d5e9b779 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:20.665914 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea390b-09aa-47bd-840f-e745d5e9b779 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:20.667318 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 598/1201] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:26:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:26:20.673213 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd90017-d6b5-4196-8664-b1e8a9b8683c None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:20.673648 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd90017-d6b5-4196-8664-b1e8a9b8683c None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:20.673812 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd90017-d6b5-4196-8664-b1e8a9b8683c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:20.690133 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-9dd90017-d6b5-4196-8664-b1e8a9b8683c None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:26:20.691318 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-9dd90017-d6b5-4196-8664-b1e8a9b8683c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:26:20.762703 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 604/1202] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:26:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:26:20.786912 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ea390b-09aa-47bd-840f-e745d5e9b779 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:20.894007 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ea390b-09aa-47bd-840f-e745d5e9b779 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:20.927593 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cae1d5-2fa1-4c66-a4e9-8464d13ba897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:20.928329 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cae1d5-2fa1-4c66-a4e9-8464d13ba897 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:20.928606 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cae1d5-2fa1-4c66-a4e9-8464d13ba897 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:20.928874 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cae1d5-2fa1-4c66-a4e9-8464d13ba897 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:20.938660 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cae1d5-2fa1-4c66-a4e9-8464d13ba897 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:20.940168 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cae1d5-2fa1-4c66-a4e9-8464d13ba897 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:20.958141 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-96cae1d5-2fa1-4c66-a4e9-8464d13ba897 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:26:20.958141 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:26:20.958141 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:26:20.958141 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:26:20.958141 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:26:20.958141 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:26:20.958141 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:26:20.958141 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:26:20.958141 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:26:20.958141 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:26:20.958141 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:26:20.958141 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:26:20.958141 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:26:20.958141 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:26:20.958141 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:26:20.959313 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:26:20.959313 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:26:20.959313 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:26:20.959313 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:26:20.959313 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:26:20.959313 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:26:20.959313 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:26:20.959313 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:26:20.959313 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:26:20.959313 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:26:20.959313 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:26:20.959313 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:26:20.959313 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:26:20.959313 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:26:20.959313 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:26:20.959313 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:26:20.959313 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:26:20.960508 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:26:20.960508 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:26:20.960508 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:26:20.960508 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:26:20.960508 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 599/1203] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:26:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:26:20.965418 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd90017-d6b5-4196-8664-b1e8a9b8683c None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:21.061927 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd90017-d6b5-4196-8664-b1e8a9b8683c None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:21.091344 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:26:21.097582 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4512c4e7-c0a0-497a-97c4-5abef47f81f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:21.101320 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4512c4e7-c0a0-497a-97c4-5abef47f81f1 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:21.101320 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4512c4e7-c0a0-497a-97c4-5abef47f81f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:21.101320 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4512c4e7-c0a0-497a-97c4-5abef47f81f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:21.101320 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4512c4e7-c0a0-497a-97c4-5abef47f81f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:26:21.101320 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4512c4e7-c0a0-497a-97c4-5abef47f81f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:21.101320 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4512c4e7-c0a0-497a-97c4-5abef47f81f1 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:21.113113 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 605/1204] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:26:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:26:21.119082 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cae1d5-2fa1-4c66-a4e9-8464d13ba897 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:21.171210 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:26:21.218181 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cae1d5-2fa1-4c66-a4e9-8464d13ba897 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:21.253684 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf18a4c-cf28-40b0-be52-d7947a015d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:21.254916 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf18a4c-cf28-40b0-be52-d7947a015d69 None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:21.254916 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf18a4c-cf28-40b0-be52-d7947a015d69 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:21.255109 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf18a4c-cf28-40b0-be52-d7947a015d69 None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:21.255704 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf18a4c-cf28-40b0-be52-d7947a015d69 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:21.257151 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf18a4c-cf28-40b0-be52-d7947a015d69 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:21.394982 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 600/1205] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Jul 18 10:26:21 2022] POST /identity/v3/users => generated 251 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:26:23.446196 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52e178-1f98-4fe0-aa3d-a232094dd246 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:23.446714 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52e178-1f98-4fe0-aa3d-a232094dd246 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:23.446714 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52e178-1f98-4fe0-aa3d-a232094dd246 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:23.448049 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 606/1206] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:26:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:26:23.453132 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134b174-b5c8-452d-ba83-f2230f081543 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:23.454341 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134b174-b5c8-452d-ba83-f2230f081543 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:23.454341 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134b174-b5c8-452d-ba83-f2230f081543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:23.470983 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-7134b174-b5c8-452d-ba83-f2230f081543 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:26:23.472175 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-7134b174-b5c8-452d-ba83-f2230f081543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:26:23.538950 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 601/1207] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:26:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:26:23.562347 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52e178-1f98-4fe0-aa3d-a232094dd246 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:23.666633 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52e178-1f98-4fe0-aa3d-a232094dd246 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:23.699773 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74df6c80-e433-41ec-9042-d082ab5385e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:23.700496 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df6c80-e433-41ec-9042-d082ab5385e9 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:23.700823 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df6c80-e433-41ec-9042-d082ab5385e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:23.701142 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df6c80-e433-41ec-9042-d082ab5385e9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:23.711476 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74df6c80-e433-41ec-9042-d082ab5385e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:26:23.719386 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-74df6c80-e433-41ec-9042-d082ab5385e9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:26:23.719386 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:26:23.719386 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:26:23.719386 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:26:23.719386 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:26:23.719386 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:26:23.719386 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:26:23.719386 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:26:23.719386 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:26:23.719386 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:26:23.719386 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:26:23.719386 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:26:23.719386 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:26:23.719386 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:26:23.719386 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:26:23.719386 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:26:23.720476 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:26:23.720476 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:26:23.720476 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:26:23.720476 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:26:23.720476 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:26:23.720476 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:26:23.720476 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:26:23.720476 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:26:23.720476 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:26:23.720476 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:26:23.720476 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:26:23.720476 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:26:23.720476 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:26:23.720476 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:26:23.720476 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:26:23.720476 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:26:23.721566 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:26:23.721566 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:26:23.721566 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:26:23.721566 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:26:23.721566 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:26:23.721566 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:26:23.721566 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:26:23.721566 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:26:23.721566 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:26:23.721566 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:26:23.721566 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:26:23.721566 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:26:23.721566 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 607/1208] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jul 18 10:26:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:26:23.726700 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7134b174-b5c8-452d-ba83-f2230f081543 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:23.767951 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:26:23.825060 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7134b174-b5c8-452d-ba83-f2230f081543 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:23.858069 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e361a3b4-fc97-4451-a892-0f311a1d1386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:23.858730 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361a3b4-fc97-4451-a892-0f311a1d1386 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:23.859007 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361a3b4-fc97-4451-a892-0f311a1d1386 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:23.859279 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361a3b4-fc97-4451-a892-0f311a1d1386 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:23.860710 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e361a3b4-fc97-4451-a892-0f311a1d1386 None admin] RBAC: Adding query filter params (name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:26:23.861100 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e361a3b4-fc97-4451-a892-0f311a1d1386 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:23.862459 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e361a3b4-fc97-4451-a892-0f311a1d1386 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:23.869995 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 602/1209] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Jul 18 10:26:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:26:23.876434 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74df6c80-e433-41ec-9042-d082ab5385e9 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:23.926063 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:26:23.980229 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74df6c80-e433-41ec-9042-d082ab5385e9 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:24.013796 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d0348-36f7-41ac-a4d2-e016b1bdddbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:24.014637 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d0348-36f7-41ac-a4d2-e016b1bdddbc None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:24.014918 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d0348-36f7-41ac-a4d2-e016b1bdddbc None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:24.015196 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d0348-36f7-41ac-a4d2-e016b1bdddbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:24.025464 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1d0348-36f7-41ac-a4d2-e016b1bdddbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:24.026943 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1d0348-36f7-41ac-a4d2-e016b1bdddbc None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:24.043506 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-da1d0348-36f7-41ac-a4d2-e016b1bdddbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:26:24.043506 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:26:24.043506 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:26:24.043506 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:26:24.043506 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:26:24.043506 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:26:24.043506 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:26:24.043506 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:26:24.043506 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:26:24.043506 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:26:24.043506 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:26:24.043506 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:26:24.043506 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:26:24.043506 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:26:24.043506 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:26:24.044604 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:26:24.044604 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:26:24.044604 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:26:24.044604 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:26:24.044604 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:26:24.044604 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:26:24.044604 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:26:24.044604 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:26:24.044604 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:26:24.044604 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:26:24.044604 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:26:24.044604 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:26:24.044604 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:26:24.044604 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:26:24.044604 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:26:24.044604 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:26:24.044604 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:26:24.045542 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:26:24.045542 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:26:24.045542 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:26:24.045542 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:26:24.045542 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 608/1210] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:26:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:26:24.051345 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e361a3b4-fc97-4451-a892-0f311a1d1386 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:24.148486 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:26:24.151408 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e361a3b4-fc97-4451-a892-0f311a1d1386 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:24.184442 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ebd74-38c7-4ed6-9bc4-8921feecd7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:24.185205 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ebd74-38c7-4ed6-9bc4-8921feecd7b8 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:24.185471 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ebd74-38c7-4ed6-9bc4-8921feecd7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:24.185750 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ebd74-38c7-4ed6-9bc4-8921feecd7b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:24.186471 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782ebd74-38c7-4ed6-9bc4-8921feecd7b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:26:24.186777 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782ebd74-38c7-4ed6-9bc4-8921feecd7b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:24.188858 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782ebd74-38c7-4ed6-9bc4-8921feecd7b8 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:24.200110 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 603/1211] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:26:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:26:24.205841 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d0348-36f7-41ac-a4d2-e016b1bdddbc None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:24.305656 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d0348-36f7-41ac-a4d2-e016b1bdddbc None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:24.307088 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:26:24.339084 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f1e22-9c03-42c4-ae5e-08deaa6b5eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:24.339888 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f1e22-9c03-42c4-ae5e-08deaa6b5eb1 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:24.340168 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f1e22-9c03-42c4-ae5e-08deaa6b5eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:24.340432 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f1e22-9c03-42c4-ae5e-08deaa6b5eb1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:24.348312 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664f1e22-9c03-42c4-ae5e-08deaa6b5eb1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:24.349792 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664f1e22-9c03-42c4-ae5e-08deaa6b5eb1 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:24.365444 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-664f1e22-9c03-42c4-ae5e-08deaa6b5eb1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 18 10:26:24.365444 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:26:24.365444 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:26:24.365444 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:26:24.365444 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:26:24.365444 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:26:24.365444 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:26:24.365444 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:26:24.365444 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:26:24.365444 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:26:24.365444 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:26:24.365444 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:26:24.365444 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:26:24.365444 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:26:24.365444 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:26:24.365444 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:26:24.372041 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:26:24.372041 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:26:24.372041 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:26:24.372041 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:26:24.372041 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:26:24.372041 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:26:24.372041 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:26:24.372041 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:26:24.372041 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:26:24.372041 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:26:24.372041 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:26:24.372041 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:26:24.372041 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:26:24.372041 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:26:24.372041 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:26:24.372041 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:26:24.372041 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:26:24.372041 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:26:24.373268 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:26:24.373268 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:26:24.373268 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:26:24.373268 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:26:24.373268 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:26:24.373268 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:26:24.373268 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:26:24.373268 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:26:24.373268 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 18 10:26:24.373268 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:26:24.373268 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 609/1212] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:26:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:26:24.374030 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ebd74-38c7-4ed6-9bc4-8921feecd7b8 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:24.473125 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ebd74-38c7-4ed6-9bc4-8921feecd7b8 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:24.507867 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d5a702-9bb0-4cfc-801f-8c117cb7e061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:24.508540 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d5a702-9bb0-4cfc-801f-8c117cb7e061 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:24.508820 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d5a702-9bb0-4cfc-801f-8c117cb7e061 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:24.509116 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d5a702-9bb0-4cfc-801f-8c117cb7e061 None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:24.509940 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d5a702-9bb0-4cfc-801f-8c117cb7e061 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:26:24.510246 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d5a702-9bb0-4cfc-801f-8c117cb7e061 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:24.511657 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d5a702-9bb0-4cfc-801f-8c117cb7e061 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:24.528668 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 604/1213] 10.222.0.39 () {56 vars in 1143 bytes} [Mon Jul 18 10:26:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:26:24.535063 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f1e22-9c03-42c4-ae5e-08deaa6b5eb1 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:24.634691 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f1e22-9c03-42c4-ae5e-08deaa6b5eb1 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:24.669992 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4dd145-0a4f-4751-84f9-f66a98e63c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:24.670642 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4dd145-0a4f-4751-84f9-f66a98e63c51 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:24.670926 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4dd145-0a4f-4751-84f9-f66a98e63c51 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:24.671203 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4dd145-0a4f-4751-84f9-f66a98e63c51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:24.700540 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:26:24.739657 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4dd145-0a4f-4751-84f9-f66a98e63c51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:24.741197 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4dd145-0a4f-4751-84f9-f66a98e63c51 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:24.840342 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 610/1214] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 10:26:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 10:26:24.847314 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d5a702-9bb0-4cfc-801f-8c117cb7e061 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:24.867549 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:26:24.950774 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d5a702-9bb0-4cfc-801f-8c117cb7e061 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:24.991344 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac59b061-2440-456e-a09f-19024ff57a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:24.992142 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59b061-2440-456e-a09f-19024ff57a44 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:24.992438 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59b061-2440-456e-a09f-19024ff57a44 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:24.992691 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59b061-2440-456e-a09f-19024ff57a44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:25.003098 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac59b061-2440-456e-a09f-19024ff57a44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:25.004530 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac59b061-2440-456e-a09f-19024ff57a44 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:25.022373 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-ac59b061-2440-456e-a09f-19024ff57a44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:26:25.022373 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:26:25.022373 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:26:25.022373 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:26:25.022373 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:26:25.022373 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:26:25.022373 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:26:25.022373 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:26:25.022373 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:26:25.022373 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:26:25.022373 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:26:25.022373 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:26:25.022373 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:26:25.022373 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:26:25.022373 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:26:25.023434 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:26:25.023434 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:26:25.023434 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:26:25.023434 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:26:25.023434 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:26:25.023434 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:26:25.023434 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:26:25.023434 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:26:25.023434 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:26:25.023434 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:26:25.023434 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:26:25.023434 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:26:25.023434 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:26:25.023434 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:26:25.023434 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:26:25.023434 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:26:25.023434 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:26:25.024553 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:26:25.024553 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:26:25.024553 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:26:25.024553 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:26:25.024553 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 605/1215] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:26:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:26:25.029331 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4dd145-0a4f-4751-84f9-f66a98e63c51 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:25.091745 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:26:25.131563 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4dd145-0a4f-4751-84f9-f66a98e63c51 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:25.166102 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0933a3fa-f010-4abb-b892-54c8abeae862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:25.166763 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933a3fa-f010-4abb-b892-54c8abeae862 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:25.167047 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933a3fa-f010-4abb-b892-54c8abeae862 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:25.167323 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0933a3fa-f010-4abb-b892-54c8abeae862 None admin] PATH_INFO: `/v3/domains` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:25.168036 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0933a3fa-f010-4abb-b892-54c8abeae862 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:26:25.168343 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0933a3fa-f010-4abb-b892-54c8abeae862 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:25.169730 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0933a3fa-f010-4abb-b892-54c8abeae862 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:25.181757 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 611/1216] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:26:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:26:25.188517 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac59b061-2440-456e-a09f-19024ff57a44 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:25.261962 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:26:25.292590 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac59b061-2440-456e-a09f-19024ff57a44 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:25.326714 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa05f19-b06c-4182-a47c-728cef247477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:25.327509 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa05f19-b06c-4182-a47c-728cef247477 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:25.327785 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa05f19-b06c-4182-a47c-728cef247477 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:25.328053 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa05f19-b06c-4182-a47c-728cef247477 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:25.334466 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa05f19-b06c-4182-a47c-728cef247477 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:25.335873 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa05f19-b06c-4182-a47c-728cef247477 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:25.349514 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-0fa05f19-b06c-4182-a47c-728cef247477 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:26:25.349514 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:26:25.349514 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:26:25.349514 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:26:25.349514 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:26:25.349514 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:26:25.349514 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:26:25.349514 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:26:25.349514 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:26:25.349514 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:26:25.349514 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:26:25.349514 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:26:25.349514 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:26:25.349514 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:26:25.349514 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:26:25.350550 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:26:25.350550 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:26:25.350550 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:26:25.350550 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:26:25.350550 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:26:25.350550 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:26:25.350550 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:26:25.350550 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:26:25.350550 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:26:25.350550 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:26:25.350550 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:26:25.350550 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:26:25.350550 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:26:25.350550 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:26:25.350550 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:26:25.350550 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:26:25.350550 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:26:25.357104 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:26:25.357104 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:26:25.357104 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:26:25.357104 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:26:25.357104 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:26:25.357104 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:26:25.357104 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:26:25.357104 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:26:25.357104 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 606/1217] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 10:26:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:26:25.357734 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0933a3fa-f010-4abb-b892-54c8abeae862 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:25.455442 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0933a3fa-f010-4abb-b892-54c8abeae862 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:25.478199 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:26:25.489939 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f4b1e6-d299-47ee-b258-8311a386d1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:25.490594 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4b1e6-d299-47ee-b258-8311a386d1fa None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:25.490876 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4b1e6-d299-47ee-b258-8311a386d1fa None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:25.491153 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4b1e6-d299-47ee-b258-8311a386d1fa None admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:25.491925 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f4b1e6-d299-47ee-b258-8311a386d1fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:26:25.492228 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f4b1e6-d299-47ee-b258-8311a386d1fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:25.493685 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f4b1e6-d299-47ee-b258-8311a386d1fa None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:25.506103 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 612/1218] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 10:26:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:26:25.512461 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa05f19-b06c-4182-a47c-728cef247477 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:25.610286 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa05f19-b06c-4182-a47c-728cef247477 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:25.637396 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:26:25.643624 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78feb93c-24ff-47c4-85bc-c2a71cc8a19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:25.644269 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78feb93c-24ff-47c4-85bc-c2a71cc8a19c None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:25.644546 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78feb93c-24ff-47c4-85bc-c2a71cc8a19c None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:25.644815 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78feb93c-24ff-47c4-85bc-c2a71cc8a19c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:25.645675 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78feb93c-24ff-47c4-85bc-c2a71cc8a19c None admin] RBAC: Adding query filter params (role.id=d151ec157a524341b7194453e46b6b25, scope.project.id=a6098fe56d304980aa14bd95b4b92c17, user.id=2330638e80a941cd9aeeb2fd615900d2) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:26:25.645979 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78feb93c-24ff-47c4-85bc-c2a71cc8a19c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:25.648221 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78feb93c-24ff-47c4-85bc-c2a71cc8a19c None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:25.653479 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 607/1219] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 10:26:25 2022] GET /identity/v3/role_assignments?user.id=2330638e80a941cd9aeeb2fd615900d2&scope.project.id=a6098fe56d304980aa14bd95b4b92c17&role.id=d151ec157a524341b7194453e46b6b25 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:26:27.660306 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738e486-2248-4de9-967a-f070d4454399 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:27.660884 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738e486-2248-4de9-967a-f070d4454399 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:27.660884 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738e486-2248-4de9-967a-f070d4454399 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:27.663245 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 613/1220] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:26:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:26:27.668509 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc62aed-7f16-446f-bc09-388314470d07 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:27.668913 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc62aed-7f16-446f-bc09-388314470d07 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:27.669089 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc62aed-7f16-446f-bc09-388314470d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:27.685619 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-afc62aed-7f16-446f-bc09-388314470d07 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:26:27.686790 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-afc62aed-7f16-446f-bc09-388314470d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:26:27.752107 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 608/1221] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:26:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:26:27.774610 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4738e486-2248-4de9-967a-f070d4454399 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:27.878105 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4738e486-2248-4de9-967a-f070d4454399 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:27.913495 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc9708-57b9-4730-8976-ce6715410925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:27.914238 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc9708-57b9-4730-8976-ce6715410925 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:27.914514 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc9708-57b9-4730-8976-ce6715410925 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:27.914789 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc9708-57b9-4730-8976-ce6715410925 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:27.925150 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fc9708-57b9-4730-8976-ce6715410925 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:26:27.932749 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-76fc9708-57b9-4730-8976-ce6715410925 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:26:27.932749 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:26:27.932749 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:26:27.932749 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:26:27.932749 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:26:27.932749 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:26:27.932749 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:26:27.932749 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:26:27.932749 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:26:27.932749 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:26:27.932749 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:26:27.932749 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:26:27.932749 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:26:27.932749 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:26:27.932749 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:26:27.932749 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:26:27.933963 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:26:27.933963 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:26:27.933963 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:26:27.933963 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:26:27.933963 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:26:27.933963 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:26:27.933963 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:26:27.933963 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:26:27.933963 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:26:27.933963 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:26:27.933963 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:26:27.933963 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:26:27.933963 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:26:27.933963 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:26:27.933963 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:26:27.933963 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:26:27.935015 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:26:27.935015 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:26:27.935015 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:26:27.935015 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:26:27.935015 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:26:27.935015 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:26:27.935015 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:26:27.935015 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:26:27.935015 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:26:27.935015 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:26:27.935015 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:26:27.935015 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:26:27.935015 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 614/1222] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jul 18 10:26:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:26:27.940704 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc62aed-7f16-446f-bc09-388314470d07 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:28.038687 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc62aed-7f16-446f-bc09-388314470d07 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:28.061319 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:26:28.073406 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21515b2-041d-4861-8f34-79977a3ec0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:28.074075 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21515b2-041d-4861-8f34-79977a3ec0bb None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:28.074351 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21515b2-041d-4861-8f34-79977a3ec0bb None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:28.074620 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21515b2-041d-4861-8f34-79977a3ec0bb None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:28.075383 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21515b2-041d-4861-8f34-79977a3ec0bb None admin] RBAC: Adding query filter params (name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:26:28.075689 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21515b2-041d-4861-8f34-79977a3ec0bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:28.077033 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21515b2-041d-4861-8f34-79977a3ec0bb None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:28.085510 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 609/1223] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Jul 18 10:26:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:26:28.091273 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc9708-57b9-4730-8976-ce6715410925 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:28.142086 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:26:28.199313 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc9708-57b9-4730-8976-ce6715410925 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:28.234257 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4b4719-6887-4dea-87e6-bb80d01deb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:28.235622 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b4719-6887-4dea-87e6-bb80d01deb55 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:28.235897 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b4719-6887-4dea-87e6-bb80d01deb55 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:28.236168 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4b4719-6887-4dea-87e6-bb80d01deb55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:28.246631 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4b4719-6887-4dea-87e6-bb80d01deb55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:28.248047 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4b4719-6887-4dea-87e6-bb80d01deb55 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:28.264806 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-5c4b4719-6887-4dea-87e6-bb80d01deb55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:26:28.264806 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:26:28.264806 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:26:28.264806 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:26:28.264806 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:26:28.264806 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:26:28.264806 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:26:28.264806 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:26:28.264806 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:26:28.264806 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:26:28.264806 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:26:28.264806 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:26:28.264806 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:26:28.264806 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:26:28.264806 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:26:28.265978 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:26:28.265978 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:26:28.265978 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:26:28.265978 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:26:28.265978 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:26:28.265978 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:26:28.265978 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:26:28.265978 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:26:28.265978 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:26:28.265978 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:26:28.265978 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:26:28.265978 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:26:28.265978 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:26:28.265978 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:26:28.265978 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:26:28.265978 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:26:28.265978 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:26:28.266949 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:26:28.266949 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:26:28.266949 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:26:28.266949 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:26:28.266949 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 615/1224] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:26:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:26:28.271969 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21515b2-041d-4861-8f34-79977a3ec0bb None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:28.371701 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21515b2-041d-4861-8f34-79977a3ec0bb None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:28.404796 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149f1491-e3c6-4b3b-b98b-9c9b2e7de56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:28.405486 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f1491-e3c6-4b3b-b98b-9c9b2e7de56e None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:28.405766 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f1491-e3c6-4b3b-b98b-9c9b2e7de56e None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:28.406045 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f1491-e3c6-4b3b-b98b-9c9b2e7de56e None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:28.407446 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149f1491-e3c6-4b3b-b98b-9c9b2e7de56e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:26:28.407749 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149f1491-e3c6-4b3b-b98b-9c9b2e7de56e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:28.409124 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149f1491-e3c6-4b3b-b98b-9c9b2e7de56e None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:28.421122 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 610/1225] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:26:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:26:28.427061 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4b4719-6887-4dea-87e6-bb80d01deb55 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:28.522778 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:26:28.529246 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4b4719-6887-4dea-87e6-bb80d01deb55 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:28.563125 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5793ec3-f485-45e3-b87f-9799ace3c6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:28.563913 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5793ec3-f485-45e3-b87f-9799ace3c6ab None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:28.564193 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5793ec3-f485-45e3-b87f-9799ace3c6ab None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:28.564467 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5793ec3-f485-45e3-b87f-9799ace3c6ab None admin] PATH_INFO: `/v3/users/placement` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:28.571371 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5793ec3-f485-45e3-b87f-9799ace3c6ab None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:28.572850 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5793ec3-f485-45e3-b87f-9799ace3c6ab None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:28.587664 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-a5793ec3-f485-45e3-b87f-9799ace3c6ab None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 18 10:26:28.587664 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:26:28.587664 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:26:28.587664 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:26:28.587664 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:26:28.587664 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:26:28.587664 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:26:28.587664 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:26:28.587664 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:26:28.587664 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:26:28.587664 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:26:28.587664 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:26:28.587664 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:26:28.587664 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:26:28.587664 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:26:28.587664 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:26:28.588862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:26:28.588862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:26:28.588862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:26:28.588862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:26:28.588862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:26:28.588862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:26:28.588862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:26:28.588862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:26:28.588862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:26:28.588862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:26:28.588862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:26:28.588862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:26:28.588862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:26:28.588862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:26:28.588862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:26:28.588862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:26:28.588862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:26:28.588862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:26:28.590314 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:26:28.590314 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:26:28.590314 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:26:28.590314 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:26:28.590314 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:26:28.590314 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:26:28.590314 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:26:28.590314 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:26:28.590314 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 18 10:26:28.590314 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:26:28.590314 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 616/1226] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:26:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:26:28.595348 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149f1491-e3c6-4b3b-b98b-9c9b2e7de56e None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:28.640291 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:26:28.693786 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149f1491-e3c6-4b3b-b98b-9c9b2e7de56e None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:28.728129 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e475e47d-4486-4d48-bb15-72e2bb5863d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:28.728794 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475e47d-4486-4d48-bb15-72e2bb5863d7 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:28.729099 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475e47d-4486-4d48-bb15-72e2bb5863d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:28.729375 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475e47d-4486-4d48-bb15-72e2bb5863d7 None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:28.730203 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e475e47d-4486-4d48-bb15-72e2bb5863d7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:26:28.730517 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e475e47d-4486-4d48-bb15-72e2bb5863d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:28.731906 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e475e47d-4486-4d48-bb15-72e2bb5863d7 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:28.748718 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 611/1227] 10.222.0.39 () {56 vars in 1143 bytes} [Mon Jul 18 10:26:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:26:28.755356 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5793ec3-f485-45e3-b87f-9799ace3c6ab None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:28.855106 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5793ec3-f485-45e3-b87f-9799ace3c6ab None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:28.888925 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b4c66-78b3-430c-9f37-d2ba8a0d85ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:28.889735 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b4c66-78b3-430c-9f37-d2ba8a0d85ce None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:28.890020 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b4c66-78b3-430c-9f37-d2ba8a0d85ce None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:28.890297 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b4c66-78b3-430c-9f37-d2ba8a0d85ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:28.900704 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426b4c66-78b3-430c-9f37-d2ba8a0d85ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:28.908051 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426b4c66-78b3-430c-9f37-d2ba8a0d85ce None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:28.919529 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-426b4c66-78b3-430c-9f37-d2ba8a0d85ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:26:28.919529 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:26:28.919529 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:26:28.919529 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:26:28.919529 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:26:28.919529 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:26:28.919529 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:26:28.919529 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:26:28.919529 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:26:28.919529 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:26:28.919529 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:26:28.919529 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:26:28.919529 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:26:28.919529 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:26:28.919529 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:26:28.920577 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:26:28.920577 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:26:28.920577 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:26:28.920577 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:26:28.920577 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:26:28.920577 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:26:28.920577 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:26:28.920577 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:26:28.920577 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:26:28.920577 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:26:28.920577 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:26:28.920577 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:26:28.920577 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:26:28.920577 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:26:28.920577 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:26:28.920577 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:26:28.920577 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:26:28.922216 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:26:28.922216 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:26:28.922216 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:26:28.922216 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:26:28.922216 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 617/1228] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:26:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:26:28.926573 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e475e47d-4486-4d48-bb15-72e2bb5863d7 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:29.024497 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e475e47d-4486-4d48-bb15-72e2bb5863d7 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:29.026863 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:26:29.057616 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a984e9-bc69-4ec8-89ec-970799e79f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:29.058281 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a984e9-bc69-4ec8-89ec-970799e79f3e None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:29.058565 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a984e9-bc69-4ec8-89ec-970799e79f3e None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:29.058844 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a984e9-bc69-4ec8-89ec-970799e79f3e None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:29.059560 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a984e9-bc69-4ec8-89ec-970799e79f3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:26:29.059869 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a984e9-bc69-4ec8-89ec-970799e79f3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:29.061308 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a984e9-bc69-4ec8-89ec-970799e79f3e None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:29.073179 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 612/1229] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:26:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:26:29.079552 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b4c66-78b3-430c-9f37-d2ba8a0d85ce None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:29.090336 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:26:29.181104 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b4c66-78b3-430c-9f37-d2ba8a0d85ce None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:29.216099 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f482124-eaa2-4ba4-8896-47fed5f00607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:29.216884 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f482124-eaa2-4ba4-8896-47fed5f00607 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:29.217197 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f482124-eaa2-4ba4-8896-47fed5f00607 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:29.217471 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f482124-eaa2-4ba4-8896-47fed5f00607 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:29.224532 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f482124-eaa2-4ba4-8896-47fed5f00607 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:29.226152 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f482124-eaa2-4ba4-8896-47fed5f00607 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:29.240989 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-1f482124-eaa2-4ba4-8896-47fed5f00607 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:26:29.240989 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:26:29.240989 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:26:29.240989 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:26:29.240989 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:26:29.240989 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:26:29.240989 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:26:29.240989 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:26:29.240989 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:26:29.240989 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:26:29.240989 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:26:29.240989 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:26:29.240989 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:26:29.240989 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:26:29.240989 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:26:29.242112 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:26:29.242112 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:26:29.242112 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:26:29.242112 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:26:29.242112 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:26:29.242112 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:26:29.242112 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:26:29.242112 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:26:29.242112 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:26:29.242112 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:26:29.242112 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:26:29.242112 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:26:29.242112 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:26:29.242112 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:26:29.242112 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:26:29.242112 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:26:29.242112 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:26:29.243415 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:26:29.243415 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:26:29.243415 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:26:29.243415 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:26:29.243415 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:26:29.243415 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:26:29.243415 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:26:29.243415 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:26:29.243415 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 618/1230] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 10:26:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:26:29.248318 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a984e9-bc69-4ec8-89ec-970799e79f3e None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:29.345936 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a984e9-bc69-4ec8-89ec-970799e79f3e None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:29.380753 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536caac1-5824-425f-8bfd-a9be0b049c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:29.381440 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536caac1-5824-425f-8bfd-a9be0b049c59 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:29.381728 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536caac1-5824-425f-8bfd-a9be0b049c59 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:29.382003 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536caac1-5824-425f-8bfd-a9be0b049c59 None admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:29.382780 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536caac1-5824-425f-8bfd-a9be0b049c59 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:26:29.383092 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536caac1-5824-425f-8bfd-a9be0b049c59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:29.384489 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536caac1-5824-425f-8bfd-a9be0b049c59 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:29.396473 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 613/1231] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 10:26:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:26:29.403377 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f482124-eaa2-4ba4-8896-47fed5f00607 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:29.473827 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:26:29.507532 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f482124-eaa2-4ba4-8896-47fed5f00607 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:29.540350 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80374e1-2869-45f9-b625-558b59f01452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:29.541321 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80374e1-2869-45f9-b625-558b59f01452 None admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:29.541790 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80374e1-2869-45f9-b625-558b59f01452 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:29.542357 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80374e1-2869-45f9-b625-558b59f01452 None admin] PATH_INFO: `/v3/projects/a6098fe56d304980aa14bd95b4b92c17/users/2330638e80a941cd9aeeb2fd615900d2/roles/d151ec157a524341b7194453e46b6b25` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:29.558966 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80374e1-2869-45f9-b625-558b59f01452 None admin] RBAC: Authorizing `identity:create_grant(project_id=a6098fe56d304980aa14bd95b4b92c17, user_id=2330638e80a941cd9aeeb2fd615900d2, role_id=d151ec157a524341b7194453e46b6b25)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:29.560685 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80374e1-2869-45f9-b625-558b59f01452 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:29.661129 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 619/1232] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jul 18 10:26:29 2022] PUT /identity/v3/projects/a6098fe56d304980aa14bd95b4b92c17/users/2330638e80a941cd9aeeb2fd615900d2/roles/d151ec157a524341b7194453e46b6b25 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:26:31.702220 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d8eb0-c6b8-4981-bfe6-1df17e29b284 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:31.702770 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d8eb0-c6b8-4981-bfe6-1df17e29b284 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:31.702770 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d8eb0-c6b8-4981-bfe6-1df17e29b284 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:31.704712 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 614/1233] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:26:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:26:31.709823 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4eca9-ca47-4f31-aca6-ee755f4b4125 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:31.710257 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4eca9-ca47-4f31-aca6-ee755f4b4125 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:31.710368 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4eca9-ca47-4f31-aca6-ee755f4b4125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:31.728560 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-78d4eca9-ca47-4f31-aca6-ee755f4b4125 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:26:31.729797 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-78d4eca9-ca47-4f31-aca6-ee755f4b4125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:26:31.796369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 620/1234] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:26:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:26:31.820644 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d8eb0-c6b8-4981-bfe6-1df17e29b284 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:31.846033 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:26:31.921917 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d8eb0-c6b8-4981-bfe6-1df17e29b284 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:31.955973 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366fa99a-1904-4a04-bd20-09af14cfc2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:31.956704 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366fa99a-1904-4a04-bd20-09af14cfc2b8 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:31.956986 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366fa99a-1904-4a04-bd20-09af14cfc2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:31.957288 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366fa99a-1904-4a04-bd20-09af14cfc2b8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:31.967438 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366fa99a-1904-4a04-bd20-09af14cfc2b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:26:31.975338 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-366fa99a-1904-4a04-bd20-09af14cfc2b8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:26:31.975338 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:26:31.975338 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:26:31.975338 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:26:31.975338 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:26:31.975338 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:26:31.975338 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:26:31.975338 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:26:31.975338 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:26:31.975338 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:26:31.975338 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:26:31.975338 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:26:31.975338 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:26:31.975338 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:26:31.975338 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:26:31.975338 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:26:31.976444 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:26:31.976444 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:26:31.976444 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:26:31.976444 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:26:31.976444 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:26:31.976444 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:26:31.976444 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:26:31.976444 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:26:31.976444 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:26:31.976444 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:26:31.976444 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:26:31.976444 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:26:31.976444 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:26:31.976444 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:26:31.976444 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:26:31.976444 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:26:31.977346 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:26:31.977346 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:26:31.977346 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:26:31.977346 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:26:31.977346 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:26:31.977346 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:26:31.977346 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:26:31.977346 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:26:31.977346 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:26:31.977346 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:26:31.977346 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 10:26:31.977346 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:26:31.977346 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 615/1235] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Jul 18 10:26:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:26:31.983257 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d4eca9-ca47-4f31-aca6-ee755f4b4125 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:32.029718 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:26:32.081677 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d4eca9-ca47-4f31-aca6-ee755f4b4125 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:32.116094 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b461f-e62e-44e8-8cd1-ae2c0d50316c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:32.120664 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b461f-e62e-44e8-8cd1-ae2c0d50316c None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:32.120664 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b461f-e62e-44e8-8cd1-ae2c0d50316c None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:32.120664 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b461f-e62e-44e8-8cd1-ae2c0d50316c None admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:32.120664 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1b461f-e62e-44e8-8cd1-ae2c0d50316c None admin] RBAC: Adding query filter params (name=service) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:26:32.120664 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1b461f-e62e-44e8-8cd1-ae2c0d50316c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:32.120664 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1b461f-e62e-44e8-8cd1-ae2c0d50316c None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:32.128378 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 621/1236] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Jul 18 10:26:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:26:32.134165 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366fa99a-1904-4a04-bd20-09af14cfc2b8 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:32.219877 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:26:32.235643 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366fa99a-1904-4a04-bd20-09af14cfc2b8 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:32.268605 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35572a3c-4ab5-475b-8e2c-0c82fbc519c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:32.269587 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35572a3c-4ab5-475b-8e2c-0c82fbc519c7 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:32.269869 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35572a3c-4ab5-475b-8e2c-0c82fbc519c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:32.270146 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35572a3c-4ab5-475b-8e2c-0c82fbc519c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:32.280381 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35572a3c-4ab5-475b-8e2c-0c82fbc519c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:32.282145 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35572a3c-4ab5-475b-8e2c-0c82fbc519c7 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:32.302921 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-35572a3c-4ab5-475b-8e2c-0c82fbc519c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:26:32.302921 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:26:32.302921 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:26:32.302921 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:26:32.302921 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:26:32.302921 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:26:32.302921 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:26:32.302921 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:26:32.302921 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:26:32.302921 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:26:32.302921 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:26:32.302921 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:26:32.302921 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:26:32.302921 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:26:32.302921 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:26:32.304018 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:26:32.304018 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:26:32.304018 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:26:32.304018 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:26:32.304018 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:26:32.304018 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:26:32.304018 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:26:32.304018 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:26:32.304018 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:26:32.304018 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:26:32.304018 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:26:32.304018 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:26:32.304018 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:26:32.304018 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:26:32.304018 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:26:32.304018 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:26:32.304018 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:26:32.305147 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:26:32.305147 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:26:32.305147 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:26:32.305147 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:26:32.305147 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 616/1237] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:26:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:26:32.310197 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b461f-e62e-44e8-8cd1-ae2c0d50316c None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:32.408912 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b461f-e62e-44e8-8cd1-ae2c0d50316c None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:32.417594 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:26:32.443043 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ad16f-55e6-4293-8e1d-048721665a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:32.443698 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ad16f-55e6-4293-8e1d-048721665a45 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:32.443982 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ad16f-55e6-4293-8e1d-048721665a45 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:32.444257 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ad16f-55e6-4293-8e1d-048721665a45 None admin] PATH_INFO: `/v3/domains` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:32.444971 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6ad16f-55e6-4293-8e1d-048721665a45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:26:32.445308 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6ad16f-55e6-4293-8e1d-048721665a45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:32.446660 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6ad16f-55e6-4293-8e1d-048721665a45 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:32.458263 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 622/1238] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:26:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:26:32.463906 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35572a3c-4ab5-475b-8e2c-0c82fbc519c7 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:32.562557 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35572a3c-4ab5-475b-8e2c-0c82fbc519c7 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:32.595530 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a217b736-1564-41ca-8ba2-40b68a605a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:32.596312 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217b736-1564-41ca-8ba2-40b68a605a05 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:32.596590 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217b736-1564-41ca-8ba2-40b68a605a05 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:32.596908 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217b736-1564-41ca-8ba2-40b68a605a05 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:32.599527 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:26:32.604586 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a217b736-1564-41ca-8ba2-40b68a605a05 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:32.606029 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a217b736-1564-41ca-8ba2-40b68a605a05 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:32.620764 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-a217b736-1564-41ca-8ba2-40b68a605a05 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 18 10:26:32.620764 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:26:32.620764 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:26:32.620764 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:26:32.620764 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:26:32.620764 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:26:32.620764 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:26:32.620764 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:26:32.620764 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:26:32.620764 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:26:32.620764 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:26:32.620764 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:26:32.620764 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:26:32.620764 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:26:32.620764 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:26:32.620764 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:26:32.621920 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:26:32.621920 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:26:32.621920 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:26:32.621920 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:26:32.621920 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:26:32.621920 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:26:32.621920 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:26:32.621920 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:26:32.621920 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:26:32.621920 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:26:32.621920 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:26:32.621920 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:26:32.621920 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:26:32.621920 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:26:32.621920 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:26:32.621920 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:26:32.621920 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:26:32.621920 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:26:32.623021 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:26:32.623021 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:26:32.623021 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:26:32.623021 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:26:32.623021 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:26:32.623021 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:26:32.623021 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:26:32.623021 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:26:32.623021 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 18 10:26:32.623021 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:26:32.623021 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 617/1239] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:26:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:26:32.627788 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ad16f-55e6-4293-8e1d-048721665a45 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:32.725843 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ad16f-55e6-4293-8e1d-048721665a45 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:32.759561 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31df3f20-b0d9-4710-b23e-78eacedd8ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:32.760220 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df3f20-b0d9-4710-b23e-78eacedd8ada None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:32.760501 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df3f20-b0d9-4710-b23e-78eacedd8ada None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:32.760775 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df3f20-b0d9-4710-b23e-78eacedd8ada None admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:32.761626 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31df3f20-b0d9-4710-b23e-78eacedd8ada None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:26:32.761931 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31df3f20-b0d9-4710-b23e-78eacedd8ada None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:32.763424 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31df3f20-b0d9-4710-b23e-78eacedd8ada None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:32.781956 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 623/1240] 10.222.0.39 () {56 vars in 1143 bytes} [Mon Jul 18 10:26:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:26:32.788016 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a217b736-1564-41ca-8ba2-40b68a605a05 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:32.889681 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a217b736-1564-41ca-8ba2-40b68a605a05 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:32.924686 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993da545-1f97-4055-b256-11d588225a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:32.925383 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993da545-1f97-4055-b256-11d588225a22 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:32.925671 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993da545-1f97-4055-b256-11d588225a22 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:32.925945 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993da545-1f97-4055-b256-11d588225a22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:32.987002 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:26:32.993353 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993da545-1f97-4055-b256-11d588225a22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:32.994788 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993da545-1f97-4055-b256-11d588225a22 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:33.089494 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 618/1241] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 10:26:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 18 10:26:33.096539 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31df3f20-b0d9-4710-b23e-78eacedd8ada None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:33.126442 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:26:33.205870 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31df3f20-b0d9-4710-b23e-78eacedd8ada None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:33.242479 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f9e2c3-8657-40f3-982d-d3ffa5f80603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:33.243272 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9e2c3-8657-40f3-982d-d3ffa5f80603 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:33.243556 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9e2c3-8657-40f3-982d-d3ffa5f80603 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:33.243830 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9e2c3-8657-40f3-982d-d3ffa5f80603 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:33.257489 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f9e2c3-8657-40f3-982d-d3ffa5f80603 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:33.259612 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f9e2c3-8657-40f3-982d-d3ffa5f80603 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:33.282217 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-f8f9e2c3-8657-40f3-982d-d3ffa5f80603 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:26:33.282217 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:26:33.282217 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:26:33.282217 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:26:33.282217 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:26:33.282217 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:26:33.282217 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:26:33.282217 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:26:33.282217 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:26:33.282217 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:26:33.282217 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:26:33.282217 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:26:33.282217 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:26:33.282217 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:26:33.282217 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:26:33.287628 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:26:33.287628 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:26:33.287628 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:26:33.287628 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:26:33.287628 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:26:33.287628 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:26:33.287628 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:26:33.287628 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:26:33.287628 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:26:33.287628 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:26:33.287628 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:26:33.287628 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:26:33.287628 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:26:33.287628 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:26:33.287628 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:26:33.287628 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:26:33.287628 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:26:33.288825 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:26:33.288825 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:26:33.288825 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:26:33.288825 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:26:33.288825 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 624/1242] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:26:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:26:33.289264 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993da545-1f97-4055-b256-11d588225a22 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:33.388774 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:26:33.395315 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993da545-1f97-4055-b256-11d588225a22 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:33.428024 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeffa674-087e-4f7b-b992-d70282bcf4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:33.428681 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeffa674-087e-4f7b-b992-d70282bcf4f7 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:33.428963 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeffa674-087e-4f7b-b992-d70282bcf4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:33.429271 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeffa674-087e-4f7b-b992-d70282bcf4f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:33.429984 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeffa674-087e-4f7b-b992-d70282bcf4f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:26:33.430296 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeffa674-087e-4f7b-b992-d70282bcf4f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:33.431637 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeffa674-087e-4f7b-b992-d70282bcf4f7 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:33.443700 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 619/1243] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:26:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:26:33.449538 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f9e2c3-8657-40f3-982d-d3ffa5f80603 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:33.527692 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:26:33.550551 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f9e2c3-8657-40f3-982d-d3ffa5f80603 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:33.583713 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a4128d-04aa-4103-b01a-b051dcf83ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:33.584498 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4128d-04aa-4103-b01a-b051dcf83ea7 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:33.584776 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4128d-04aa-4103-b01a-b051dcf83ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:33.585071 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4128d-04aa-4103-b01a-b051dcf83ea7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:33.591509 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a4128d-04aa-4103-b01a-b051dcf83ea7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:33.595860 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a4128d-04aa-4103-b01a-b051dcf83ea7 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:33.606619 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-d0a4128d-04aa-4103-b01a-b051dcf83ea7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:26:33.606619 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:26:33.606619 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:26:33.606619 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:26:33.606619 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:26:33.606619 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:26:33.606619 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:26:33.606619 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:26:33.606619 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:26:33.606619 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:26:33.606619 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:26:33.606619 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:26:33.606619 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:26:33.606619 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:26:33.606619 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:26:33.607635 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:26:33.607635 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:26:33.607635 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:26:33.607635 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:26:33.607635 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:26:33.607635 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:26:33.607635 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:26:33.607635 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:26:33.607635 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:26:33.607635 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:26:33.607635 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:26:33.607635 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:26:33.607635 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:26:33.607635 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:26:33.607635 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:26:33.607635 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:26:33.607635 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:26:33.608701 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:26:33.608701 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:26:33.608701 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:26:33.608701 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:26:33.608701 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:26:33.608701 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:26:33.608701 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:26:33.608701 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:26:33.608701 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 625/1244] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 10:26:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:26:33.615559 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeffa674-087e-4f7b-b992-d70282bcf4f7 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:33.716672 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeffa674-087e-4f7b-b992-d70282bcf4f7 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:33.750214 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c3a12-80d8-48de-a2c2-c3ed52ec4e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:33.750865 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c3a12-80d8-48de-a2c2-c3ed52ec4e90 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:33.751143 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c3a12-80d8-48de-a2c2-c3ed52ec4e90 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:33.751413 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c3a12-80d8-48de-a2c2-c3ed52ec4e90 None admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:33.752186 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984c3a12-80d8-48de-a2c2-c3ed52ec4e90 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:26:33.752492 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984c3a12-80d8-48de-a2c2-c3ed52ec4e90 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:33.753928 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984c3a12-80d8-48de-a2c2-c3ed52ec4e90 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:33.766494 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 620/1245] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 10:26:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:26:33.772621 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a4128d-04aa-4103-b01a-b051dcf83ea7 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:33.871657 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a4128d-04aa-4103-b01a-b051dcf83ea7 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:33.904715 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a9ddf4-9208-414f-a272-92ee48a9c5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:33.909214 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9ddf4-9208-414f-a272-92ee48a9c5d6 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:33.909214 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9ddf4-9208-414f-a272-92ee48a9c5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:33.909214 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9ddf4-9208-414f-a272-92ee48a9c5d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:33.909214 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a9ddf4-9208-414f-a272-92ee48a9c5d6 None admin] RBAC: Adding query filter params (role.id=d151ec157a524341b7194453e46b6b25, scope.project.id=a6098fe56d304980aa14bd95b4b92c17, user.id=2330638e80a941cd9aeeb2fd615900d2) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:26:33.909214 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a9ddf4-9208-414f-a272-92ee48a9c5d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:33.909667 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a9ddf4-9208-414f-a272-92ee48a9c5d6 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:33.915641 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 626/1246] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 10:26:33 2022] GET /identity/v3/role_assignments?user.id=2330638e80a941cd9aeeb2fd615900d2&scope.project.id=a6098fe56d304980aa14bd95b4b92c17&role.id=d151ec157a524341b7194453e46b6b25 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:26:35.982245 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceabbf3-77c8-44e1-aa84-0454d70fef8d None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:35.982819 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceabbf3-77c8-44e1-aa84-0454d70fef8d None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:35.982819 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceabbf3-77c8-44e1-aa84-0454d70fef8d None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:35.984283 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 621/1247] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:26:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:26:35.989606 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d897f7-18ff-42c0-a727-48e7d25fed03 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:35.990013 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d897f7-18ff-42c0-a727-48e7d25fed03 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:35.990158 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d897f7-18ff-42c0-a727-48e7d25fed03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:35.995356 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:26:36.007299 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-64d897f7-18ff-42c0-a727-48e7d25fed03 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:26:36.008483 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-64d897f7-18ff-42c0-a727-48e7d25fed03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:26:36.073832 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 627/1248] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:26:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:26:36.097987 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceabbf3-77c8-44e1-aa84-0454d70fef8d None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:36.117010 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:26:36.198781 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceabbf3-77c8-44e1-aa84-0454d70fef8d None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:36.231793 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745bba3-49d2-4a07-bba9-c5f5f3d19d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:36.232628 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745bba3-49d2-4a07-bba9-c5f5f3d19d43 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:36.232862 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745bba3-49d2-4a07-bba9-c5f5f3d19d43 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:36.233169 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745bba3-49d2-4a07-bba9-c5f5f3d19d43 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:36.243558 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d745bba3-49d2-4a07-bba9-c5f5f3d19d43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:26:36.252213 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-d745bba3-49d2-4a07-bba9-c5f5f3d19d43 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:26:36.252213 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:26:36.252213 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:26:36.252213 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:26:36.252213 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:26:36.252213 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:26:36.252213 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:26:36.252213 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:26:36.252213 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:26:36.252213 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:26:36.252213 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:26:36.252213 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:26:36.252213 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:26:36.252213 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:26:36.252213 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:26:36.252213 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:26:36.253361 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:26:36.253361 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:26:36.253361 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:26:36.253361 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:26:36.253361 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:26:36.253361 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:26:36.253361 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:26:36.253361 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:26:36.253361 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:26:36.253361 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:26:36.253361 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:26:36.253361 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:26:36.253361 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:26:36.253361 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:26:36.253361 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:26:36.253361 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:26:36.254375 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:26:36.254375 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:26:36.254375 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:26:36.254375 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:26:36.254375 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:26:36.254375 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:26:36.254375 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:26:36.254375 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:26:36.254375 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:26:36.254375 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:26:36.254375 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:26:36.254375 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:26:36.254375 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 622/1249] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 10:26:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:26:36.259796 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d897f7-18ff-42c0-a727-48e7d25fed03 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:36.358154 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d897f7-18ff-42c0-a727-48e7d25fed03 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:36.388375 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:26:36.394027 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba8d34-4f99-4b7b-a96a-914e031d2eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:36.394694 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba8d34-4f99-4b7b-a96a-914e031d2eb4 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:36.394981 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba8d34-4f99-4b7b-a96a-914e031d2eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:36.395260 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba8d34-4f99-4b7b-a96a-914e031d2eb4 None admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:36.396076 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cba8d34-4f99-4b7b-a96a-914e031d2eb4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:26:36.396387 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cba8d34-4f99-4b7b-a96a-914e031d2eb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:36.397792 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cba8d34-4f99-4b7b-a96a-914e031d2eb4 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:36.405792 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 628/1250] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 10:26:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:26:36.411538 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745bba3-49d2-4a07-bba9-c5f5f3d19d43 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:36.490498 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:26:36.513003 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745bba3-49d2-4a07-bba9-c5f5f3d19d43 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:36.545361 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14726d00-54eb-4fd6-824a-4a985b8d45df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:36.546151 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14726d00-54eb-4fd6-824a-4a985b8d45df None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:36.546968 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14726d00-54eb-4fd6-824a-4a985b8d45df None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:36.547349 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14726d00-54eb-4fd6-824a-4a985b8d45df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:36.557607 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14726d00-54eb-4fd6-824a-4a985b8d45df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:36.559063 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14726d00-54eb-4fd6-824a-4a985b8d45df None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:36.576567 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-14726d00-54eb-4fd6-824a-4a985b8d45df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:26:36.576567 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:26:36.576567 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:26:36.576567 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:26:36.576567 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:26:36.576567 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:26:36.576567 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:26:36.576567 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:26:36.576567 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:26:36.576567 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:26:36.576567 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:26:36.576567 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:26:36.576567 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:26:36.576567 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:26:36.576567 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:26:36.577524 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:26:36.577524 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:26:36.577524 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:26:36.577524 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:26:36.577524 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:26:36.577524 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:26:36.577524 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:26:36.577524 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:26:36.577524 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:26:36.577524 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:26:36.577524 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:26:36.577524 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:26:36.577524 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:26:36.577524 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:26:36.577524 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:26:36.577524 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:26:36.577524 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:26:36.578558 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:26:36.578558 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:26:36.578558 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:26:36.578558 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:26:36.578558 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 623/1251] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:26:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:26:36.583738 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba8d34-4f99-4b7b-a96a-914e031d2eb4 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:36.685433 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba8d34-4f99-4b7b-a96a-914e031d2eb4 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:36.720638 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a8c12-f468-4e7e-ad84-6d4e4bdcf48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:36.721327 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a8c12-f468-4e7e-ad84-6d4e4bdcf48f None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:36.721609 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a8c12-f468-4e7e-ad84-6d4e4bdcf48f None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:36.721884 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540a8c12-f468-4e7e-ad84-6d4e4bdcf48f None admin] PATH_INFO: `/v3/domains` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:36.722606 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540a8c12-f468-4e7e-ad84-6d4e4bdcf48f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:26:36.722931 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540a8c12-f468-4e7e-ad84-6d4e4bdcf48f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:36.724267 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540a8c12-f468-4e7e-ad84-6d4e4bdcf48f None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:36.736330 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 629/1252] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:26:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:26:36.742213 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14726d00-54eb-4fd6-824a-4a985b8d45df None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:36.842758 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14726d00-54eb-4fd6-824a-4a985b8d45df None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:36.869114 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:26:36.876979 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b2ba7-8d98-4240-aacf-133e9faf23dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:36.877790 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b2ba7-8d98-4240-aacf-133e9faf23dd None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:36.878074 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b2ba7-8d98-4240-aacf-133e9faf23dd None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:36.878352 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b2ba7-8d98-4240-aacf-133e9faf23dd None admin] PATH_INFO: `/v3/users/placement` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:36.885689 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525b2ba7-8d98-4240-aacf-133e9faf23dd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:36.887116 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525b2ba7-8d98-4240-aacf-133e9faf23dd None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:36.901929 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-525b2ba7-8d98-4240-aacf-133e9faf23dd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 18 10:26:36.901929 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:26:36.901929 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:26:36.901929 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:26:36.901929 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:26:36.901929 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:26:36.901929 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:26:36.901929 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:26:36.901929 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:26:36.901929 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:26:36.901929 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:26:36.901929 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:26:36.901929 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:26:36.901929 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:26:36.901929 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:26:36.901929 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:26:36.903018 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:26:36.903018 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:26:36.903018 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:26:36.903018 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:26:36.903018 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:26:36.903018 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:26:36.903018 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:26:36.903018 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:26:36.903018 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:26:36.903018 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:26:36.903018 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:26:36.903018 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:26:36.903018 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:26:36.903018 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:26:36.903018 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:26:36.903018 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:26:36.903018 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:26:36.903018 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:26:36.904046 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:26:36.904046 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:26:36.904046 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:26:36.904046 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:26:36.904046 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:26:36.904046 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:26:36.904046 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:26:36.904046 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:26:36.904046 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 18 10:26:36.904046 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:26:36.904046 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 624/1253] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:26:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:26:36.909507 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a8c12-f468-4e7e-ad84-6d4e4bdcf48f None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:36.966243 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:26:37.008985 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540a8c12-f468-4e7e-ad84-6d4e4bdcf48f None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:37.041668 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51824ab8-b66f-4959-901c-2a9ddd5f80d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:37.042470 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51824ab8-b66f-4959-901c-2a9ddd5f80d4 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:37.042752 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51824ab8-b66f-4959-901c-2a9ddd5f80d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:37.043026 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51824ab8-b66f-4959-901c-2a9ddd5f80d4 None admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:37.043850 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51824ab8-b66f-4959-901c-2a9ddd5f80d4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:26:37.044158 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51824ab8-b66f-4959-901c-2a9ddd5f80d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:37.045601 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51824ab8-b66f-4959-901c-2a9ddd5f80d4 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:37.063476 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 630/1254] 10.222.0.39 () {56 vars in 1143 bytes} [Mon Jul 18 10:26:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:26:37.069518 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b2ba7-8d98-4240-aacf-133e9faf23dd None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:37.169049 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b2ba7-8d98-4240-aacf-133e9faf23dd None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:37.206487 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b0bf91-8fc9-442f-8c74-f790fc70c776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:37.207145 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0bf91-8fc9-442f-8c74-f790fc70c776 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:37.207519 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0bf91-8fc9-442f-8c74-f790fc70c776 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:37.207797 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0bf91-8fc9-442f-8c74-f790fc70c776 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:37.262645 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:26:37.275540 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b0bf91-8fc9-442f-8c74-f790fc70c776 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:37.277197 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b0bf91-8fc9-442f-8c74-f790fc70c776 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:37.370798 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 625/1255] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 10:26:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 10:26:37.377642 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51824ab8-b66f-4959-901c-2a9ddd5f80d4 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:37.478068 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51824ab8-b66f-4959-901c-2a9ddd5f80d4 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:37.491491 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:26:37.511946 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b399ff73-178c-4fbf-a64e-b4e78e57db27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:37.512786 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399ff73-178c-4fbf-a64e-b4e78e57db27 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:37.513077 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399ff73-178c-4fbf-a64e-b4e78e57db27 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:37.513393 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b399ff73-178c-4fbf-a64e-b4e78e57db27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:37.523938 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b399ff73-178c-4fbf-a64e-b4e78e57db27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:37.525416 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b399ff73-178c-4fbf-a64e-b4e78e57db27 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:37.543592 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-b399ff73-178c-4fbf-a64e-b4e78e57db27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:26:37.543592 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:26:37.543592 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:26:37.543592 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:26:37.543592 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:26:37.543592 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:26:37.543592 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:26:37.543592 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:26:37.543592 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:26:37.543592 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:26:37.543592 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:26:37.543592 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:26:37.543592 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:26:37.543592 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:26:37.543592 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:26:37.544629 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:26:37.544629 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:26:37.544629 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:26:37.544629 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:26:37.544629 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:26:37.544629 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:26:37.544629 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:26:37.544629 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:26:37.544629 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:26:37.544629 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:26:37.544629 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:26:37.544629 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:26:37.544629 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:26:37.544629 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:26:37.544629 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:26:37.544629 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:26:37.544629 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:26:37.545760 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:26:37.545760 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:26:37.545760 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:26:37.545760 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:26:37.545760 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 631/1256] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:26:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:26:37.551335 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b0bf91-8fc9-442f-8c74-f790fc70c776 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:37.650107 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:26:37.663571 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b0bf91-8fc9-442f-8c74-f790fc70c776 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:37.697819 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4d9cb-b653-40f5-b85a-790969c7128a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:37.698481 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4d9cb-b653-40f5-b85a-790969c7128a None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:37.698766 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4d9cb-b653-40f5-b85a-790969c7128a None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:37.699043 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4d9cb-b653-40f5-b85a-790969c7128a None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:37.699758 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d4d9cb-b653-40f5-b85a-790969c7128a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:26:37.700066 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d4d9cb-b653-40f5-b85a-790969c7128a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:37.701645 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d4d9cb-b653-40f5-b85a-790969c7128a None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:37.713571 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 626/1257] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:26:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:26:37.719409 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b399ff73-178c-4fbf-a64e-b4e78e57db27 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:37.820226 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b399ff73-178c-4fbf-a64e-b4e78e57db27 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:37.854590 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f74487-9aeb-4ebe-a19f-ac550246d4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:37.855375 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f74487-9aeb-4ebe-a19f-ac550246d4f3 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:37.855660 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f74487-9aeb-4ebe-a19f-ac550246d4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:37.855935 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f74487-9aeb-4ebe-a19f-ac550246d4f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:37.862834 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f74487-9aeb-4ebe-a19f-ac550246d4f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:37.864288 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f74487-9aeb-4ebe-a19f-ac550246d4f3 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:37.878570 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-b9f74487-9aeb-4ebe-a19f-ac550246d4f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:26:37.878570 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:26:37.878570 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:26:37.878570 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:26:37.878570 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:26:37.878570 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:26:37.878570 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:26:37.878570 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:26:37.878570 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:26:37.878570 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:26:37.878570 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:26:37.878570 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:26:37.878570 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:26:37.878570 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:26:37.878570 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:26:37.879642 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:26:37.879642 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:26:37.879642 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:26:37.879642 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:26:37.879642 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:26:37.879642 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:26:37.879642 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:26:37.879642 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:26:37.879642 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:26:37.879642 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:26:37.879642 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:26:37.879642 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:26:37.879642 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:26:37.879642 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:26:37.879642 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:26:37.879642 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:26:37.879642 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:26:37.880772 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:26:37.880772 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:26:37.880772 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:26:37.880772 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:26:37.880772 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:26:37.880772 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:26:37.880772 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:26:37.880772 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:26:37.880772 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 632/1258] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 10:26:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:26:37.885726 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4d9cb-b653-40f5-b85a-790969c7128a None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:37.984783 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4d9cb-b653-40f5-b85a-790969c7128a None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:38.018326 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa38cd-2bb5-4d9c-b701-590fc08ff587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:38.018985 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa38cd-2bb5-4d9c-b701-590fc08ff587 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:38.019262 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa38cd-2bb5-4d9c-b701-590fc08ff587 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:38.019531 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa38cd-2bb5-4d9c-b701-590fc08ff587 None admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:38.020303 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aa38cd-2bb5-4d9c-b701-590fc08ff587 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:26:38.020608 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aa38cd-2bb5-4d9c-b701-590fc08ff587 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:38.022038 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aa38cd-2bb5-4d9c-b701-590fc08ff587 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:38.033762 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 627/1259] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 10:26:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:26:38.039897 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f74487-9aeb-4ebe-a19f-ac550246d4f3 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:38.066452 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:26:38.144966 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f74487-9aeb-4ebe-a19f-ac550246d4f3 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:38.178259 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dd084f-fa24-457a-89b4-8220c841a972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:38.178904 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd084f-fa24-457a-89b4-8220c841a972 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:38.179183 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd084f-fa24-457a-89b4-8220c841a972 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:38.179453 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd084f-fa24-457a-89b4-8220c841a972 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:38.180267 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dd084f-fa24-457a-89b4-8220c841a972 None admin] RBAC: Adding query filter params (role.id=e7b6a55ecf6c491487955aaefbf9c388, scope.project.id=a6098fe56d304980aa14bd95b4b92c17, user.id=2330638e80a941cd9aeeb2fd615900d2) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:26:38.180574 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dd084f-fa24-457a-89b4-8220c841a972 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:38.182047 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dd084f-fa24-457a-89b4-8220c841a972 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:38.187319 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 633/1260] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 10:26:38 2022] GET /identity/v3/role_assignments?user.id=2330638e80a941cd9aeeb2fd615900d2&scope.project.id=a6098fe56d304980aa14bd95b4b92c17&role.id=e7b6a55ecf6c491487955aaefbf9c388 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:26:40.200898 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdadea1-934a-4309-b275-1c40503b080a None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:40.201468 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdadea1-934a-4309-b275-1c40503b080a None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:40.201468 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdadea1-934a-4309-b275-1c40503b080a None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:40.202990 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 628/1261] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:26:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:26:40.208382 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45013e8f-b70d-4081-a975-4ffae4b3c672 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:40.208813 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45013e8f-b70d-4081-a975-4ffae4b3c672 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:40.209005 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45013e8f-b70d-4081-a975-4ffae4b3c672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:40.226237 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-45013e8f-b70d-4081-a975-4ffae4b3c672 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:26:40.227686 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-45013e8f-b70d-4081-a975-4ffae4b3c672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:26:40.294465 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 634/1262] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:26:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:26:40.317698 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdadea1-934a-4309-b275-1c40503b080a None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:40.329521 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:26:40.418210 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdadea1-934a-4309-b275-1c40503b080a None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:40.453725 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c20b9f-5d9a-49cb-a57c-05e418ea42f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:40.454518 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c20b9f-5d9a-49cb-a57c-05e418ea42f9 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:40.454800 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c20b9f-5d9a-49cb-a57c-05e418ea42f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:40.455073 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c20b9f-5d9a-49cb-a57c-05e418ea42f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:40.464913 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c20b9f-5d9a-49cb-a57c-05e418ea42f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:26:40.472970 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-b4c20b9f-5d9a-49cb-a57c-05e418ea42f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:26:40.472970 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:26:40.472970 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:26:40.472970 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:26:40.472970 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:26:40.472970 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:26:40.472970 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:26:40.472970 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:26:40.472970 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:26:40.472970 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:26:40.472970 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:26:40.472970 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:26:40.472970 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:26:40.472970 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:26:40.472970 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:26:40.472970 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:26:40.474286 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:26:40.474286 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:26:40.474286 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:26:40.474286 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:26:40.474286 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:26:40.474286 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:26:40.474286 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:26:40.474286 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:26:40.474286 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:26:40.474286 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:26:40.474286 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:26:40.474286 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:26:40.474286 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:26:40.474286 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:26:40.474286 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:26:40.474286 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:26:40.475387 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:26:40.475387 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:26:40.475387 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:26:40.475387 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:26:40.475387 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:26:40.475387 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:26:40.475387 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:26:40.475387 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:26:40.475387 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:26:40.475387 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:26:40.475387 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:26:40.475387 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:26:40.475387 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 629/1263] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 10:26:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:26:40.480427 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45013e8f-b70d-4081-a975-4ffae4b3c672 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:40.499593 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:26:40.577444 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45013e8f-b70d-4081-a975-4ffae4b3c672 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:40.615764 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb6da0e-3155-4fa6-acbe-a09233c624de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:40.616433 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6da0e-3155-4fa6-acbe-a09233c624de None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:40.616715 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6da0e-3155-4fa6-acbe-a09233c624de None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:40.616992 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6da0e-3155-4fa6-acbe-a09233c624de None admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:40.617793 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb6da0e-3155-4fa6-acbe-a09233c624de None admin] RBAC: Adding query filter params (name=admin) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:26:40.618098 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb6da0e-3155-4fa6-acbe-a09233c624de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:40.619496 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb6da0e-3155-4fa6-acbe-a09233c624de None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:40.628244 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 635/1264] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 10:26:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:26:40.634244 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c20b9f-5d9a-49cb-a57c-05e418ea42f9 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:40.702565 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:26:40.737152 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c20b9f-5d9a-49cb-a57c-05e418ea42f9 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:40.771021 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878c6043-97e8-4f59-a1c9-98a701c8ac47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:40.771808 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c6043-97e8-4f59-a1c9-98a701c8ac47 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:40.772084 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c6043-97e8-4f59-a1c9-98a701c8ac47 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:40.772351 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c6043-97e8-4f59-a1c9-98a701c8ac47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:40.782651 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878c6043-97e8-4f59-a1c9-98a701c8ac47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:40.790523 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878c6043-97e8-4f59-a1c9-98a701c8ac47 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:40.800705 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-878c6043-97e8-4f59-a1c9-98a701c8ac47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:26:40.800705 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:26:40.800705 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:26:40.800705 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:26:40.800705 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:26:40.800705 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:26:40.800705 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:26:40.800705 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:26:40.800705 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:26:40.800705 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:26:40.800705 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:26:40.800705 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:26:40.800705 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:26:40.800705 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:26:40.800705 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:26:40.801812 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:26:40.801812 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:26:40.801812 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:26:40.801812 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:26:40.801812 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:26:40.801812 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:26:40.801812 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:26:40.801812 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:26:40.801812 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:26:40.801812 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:26:40.801812 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:26:40.801812 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:26:40.801812 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:26:40.801812 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:26:40.801812 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:26:40.801812 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:26:40.801812 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:26:40.802948 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:26:40.802948 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:26:40.802948 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:26:40.802948 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:26:40.802948 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 630/1265] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:26:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:26:40.808165 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb6da0e-3155-4fa6-acbe-a09233c624de None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:40.888256 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:26:40.906686 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb6da0e-3155-4fa6-acbe-a09233c624de None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:40.939230 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e229ef-8f65-46bb-84e0-cfbcc196abdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:40.939884 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e229ef-8f65-46bb-84e0-cfbcc196abdf None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:40.940166 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e229ef-8f65-46bb-84e0-cfbcc196abdf None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:40.940437 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e229ef-8f65-46bb-84e0-cfbcc196abdf None admin] PATH_INFO: `/v3/domains` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:40.941175 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e229ef-8f65-46bb-84e0-cfbcc196abdf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:26:40.941502 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e229ef-8f65-46bb-84e0-cfbcc196abdf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:40.942851 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e229ef-8f65-46bb-84e0-cfbcc196abdf None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:40.959152 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 636/1266] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:26:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:26:40.960776 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878c6043-97e8-4f59-a1c9-98a701c8ac47 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:41.061214 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878c6043-97e8-4f59-a1c9-98a701c8ac47 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:41.080973 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:26:41.095063 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34fdb41-0030-4b7e-97a9-dfd30d09f122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:41.095875 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34fdb41-0030-4b7e-97a9-dfd30d09f122 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:41.096157 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34fdb41-0030-4b7e-97a9-dfd30d09f122 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:41.096429 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34fdb41-0030-4b7e-97a9-dfd30d09f122 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:41.104223 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34fdb41-0030-4b7e-97a9-dfd30d09f122 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:41.105690 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34fdb41-0030-4b7e-97a9-dfd30d09f122 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:41.120454 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-c34fdb41-0030-4b7e-97a9-dfd30d09f122 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 18 10:26:41.120454 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:26:41.120454 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:26:41.120454 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:26:41.120454 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:26:41.120454 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:26:41.120454 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:26:41.120454 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:26:41.120454 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:26:41.120454 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:26:41.120454 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:26:41.120454 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:26:41.120454 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:26:41.120454 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:26:41.120454 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:26:41.120454 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:26:41.121622 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:26:41.121622 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:26:41.121622 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:26:41.121622 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:26:41.121622 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:26:41.121622 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:26:41.121622 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:26:41.121622 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:26:41.121622 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:26:41.121622 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:26:41.121622 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:26:41.121622 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:26:41.121622 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:26:41.121622 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:26:41.121622 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:26:41.121622 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:26:41.121622 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:26:41.121622 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:26:41.122750 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:26:41.122750 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:26:41.122750 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:26:41.122750 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:26:41.122750 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:26:41.122750 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:26:41.122750 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:26:41.122750 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:26:41.122750 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 18 10:26:41.122750 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:26:41.122750 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 631/1267] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:26:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:26:41.128159 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e229ef-8f65-46bb-84e0-cfbcc196abdf None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:41.226476 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e229ef-8f65-46bb-84e0-cfbcc196abdf None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:41.259862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f1c8b2-e36e-4ed5-8019-5ce013963b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:41.260522 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1c8b2-e36e-4ed5-8019-5ce013963b7d None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:41.260804 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1c8b2-e36e-4ed5-8019-5ce013963b7d None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:41.261108 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1c8b2-e36e-4ed5-8019-5ce013963b7d None admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:41.261942 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f1c8b2-e36e-4ed5-8019-5ce013963b7d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:26:41.262251 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f1c8b2-e36e-4ed5-8019-5ce013963b7d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:41.263657 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f1c8b2-e36e-4ed5-8019-5ce013963b7d None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:41.272456 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:26:41.280304 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 637/1268] 10.222.0.39 () {56 vars in 1143 bytes} [Mon Jul 18 10:26:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:26:41.286269 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34fdb41-0030-4b7e-97a9-dfd30d09f122 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:41.388822 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34fdb41-0030-4b7e-97a9-dfd30d09f122 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:41.421391 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b8711-abb4-4ee0-974f-edc05c1939ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:41.422892 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b8711-abb4-4ee0-974f-edc05c1939ae None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:41.423174 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b8711-abb4-4ee0-974f-edc05c1939ae None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:41.423438 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b8711-abb4-4ee0-974f-edc05c1939ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:41.433617 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310b8711-abb4-4ee0-974f-edc05c1939ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:41.435034 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310b8711-abb4-4ee0-974f-edc05c1939ae None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:41.451789 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-310b8711-abb4-4ee0-974f-edc05c1939ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:26:41.451789 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:26:41.451789 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:26:41.451789 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:26:41.451789 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:26:41.451789 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:26:41.451789 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:26:41.451789 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:26:41.451789 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:26:41.451789 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:26:41.451789 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:26:41.451789 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:26:41.451789 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:26:41.451789 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:26:41.451789 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:26:41.453490 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:26:41.453490 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:26:41.453490 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:26:41.453490 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:26:41.453490 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:26:41.453490 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:26:41.453490 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:26:41.453490 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:26:41.453490 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:26:41.453490 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:26:41.453490 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:26:41.453490 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:26:41.453490 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:26:41.453490 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:26:41.453490 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:26:41.453490 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:26:41.453490 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:26:41.454624 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:26:41.454624 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:26:41.454624 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:26:41.454624 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:26:41.454624 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 632/1269] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:26:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:26:41.459230 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f1c8b2-e36e-4ed5-8019-5ce013963b7d None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:41.560751 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f1c8b2-e36e-4ed5-8019-5ce013963b7d None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:41.595395 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe2b9c-ab84-49d2-b800-c0806eda0196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:41.596104 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe2b9c-ab84-49d2-b800-c0806eda0196 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:41.596393 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe2b9c-ab84-49d2-b800-c0806eda0196 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:41.596675 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe2b9c-ab84-49d2-b800-c0806eda0196 None admin] PATH_INFO: `/v3/domains` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:41.597434 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fe2b9c-ab84-49d2-b800-c0806eda0196 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:26:41.598012 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fe2b9c-ab84-49d2-b800-c0806eda0196 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:41.599408 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fe2b9c-ab84-49d2-b800-c0806eda0196 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:41.612049 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 638/1270] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:26:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:26:41.618001 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b8711-abb4-4ee0-974f-edc05c1939ae None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:41.649132 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:26:41.714931 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b8711-abb4-4ee0-974f-edc05c1939ae None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:41.748980 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a2de80-71c5-4e44-83d5-d231ce75880a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:41.749886 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2de80-71c5-4e44-83d5-d231ce75880a None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:41.750167 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2de80-71c5-4e44-83d5-d231ce75880a None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:41.750472 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2de80-71c5-4e44-83d5-d231ce75880a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:41.757443 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a2de80-71c5-4e44-83d5-d231ce75880a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:41.758868 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a2de80-71c5-4e44-83d5-d231ce75880a None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:41.772688 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-57a2de80-71c5-4e44-83d5-d231ce75880a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:26:41.772688 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:26:41.772688 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:26:41.772688 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:26:41.772688 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:26:41.772688 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:26:41.772688 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:26:41.772688 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:26:41.772688 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:26:41.772688 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:26:41.772688 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:26:41.772688 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:26:41.772688 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:26:41.772688 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:26:41.772688 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:26:41.775857 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:26:41.775857 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:26:41.775857 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:26:41.775857 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:26:41.775857 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:26:41.775857 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:26:41.775857 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:26:41.775857 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:26:41.775857 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:26:41.775857 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:26:41.775857 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:26:41.775857 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:26:41.775857 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:26:41.775857 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:26:41.775857 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:26:41.775857 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:26:41.775857 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:26:41.776971 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:26:41.776971 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:26:41.776971 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:26:41.776971 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:26:41.776971 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:26:41.776971 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:26:41.776971 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:26:41.776971 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:26:41.776971 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 633/1271] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 10:26:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 10:26:41.780019 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe2b9c-ab84-49d2-b800-c0806eda0196 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:41.841057 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:26:41.882956 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe2b9c-ab84-49d2-b800-c0806eda0196 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:41.916490 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aeb425-1854-4670-bf58-0596edef2dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:41.917183 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aeb425-1854-4670-bf58-0596edef2dae None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:41.917473 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aeb425-1854-4670-bf58-0596edef2dae None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:41.917745 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aeb425-1854-4670-bf58-0596edef2dae None admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:41.918522 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aeb425-1854-4670-bf58-0596edef2dae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:26:41.918831 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aeb425-1854-4670-bf58-0596edef2dae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:41.920253 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aeb425-1854-4670-bf58-0596edef2dae None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:41.932174 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 639/1272] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 10:26:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:26:41.938287 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a2de80-71c5-4e44-83d5-d231ce75880a None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:42.032460 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:26:42.041301 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a2de80-71c5-4e44-83d5-d231ce75880a None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:42.074407 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da00163-aed9-41e2-9b8b-751c8196c05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:42.075310 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da00163-aed9-41e2-9b8b-751c8196c05b None admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:42.075575 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da00163-aed9-41e2-9b8b-751c8196c05b None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:42.075848 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da00163-aed9-41e2-9b8b-751c8196c05b None admin] PATH_INFO: `/v3/projects/a6098fe56d304980aa14bd95b4b92c17/users/2330638e80a941cd9aeeb2fd615900d2/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:42.078989 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da00163-aed9-41e2-9b8b-751c8196c05b None admin] RBAC: Authorizing `identity:create_grant(project_id=a6098fe56d304980aa14bd95b4b92c17, user_id=2330638e80a941cd9aeeb2fd615900d2, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:42.080409 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da00163-aed9-41e2-9b8b-751c8196c05b None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:42.169212 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 634/1273] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Jul 18 10:26:41 2022] PUT /identity/v3/projects/a6098fe56d304980aa14bd95b4b92c17/users/2330638e80a941cd9aeeb2fd615900d2/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:26:44.137763 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a0505-c123-44ff-838e-d1fe62d2e192 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:44.141464 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a0505-c123-44ff-838e-d1fe62d2e192 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:44.141464 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a0505-c123-44ff-838e-d1fe62d2e192 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:44.141464 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 640/1274] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:26:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:26:44.145112 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e0e38-ce9c-4782-a9bf-8b476325c175 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:44.145491 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e0e38-ce9c-4782-a9bf-8b476325c175 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:44.145675 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e0e38-ce9c-4782-a9bf-8b476325c175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:44.162363 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-6f2e0e38-ce9c-4782-a9bf-8b476325c175 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:26:44.163547 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-6f2e0e38-ce9c-4782-a9bf-8b476325c175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:26:44.230012 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 635/1275] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:26:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:26:44.253674 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a0505-c123-44ff-838e-d1fe62d2e192 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:44.354300 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a0505-c123-44ff-838e-d1fe62d2e192 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:44.371588 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:26:44.389334 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74abc221-a1b1-48b0-8693-2224235c7fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:44.390122 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74abc221-a1b1-48b0-8693-2224235c7fff None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:44.390445 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74abc221-a1b1-48b0-8693-2224235c7fff None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:44.390746 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74abc221-a1b1-48b0-8693-2224235c7fff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:44.400588 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74abc221-a1b1-48b0-8693-2224235c7fff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 10:26:44.408754 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-74abc221-a1b1-48b0-8693-2224235c7fff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:26:44.408754 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:26:44.408754 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:26:44.408754 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:26:44.408754 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:26:44.408754 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:26:44.408754 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:26:44.408754 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:26:44.408754 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:26:44.408754 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:26:44.408754 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:26:44.408754 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:26:44.408754 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 10:26:44.408754 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 10:26:44.408754 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 10:26:44.408754 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 10:26:44.409862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 10:26:44.409862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 10:26:44.409862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 10:26:44.409862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 10:26:44.409862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:26:44.409862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:26:44.409862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:26:44.409862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:26:44.409862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:26:44.409862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:26:44.409862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:26:44.409862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:26:44.409862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:26:44.409862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:26:44.409862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:26:44.409862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:26:44.410746 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:26:44.410746 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:26:44.410746 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:26:44.410746 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:26:44.410746 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 10:26:44.410746 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 10:26:44.410746 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 10:26:44.410746 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 10:26:44.410746 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 10:26:44.410746 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 10:26:44.410746 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 10:26:44.410746 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:26:44.410746 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 641/1276] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Jul 18 10:26:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:26:44.416015 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e0e38-ce9c-4782-a9bf-8b476325c175 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:44.496550 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:26:44.514487 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e0e38-ce9c-4782-a9bf-8b476325c175 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:44.547603 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f3a902-99ff-446f-bc2f-d6c68143c39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:44.548262 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3a902-99ff-446f-bc2f-d6c68143c39a None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:44.548544 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3a902-99ff-446f-bc2f-d6c68143c39a None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:44.548815 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3a902-99ff-446f-bc2f-d6c68143c39a None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:44.549612 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f3a902-99ff-446f-bc2f-d6c68143c39a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:26:44.549919 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f3a902-99ff-446f-bc2f-d6c68143c39a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:44.551268 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f3a902-99ff-446f-bc2f-d6c68143c39a None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:44.559113 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 636/1277] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Jul 18 10:26:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:26:44.565009 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74abc221-a1b1-48b0-8693-2224235c7fff None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:44.667645 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74abc221-a1b1-48b0-8693-2224235c7fff None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:44.701330 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371fc936-8664-44bf-84ce-30de1fbd3de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:44.702119 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371fc936-8664-44bf-84ce-30de1fbd3de6 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:44.702408 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371fc936-8664-44bf-84ce-30de1fbd3de6 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:44.702804 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371fc936-8664-44bf-84ce-30de1fbd3de6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:44.713450 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371fc936-8664-44bf-84ce-30de1fbd3de6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:44.714922 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371fc936-8664-44bf-84ce-30de1fbd3de6 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:44.732918 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-371fc936-8664-44bf-84ce-30de1fbd3de6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:26:44.732918 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:26:44.732918 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:26:44.732918 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:26:44.732918 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:26:44.732918 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:26:44.732918 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:26:44.732918 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:26:44.732918 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:26:44.732918 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:26:44.732918 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:26:44.732918 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:26:44.732918 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:26:44.732918 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:26:44.732918 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:26:44.734488 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:26:44.734488 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:26:44.734488 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:26:44.734488 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:26:44.734488 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:26:44.734488 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:26:44.734488 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:26:44.734488 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:26:44.734488 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:26:44.734488 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:26:44.734488 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:26:44.734488 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:26:44.734488 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:26:44.734488 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:26:44.734488 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:26:44.734488 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:26:44.734488 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:26:44.740357 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:26:44.740357 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:26:44.740357 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:26:44.740357 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:26:44.740357 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 642/1278] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:26:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:26:44.740680 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f3a902-99ff-446f-bc2f-d6c68143c39a None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:44.840616 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f3a902-99ff-446f-bc2f-d6c68143c39a None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:44.874192 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e22ef-b05d-4fa9-9e86-62efdcf7cf65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:44.874969 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e22ef-b05d-4fa9-9e86-62efdcf7cf65 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:44.875252 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e22ef-b05d-4fa9-9e86-62efdcf7cf65 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:44.875528 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e22ef-b05d-4fa9-9e86-62efdcf7cf65 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:44.876312 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e22ef-b05d-4fa9-9e86-62efdcf7cf65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:26:44.876621 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e22ef-b05d-4fa9-9e86-62efdcf7cf65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:44.878028 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e22ef-b05d-4fa9-9e86-62efdcf7cf65 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:44.889705 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 637/1279] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:26:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:26:44.896315 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371fc936-8664-44bf-84ce-30de1fbd3de6 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:44.927147 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:26:44.995875 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371fc936-8664-44bf-84ce-30de1fbd3de6 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:45.030178 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96f180-2782-4d92-bb64-4b4ee0d574f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:45.031777 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96f180-2782-4d92-bb64-4b4ee0d574f7 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:45.031777 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96f180-2782-4d92-bb64-4b4ee0d574f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:45.032096 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96f180-2782-4d92-bb64-4b4ee0d574f7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:45.039151 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d96f180-2782-4d92-bb64-4b4ee0d574f7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:45.040620 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d96f180-2782-4d92-bb64-4b4ee0d574f7 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:45.055386 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-3d96f180-2782-4d92-bb64-4b4ee0d574f7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 18 10:26:45.055386 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:26:45.055386 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:26:45.055386 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:26:45.055386 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:26:45.055386 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:26:45.055386 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:26:45.055386 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:26:45.055386 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:26:45.055386 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:26:45.055386 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:26:45.055386 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:26:45.055386 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 10:26:45.055386 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 10:26:45.055386 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 10:26:45.055386 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 10:26:45.056549 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:26:45.056549 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:26:45.056549 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 10:26:45.056549 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:26:45.056549 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 10:26:45.056549 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 10:26:45.056549 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:26:45.056549 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:26:45.056549 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:26:45.056549 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:26:45.056549 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:26:45.056549 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:26:45.056549 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:26:45.056549 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:26:45.056549 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:26:45.056549 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:26:45.056549 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:26:45.056549 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:26:45.057602 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:26:45.057602 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:26:45.057602 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 10:26:45.057602 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 10:26:45.057602 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 10:26:45.057602 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 10:26:45.057602 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 10:26:45.057602 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 10:26:45.057602 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 18 10:26:45.057602 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:26:45.057602 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 643/1280] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:26:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:26:45.062867 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e22ef-b05d-4fa9-9e86-62efdcf7cf65 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:45.066724 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:26:45.164727 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e22ef-b05d-4fa9-9e86-62efdcf7cf65 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:45.198998 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9fa278-ebb1-42a9-96d9-e30c25b14537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:45.199608 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fa278-ebb1-42a9-96d9-e30c25b14537 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:45.199892 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fa278-ebb1-42a9-96d9-e30c25b14537 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:45.200168 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fa278-ebb1-42a9-96d9-e30c25b14537 None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:45.201002 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9fa278-ebb1-42a9-96d9-e30c25b14537 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:26:45.201345 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9fa278-ebb1-42a9-96d9-e30c25b14537 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:45.203454 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9fa278-ebb1-42a9-96d9-e30c25b14537 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:45.221068 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 638/1281] 10.222.0.39 () {56 vars in 1143 bytes} [Mon Jul 18 10:26:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:26:45.227147 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96f180-2782-4d92-bb64-4b4ee0d574f7 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:45.317890 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:26:45.327214 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96f180-2782-4d92-bb64-4b4ee0d574f7 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:45.360889 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e4d74-93b2-4538-8bf2-bda6374797e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:45.361581 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e4d74-93b2-4538-8bf2-bda6374797e8 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:45.361967 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e4d74-93b2-4538-8bf2-bda6374797e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:45.362216 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e4d74-93b2-4538-8bf2-bda6374797e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:45.429764 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180e4d74-93b2-4538-8bf2-bda6374797e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:45.431274 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180e4d74-93b2-4538-8bf2-bda6374797e8 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:45.519585 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:26:45.529532 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 644/1282] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Jul 18 10:26:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 10:26:45.535895 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9fa278-ebb1-42a9-96d9-e30c25b14537 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:45.595766 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:26:45.634752 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9fa278-ebb1-42a9-96d9-e30c25b14537 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:45.668022 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d387e1-5522-4450-a503-1876b44189f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:45.668807 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d387e1-5522-4450-a503-1876b44189f7 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:45.669111 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d387e1-5522-4450-a503-1876b44189f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:45.669384 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d387e1-5522-4450-a503-1876b44189f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:45.680621 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d387e1-5522-4450-a503-1876b44189f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:45.682073 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d387e1-5522-4450-a503-1876b44189f7 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:45.699403 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-a8d387e1-5522-4450-a503-1876b44189f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:26:45.699403 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:26:45.699403 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:26:45.699403 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:26:45.699403 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:26:45.699403 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:26:45.699403 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:26:45.699403 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:26:45.699403 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:26:45.699403 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:26:45.699403 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:26:45.699403 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:26:45.699403 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 10:26:45.699403 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 10:26:45.699403 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 10:26:45.700476 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 10:26:45.700476 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:26:45.700476 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:26:45.700476 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:26:45.700476 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:26:45.700476 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:26:45.700476 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:26:45.700476 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:26:45.700476 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:26:45.700476 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:26:45.700476 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:26:45.700476 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:26:45.700476 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:26:45.700476 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:26:45.700476 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:26:45.700476 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:26:45.700476 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:26:45.701467 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 10:26:45.701467 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 10:26:45.701467 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 10:26:45.701467 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:26:45.701467 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 639/1283] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:26:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:26:45.706444 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e4d74-93b2-4538-8bf2-bda6374797e8 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:45.807456 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e4d74-93b2-4538-8bf2-bda6374797e8 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:45.840331 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff4ebd-e3e5-4400-954f-be11ca0f3fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:45.840982 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff4ebd-e3e5-4400-954f-be11ca0f3fb6 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:45.841296 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff4ebd-e3e5-4400-954f-be11ca0f3fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:45.841570 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff4ebd-e3e5-4400-954f-be11ca0f3fb6 None admin] PATH_INFO: `/v3/domains` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:45.842282 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff4ebd-e3e5-4400-954f-be11ca0f3fb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:26:45.842584 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff4ebd-e3e5-4400-954f-be11ca0f3fb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:45.844059 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff4ebd-e3e5-4400-954f-be11ca0f3fb6 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:45.855074 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 645/1284] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Jul 18 10:26:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:26:45.861779 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d387e1-5522-4450-a503-1876b44189f7 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:45.962382 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d387e1-5522-4450-a503-1876b44189f7 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:45.976535 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:26:45.997471 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c82f5b6-1bbd-4a3e-aecb-575ded366eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:45.998262 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c82f5b6-1bbd-4a3e-aecb-575ded366eb4 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:45.998543 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c82f5b6-1bbd-4a3e-aecb-575ded366eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:45.998814 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c82f5b6-1bbd-4a3e-aecb-575ded366eb4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:46.005498 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c82f5b6-1bbd-4a3e-aecb-575ded366eb4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:46.006946 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c82f5b6-1bbd-4a3e-aecb-575ded366eb4 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:46.021274 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-1c82f5b6-1bbd-4a3e-aecb-575ded366eb4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:26:46.021274 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:26:46.021274 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:26:46.021274 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:26:46.021274 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:26:46.021274 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:26:46.021274 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:26:46.021274 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:26:46.021274 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:26:46.021274 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:26:46.021274 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:26:46.021274 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:26:46.021274 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 10:26:46.021274 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 10:26:46.021274 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 10:26:46.037019 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 10:26:46.037019 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:26:46.037019 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:26:46.037019 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:26:46.037019 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:26:46.037019 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:26:46.037019 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:26:46.037019 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:26:46.037019 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( Jul 18 10:26:46.037019 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:26:46.037019 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:26:46.037019 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:26:46.037019 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:26:46.037019 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:26:46.037019 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:26:46.037019 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:26:46.037019 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:26:46.038242 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 10:26:46.038242 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 10:26:46.038242 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 10:26:46.038242 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 10:26:46.038242 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 10:26:46.038242 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 10:26:46.038242 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 10:26:46.038242 dv-cinder-837546-3-smb devstack@keystone.service[80393]: ERROR keystone.server.flask.application Jul 18 10:26:46.038242 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 640/1285] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Jul 18 10:26:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:26:46.038839 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff4ebd-e3e5-4400-954f-be11ca0f3fb6 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:46.080799 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:26:46.129883 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff4ebd-e3e5-4400-954f-be11ca0f3fb6 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:46.161785 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca922e9-4f5f-4e79-a4c2-b8490f829092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:46.162634 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca922e9-4f5f-4e79-a4c2-b8490f829092 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:46.163153 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca922e9-4f5f-4e79-a4c2-b8490f829092 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:46.163959 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca922e9-4f5f-4e79-a4c2-b8490f829092 None admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:46.164764 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca922e9-4f5f-4e79-a4c2-b8490f829092 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:26:46.165106 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca922e9-4f5f-4e79-a4c2-b8490f829092 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:46.166547 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca922e9-4f5f-4e79-a4c2-b8490f829092 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:46.179011 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 646/1286] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Jul 18 10:26:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:26:46.185085 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c82f5b6-1bbd-4a3e-aecb-575ded366eb4 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:46.283931 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c82f5b6-1bbd-4a3e-aecb-575ded366eb4 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:46.317874 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d5757-ac47-49b8-823f-03b6bb5a4633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:46.318534 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d5757-ac47-49b8-823f-03b6bb5a4633 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:46.318820 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d5757-ac47-49b8-823f-03b6bb5a4633 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:46.319098 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d5757-ac47-49b8-823f-03b6bb5a4633 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:46.319930 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9d5757-ac47-49b8-823f-03b6bb5a4633 None admin] RBAC: Adding query filter params (role.id=e7b6a55ecf6c491487955aaefbf9c388, scope.project.id=a6098fe56d304980aa14bd95b4b92c17, user.id=2330638e80a941cd9aeeb2fd615900d2) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:26:46.320267 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9d5757-ac47-49b8-823f-03b6bb5a4633 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:46.321706 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9d5757-ac47-49b8-823f-03b6bb5a4633 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:46.328761 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 641/1287] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Jul 18 10:26:46 2022] GET /identity/v3/role_assignments?user.id=2330638e80a941cd9aeeb2fd615900d2&scope.project.id=a6098fe56d304980aa14bd95b4b92c17&role.id=e7b6a55ecf6c491487955aaefbf9c388 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:26:48.382639 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ce835-a6af-4798-947d-909e92dd29b1 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:48.383125 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ce835-a6af-4798-947d-909e92dd29b1 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:48.383125 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524ce835-a6af-4798-947d-909e92dd29b1 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:48.384453 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 647/1288] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:26:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:26:48.389786 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4351ba9-5006-4e07-9220-6857d1e3422a None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:48.390272 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4351ba9-5006-4e07-9220-6857d1e3422a None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:48.390489 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4351ba9-5006-4e07-9220-6857d1e3422a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:48.408085 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-f4351ba9-5006-4e07-9220-6857d1e3422a None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:26:48.409352 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-f4351ba9-5006-4e07-9220-6857d1e3422a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:26:48.439834 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:26:48.477794 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 642/1289] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:26:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:26:48.500373 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524ce835-a6af-4798-947d-909e92dd29b1 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:48.602095 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524ce835-a6af-4798-947d-909e92dd29b1 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:48.612629 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:26:48.635199 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66590489-05f3-4c8e-ac2d-b26e28c7ec17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:48.635936 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66590489-05f3-4c8e-ac2d-b26e28c7ec17 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:48.636218 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66590489-05f3-4c8e-ac2d-b26e28c7ec17 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:48.636497 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66590489-05f3-4c8e-ac2d-b26e28c7ec17 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:48.637251 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66590489-05f3-4c8e-ac2d-b26e28c7ec17 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:48.638623 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66590489-05f3-4c8e-ac2d-b26e28c7ec17 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:48.651819 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-66590489-05f3-4c8e-ac2d-b26e28c7ec17 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 10:26:48.651819 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:26:48.651819 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 10:26:48.651819 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 10:26:48.651819 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 10:26:48.651819 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 10:26:48.651819 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 10:26:48.651819 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:26:48.651819 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 10:26:48.651819 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:26:48.651819 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 10:26:48.651819 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:26:48.651819 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:26:48.651819 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:26:48.651819 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:26:48.651819 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:26:48.651819 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:26:48.653027 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:26:48.653027 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:26:48.653027 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:26:48.653027 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:26:48.653027 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:26:48.653027 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:26:48.653027 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 10:26:48.653027 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 10:26:48.653027 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 10:26:48.653027 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 10:26:48.653027 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:26:48.653027 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:26:48.653027 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:26:48.653027 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:26:48.653027 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:26:48.653027 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:26:48.653940 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:26:48.653940 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:26:48.653940 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:26:48.653940 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:26:48.653940 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:26:48.653940 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:26:48.653940 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:26:48.653940 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:26:48.653940 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:26:48.653940 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:26:48.653940 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 10:26:48.653940 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:26:48.653940 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 10:26:48.653940 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:26:48.653940 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 648/1290] 10.222.0.39 () {56 vars in 1117 bytes} [Mon Jul 18 10:26:48 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:26:48.659935 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4351ba9-5006-4e07-9220-6857d1e3422a None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:48.757532 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4351ba9-5006-4e07-9220-6857d1e3422a None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:48.791851 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a3aaff-5ded-4bbd-8f32-2160f85a593a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:48.792512 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3aaff-5ded-4bbd-8f32-2160f85a593a None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:48.792791 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3aaff-5ded-4bbd-8f32-2160f85a593a None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:48.793088 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3aaff-5ded-4bbd-8f32-2160f85a593a None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:48.793785 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a3aaff-5ded-4bbd-8f32-2160f85a593a None admin] RBAC: Adding query filter params (name=placement) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:26:48.794088 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a3aaff-5ded-4bbd-8f32-2160f85a593a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:48.795427 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a3aaff-5ded-4bbd-8f32-2160f85a593a None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:48.800371 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 643/1291] 10.222.0.39 () {56 vars in 1116 bytes} [Mon Jul 18 10:26:48 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:26:48.806305 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66590489-05f3-4c8e-ac2d-b26e28c7ec17 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:48.904277 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66590489-05f3-4c8e-ac2d-b26e28c7ec17 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:48.938469 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99187a9-b9dc-454f-b7bd-cb66ebd3f862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:48.939134 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99187a9-b9dc-454f-b7bd-cb66ebd3f862 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:48.939417 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99187a9-b9dc-454f-b7bd-cb66ebd3f862 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:48.939693 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99187a9-b9dc-454f-b7bd-cb66ebd3f862 None admin] PATH_INFO: `/v3/services` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:48.940396 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99187a9-b9dc-454f-b7bd-cb66ebd3f862 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:26:48.940702 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99187a9-b9dc-454f-b7bd-cb66ebd3f862 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:48.942101 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99187a9-b9dc-454f-b7bd-cb66ebd3f862 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:48.946588 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 649/1292] 10.222.0.39 () {56 vars in 1116 bytes} [Mon Jul 18 10:26:48 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:26:50.975683 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf17c8b-8880-4f1f-b306-cff92e03f4b2 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:50.976245 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf17c8b-8880-4f1f-b306-cff92e03f4b2 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:50.976245 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf17c8b-8880-4f1f-b306-cff92e03f4b2 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:50.977947 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 644/1293] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:26:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:26:50.983285 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d738d1-3408-4b3d-9f55-7789eede2839 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:50.983918 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d738d1-3408-4b3d-9f55-7789eede2839 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:50.984106 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d738d1-3408-4b3d-9f55-7789eede2839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:51.001431 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-78d738d1-3408-4b3d-9f55-7789eede2839 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:26:51.008186 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-78d738d1-3408-4b3d-9f55-7789eede2839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:26:51.037795 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:26:51.075015 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 650/1294] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:26:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:26:51.099178 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf17c8b-8880-4f1f-b306-cff92e03f4b2 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:51.130154 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:26:51.198592 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf17c8b-8880-4f1f-b306-cff92e03f4b2 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:51.233090 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeb2ff0-55b6-477e-80c3-3a99d7f43e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:51.233905 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb2ff0-55b6-477e-80c3-3a99d7f43e96 None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:51.234182 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb2ff0-55b6-477e-80c3-3a99d7f43e96 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:51.234457 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeb2ff0-55b6-477e-80c3-3a99d7f43e96 None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:51.235177 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeb2ff0-55b6-477e-80c3-3a99d7f43e96 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:51.236566 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeb2ff0-55b6-477e-80c3-3a99d7f43e96 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:51.323319 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 645/1295] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Jul 18 10:26:51 2022] POST /identity/v3/services => generated 246 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:26:53.349003 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778174b8-e9a3-4225-9cc4-5a4b1e8cdcb8 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:53.349745 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778174b8-e9a3-4225-9cc4-5a4b1e8cdcb8 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:53.349745 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778174b8-e9a3-4225-9cc4-5a4b1e8cdcb8 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:53.350976 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 651/1296] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:26:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:26:53.356586 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01de30-4084-4b19-af96-5e7138d903ce None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:53.357001 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01de30-4084-4b19-af96-5e7138d903ce None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:53.357158 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01de30-4084-4b19-af96-5e7138d903ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:53.374815 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-ab01de30-4084-4b19-af96-5e7138d903ce None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:26:53.376016 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-ab01de30-4084-4b19-af96-5e7138d903ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:26:53.448203 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 646/1297] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:26:53 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:26:53.471613 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778174b8-e9a3-4225-9cc4-5a4b1e8cdcb8 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:53.570278 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778174b8-e9a3-4225-9cc4-5a4b1e8cdcb8 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:53.603487 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0082d75e-4109-44b8-97b4-d823c5bc3efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:53.604277 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082d75e-4109-44b8-97b4-d823c5bc3efa None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:53.604555 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082d75e-4109-44b8-97b4-d823c5bc3efa None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:53.604825 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082d75e-4109-44b8-97b4-d823c5bc3efa None admin] PATH_INFO: `/v3/services/placement` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:53.605492 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0082d75e-4109-44b8-97b4-d823c5bc3efa None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:53.606989 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0082d75e-4109-44b8-97b4-d823c5bc3efa None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:53.619209 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-0082d75e-4109-44b8-97b4-d823c5bc3efa None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 10:26:53.619209 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:26:53.619209 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 10:26:53.619209 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 10:26:53.619209 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 10:26:53.619209 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 10:26:53.619209 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 10:26:53.619209 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:26:53.619209 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 10:26:53.619209 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:26:53.619209 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 10:26:53.619209 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:26:53.619209 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:26:53.619209 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:26:53.619209 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:26:53.619209 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:26:53.619209 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:26:53.620396 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:26:53.620396 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:26:53.620396 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:26:53.620396 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:26:53.620396 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:26:53.620396 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:26:53.620396 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 10:26:53.620396 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 10:26:53.620396 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 10:26:53.620396 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 10:26:53.620396 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:26:53.620396 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:26:53.620396 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:26:53.620396 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:26:53.620396 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:26:53.620396 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:26:53.621379 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:26:53.621379 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:26:53.621379 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:26:53.621379 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:26:53.621379 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:26:53.621379 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:26:53.621379 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:26:53.621379 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:26:53.621379 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:26:53.621379 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:26:53.621379 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 10:26:53.621379 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:26:53.621379 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 10:26:53.621379 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:26:53.621379 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 652/1298] 10.222.0.39 () {56 vars in 1117 bytes} [Mon Jul 18 10:26:53 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:26:53.627002 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab01de30-4084-4b19-af96-5e7138d903ce None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:53.645662 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:26:53.722965 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab01de30-4084-4b19-af96-5e7138d903ce None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:53.756653 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12953edd-1835-4b0a-9b0c-f98ea753e61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:53.757337 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12953edd-1835-4b0a-9b0c-f98ea753e61c None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:53.757617 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12953edd-1835-4b0a-9b0c-f98ea753e61c None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:53.757889 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12953edd-1835-4b0a-9b0c-f98ea753e61c None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:53.758575 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12953edd-1835-4b0a-9b0c-f98ea753e61c None admin] RBAC: Adding query filter params (name=placement) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:26:53.758875 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12953edd-1835-4b0a-9b0c-f98ea753e61c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:53.760222 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12953edd-1835-4b0a-9b0c-f98ea753e61c None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:53.766028 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 647/1299] 10.222.0.39 () {56 vars in 1116 bytes} [Mon Jul 18 10:26:53 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:26:53.771917 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0082d75e-4109-44b8-97b4-d823c5bc3efa None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:53.803215 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:26:53.872033 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0082d75e-4109-44b8-97b4-d823c5bc3efa None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:53.904933 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71408fbf-6274-485a-b15a-dd976bfa2e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:53.905747 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71408fbf-6274-485a-b15a-dd976bfa2e66 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:53.906163 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71408fbf-6274-485a-b15a-dd976bfa2e66 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:53.906421 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71408fbf-6274-485a-b15a-dd976bfa2e66 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:53.907203 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71408fbf-6274-485a-b15a-dd976bfa2e66 None admin] RBAC: Adding query filter params (interface=public, service_id=d99b4424d42d42479491cf084d3a3ad4, region_id=RegionOne) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:26:53.907539 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71408fbf-6274-485a-b15a-dd976bfa2e66 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:53.908913 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71408fbf-6274-485a-b15a-dd976bfa2e66 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:53.914035 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 653/1300] 10.222.0.39 () {56 vars in 1251 bytes} [Mon Jul 18 10:26:53 2022] GET /identity/v3/endpoints?service_id=d99b4424d42d42479491cf084d3a3ad4&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:26:53.919863 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12953edd-1835-4b0a-9b0c-f98ea753e61c None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:54.000816 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:26:54.018025 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12953edd-1835-4b0a-9b0c-f98ea753e61c None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:54.050766 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14739989-139e-4fac-828c-dd9253ba4ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:54.051415 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14739989-139e-4fac-828c-dd9253ba4ef1 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:54.051695 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14739989-139e-4fac-828c-dd9253ba4ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:54.051971 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14739989-139e-4fac-828c-dd9253ba4ef1 None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:54.052643 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14739989-139e-4fac-828c-dd9253ba4ef1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:54.054001 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14739989-139e-4fac-828c-dd9253ba4ef1 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:54.060675 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 648/1301] 10.222.0.39 () {56 vars in 1087 bytes} [Mon Jul 18 10:26:53 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:26:56.074698 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b7014-5a88-4919-bb38-0a38acb715f3 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:56.075422 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b7014-5a88-4919-bb38-0a38acb715f3 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:56.075422 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b7014-5a88-4919-bb38-0a38acb715f3 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:56.076759 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 654/1302] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:26:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:26:56.083349 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beafdb14-7b8b-48d3-9ca1-1a4fc682123a None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:56.083764 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beafdb14-7b8b-48d3-9ca1-1a4fc682123a None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:56.083894 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beafdb14-7b8b-48d3-9ca1-1a4fc682123a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:56.101662 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-beafdb14-7b8b-48d3-9ca1-1a4fc682123a None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:26:56.102851 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-beafdb14-7b8b-48d3-9ca1-1a4fc682123a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:26:56.169875 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 649/1303] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:26:56 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 10:26:56.192736 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b7014-5a88-4919-bb38-0a38acb715f3 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:56.291244 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:26:56.298154 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b7014-5a88-4919-bb38-0a38acb715f3 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:56.332278 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb12b140-541f-42b4-bd98-e6ea1051d566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:56.333009 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12b140-541f-42b4-bd98-e6ea1051d566 None admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:56.333366 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12b140-541f-42b4-bd98-e6ea1051d566 None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:56.333639 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12b140-541f-42b4-bd98-e6ea1051d566 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:56.334280 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb12b140-541f-42b4-bd98-e6ea1051d566 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:56.335645 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb12b140-541f-42b4-bd98-e6ea1051d566 None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:56.347804 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application [None req-eb12b140-541f-42b4-bd98-e6ea1051d566 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 10:26:56.347804 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:26:56.347804 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 10:26:56.347804 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 10:26:56.347804 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 10:26:56.347804 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 10:26:56.347804 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 10:26:56.347804 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:26:56.347804 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 10:26:56.347804 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:26:56.347804 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 10:26:56.347804 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:26:56.347804 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 10:26:56.347804 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 10:26:56.347804 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 10:26:56.347804 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 10:26:56.347804 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 10:26:56.353295 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 10:26:56.353295 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 10:26:56.353295 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 10:26:56.353295 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 10:26:56.353295 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 10:26:56.353295 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 10:26:56.353295 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 10:26:56.353295 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 10:26:56.353295 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 10:26:56.353295 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 10:26:56.353295 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 10:26:56.353295 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 10:26:56.353295 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 10:26:56.353295 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 10:26:56.353295 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 10:26:56.353295 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 10:26:56.354334 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 10:26:56.354334 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application with Lock( Jul 18 10:26:56.354334 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 10:26:56.354334 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self._enter() Jul 18 10:26:56.354334 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 10:26:56.354334 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 10:26:56.354334 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 10:26:56.354334 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application return self.creator() Jul 18 10:26:56.354334 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 10:26:56.354334 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application created_value = creator( Jul 18 10:26:56.354334 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 10:26:56.354334 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 10:26:56.354334 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 10:26:56.354334 dv-cinder-837546-3-smb devstack@keystone.service[80392]: ERROR keystone.server.flask.application Jul 18 10:26:56.354334 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 655/1304] 10.222.0.39 () {56 vars in 1117 bytes} [Mon Jul 18 10:26:56 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 10:26:56.356142 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beafdb14-7b8b-48d3-9ca1-1a4fc682123a None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:56.433817 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:26:56.456627 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beafdb14-7b8b-48d3-9ca1-1a4fc682123a None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:56.491522 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd32805-b458-45dc-94c6-48924c84903e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:56.492185 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd32805-b458-45dc-94c6-48924c84903e None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:56.492471 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd32805-b458-45dc-94c6-48924c84903e None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:56.492752 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd32805-b458-45dc-94c6-48924c84903e None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:56.493548 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd32805-b458-45dc-94c6-48924c84903e None admin] RBAC: Adding query filter params (name=placement) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:26:56.493862 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd32805-b458-45dc-94c6-48924c84903e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:56.495214 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd32805-b458-45dc-94c6-48924c84903e None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:56.500461 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 650/1305] 10.222.0.39 () {56 vars in 1116 bytes} [Mon Jul 18 10:26:56 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:26:56.506216 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb12b140-541f-42b4-bd98-e6ea1051d566 None admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:26:56.612292 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb12b140-541f-42b4-bd98-e6ea1051d566 None admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:26:56.647334 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852cd18a-5e42-4c99-a43c-c50911d824fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:26:56.648117 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852cd18a-5e42-4c99-a43c-c50911d824fb None admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:26:56.648404 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852cd18a-5e42-4c99-a43c-c50911d824fb None admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:26:56.648677 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852cd18a-5e42-4c99-a43c-c50911d824fb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:26:56.649474 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852cd18a-5e42-4c99-a43c-c50911d824fb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:26:56.650830 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852cd18a-5e42-4c99-a43c-c50911d824fb None admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:26:56.740418 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 656/1306] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Jul 18 10:26:56 2022] POST /identity/v3/endpoints => generated 331 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:27:06.497231 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=30 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:27:06.736237 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:10.915860 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca39de-8605-47b0-821a-35726c1ebad3 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:10.916448 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca39de-8605-47b0-821a-35726c1ebad3 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:10.916448 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca39de-8605-47b0-821a-35726c1ebad3 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:10.923571 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a714f-695e-4619-9c1b-98debf3d3101 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:10.924038 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a714f-695e-4619-9c1b-98debf3d3101 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:10.924119 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a714f-695e-4619-9c1b-98debf3d3101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:10.926416 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 651/1307] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:33:10 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:33:11.003831 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-fa5a714f-695e-4619-9c1b-98debf3d3101 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:33:11.005111 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-fa5a714f-695e-4619-9c1b-98debf3d3101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:11.146091 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 657/1308] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:33:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:33:11.186278 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405cd7cd-4393-421a-b6bc-0ca8cb62b205 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:11.186787 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405cd7cd-4393-421a-b6bc-0ca8cb62b205 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:11.187368 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405cd7cd-4393-421a-b6bc-0ca8cb62b205 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:11.190005 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 652/1309] 10.222.0.39 () {54 vars in 965 bytes} [Mon Jul 18 10:33:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:33:11.197908 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f5f7b-849b-4ce6-8af3-c1b817633ac7 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:11.198300 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f5f7b-849b-4ce6-8af3-c1b817633ac7 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:11.198460 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f5f7b-849b-4ce6-8af3-c1b817633ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:11.337645 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-fa2f5f7b-849b-4ce6-8af3-c1b817633ac7 None None] MFA Rules not processed for user `2f88e3a2b95e477bae1cc98e9e18dc24`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:33:11.338985 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-fa2f5f7b-849b-4ce6-8af3-c1b817633ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:11.364889 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:11.427029 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 658/1310] 10.222.0.39 () {58 vars in 1062 bytes} [Mon Jul 18 10:33:11 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:33:11.439535 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405cd7cd-4393-421a-b6bc-0ca8cb62b205 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:33:11.441318 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-405cd7cd-4393-421a-b6bc-0ca8cb62b205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:11.572854 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405cd7cd-4393-421a-b6bc-0ca8cb62b205 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:33:11.659489 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da058320-ab3a-413d-9a36-e29e456279a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:33:11.660106 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da058320-ab3a-413d-9a36-e29e456279a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:11.660502 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da058320-ab3a-413d-9a36-e29e456279a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:11.661006 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da058320-ab3a-413d-9a36-e29e456279a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:11.662756 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-da058320-ab3a-413d-9a36-e29e456279a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:11.725541 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:11.788846 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da058320-ab3a-413d-9a36-e29e456279a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:33:11.790492 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da058320-ab3a-413d-9a36-e29e456279a6 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:33:11.812359 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 653/1311] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:33:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:33:14.208550 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723216b9-b7a1-4443-8ec4-92ec76527489 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:14.209094 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723216b9-b7a1-4443-8ec4-92ec76527489 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:14.209094 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723216b9-b7a1-4443-8ec4-92ec76527489 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:14.210852 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 659/1312] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:33:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:33:14.216409 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040171a-ca60-464c-8999-89537408fb0d None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:14.216943 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040171a-ca60-464c-8999-89537408fb0d None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:14.217027 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b040171a-ca60-464c-8999-89537408fb0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:14.310770 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-b040171a-ca60-464c-8999-89537408fb0d None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:33:14.312769 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-b040171a-ca60-464c-8999-89537408fb0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:14.413474 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 654/1313] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:33:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:33:14.453780 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723216b9-b7a1-4443-8ec4-92ec76527489 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:33:14.455388 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-723216b9-b7a1-4443-8ec4-92ec76527489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:14.570035 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723216b9-b7a1-4443-8ec4-92ec76527489 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:33:14.641646 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:14.644152 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03284d0c-4622-43ed-aedb-d51683abf776 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:33:14.644800 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03284d0c-4622-43ed-aedb-d51683abf776 service neutron] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:14.645112 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03284d0c-4622-43ed-aedb-d51683abf776 service neutron] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:14.645396 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03284d0c-4622-43ed-aedb-d51683abf776 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:14.647041 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-03284d0c-4622-43ed-aedb-d51683abf776 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:14.757559 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03284d0c-4622-43ed-aedb-d51683abf776 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:33:14.758995 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03284d0c-4622-43ed-aedb-d51683abf776 service neutron] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:33:14.777479 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 660/1314] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:33:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:33:17.283404 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629100d-8a79-49ef-a13f-9e34d2798176 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:17.283964 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629100d-8a79-49ef-a13f-9e34d2798176 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:17.283964 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629100d-8a79-49ef-a13f-9e34d2798176 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:17.285377 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 655/1315] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:33:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:33:17.290502 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b1958-8a47-4ff7-997c-814d02245b38 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:17.290901 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b1958-8a47-4ff7-997c-814d02245b38 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:17.291061 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b1958-8a47-4ff7-997c-814d02245b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:17.356058 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-593b1958-8a47-4ff7-997c-814d02245b38 None None] MFA Rules not processed for user `7a03ae73926e423685124aabba9f801a`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:33:17.357242 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-593b1958-8a47-4ff7-997c-814d02245b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:17.408852 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:17.455504 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 661/1316] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:33:17 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:33:17.507615 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93982df5-399f-47cb-babd-c06cc3eef77e None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:17.507904 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93982df5-399f-47cb-babd-c06cc3eef77e None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:17.508185 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93982df5-399f-47cb-babd-c06cc3eef77e None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:17.509630 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 656/1317] 10.222.0.39 () {54 vars in 965 bytes} [Mon Jul 18 10:33:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:33:17.516035 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484ea41-9438-4b8d-bf0e-760ad22c072d None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:17.516327 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484ea41-9438-4b8d-bf0e-760ad22c072d None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:17.516639 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484ea41-9438-4b8d-bf0e-760ad22c072d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:17.595473 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-1484ea41-9438-4b8d-bf0e-760ad22c072d None None] MFA Rules not processed for user `2f88e3a2b95e477bae1cc98e9e18dc24`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:33:17.596676 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-1484ea41-9438-4b8d-bf0e-760ad22c072d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:17.673480 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 662/1318] 10.222.0.39 () {58 vars in 1062 bytes} [Mon Jul 18 10:33:17 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:33:17.682442 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93982df5-399f-47cb-babd-c06cc3eef77e None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:33:17.683977 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-93982df5-399f-47cb-babd-c06cc3eef77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:17.694395 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:17.790395 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93982df5-399f-47cb-babd-c06cc3eef77e None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:33:17.863234 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d707cfb-ed2e-45e7-a154-2b7aa495c59f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:33:17.863895 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d707cfb-ed2e-45e7-a154-2b7aa495c59f service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:17.864177 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d707cfb-ed2e-45e7-a154-2b7aa495c59f service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:17.864453 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d707cfb-ed2e-45e7-a154-2b7aa495c59f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:17.866130 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-4d707cfb-ed2e-45e7-a154-2b7aa495c59f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:17.926564 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:17.974108 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d707cfb-ed2e-45e7-a154-2b7aa495c59f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:33:17.975524 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d707cfb-ed2e-45e7-a154-2b7aa495c59f service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:33:17.994033 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 657/1319] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:33:17 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:33:21.283928 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76139e1b-18ff-4150-8841-f247e8c14a1a None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:21.284451 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76139e1b-18ff-4150-8841-f247e8c14a1a None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:21.284542 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76139e1b-18ff-4150-8841-f247e8c14a1a None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:21.285917 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 663/1320] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:33:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:33:21.291181 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6ffe3-3f91-473e-b8b2-74c758e1a806 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:21.291596 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6ffe3-3f91-473e-b8b2-74c758e1a806 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:21.291743 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6ffe3-3f91-473e-b8b2-74c758e1a806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:21.356382 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-02a6ffe3-3f91-473e-b8b2-74c758e1a806 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:33:21.357578 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-02a6ffe3-3f91-473e-b8b2-74c758e1a806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:21.454307 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 658/1321] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:33:21 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:33:21.493731 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76139e1b-18ff-4150-8841-f247e8c14a1a None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:33:21.495279 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-76139e1b-18ff-4150-8841-f247e8c14a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:21.545897 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:21.600561 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76139e1b-18ff-4150-8841-f247e8c14a1a None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:33:21.673225 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc1f1b2-6442-40f8-ac2c-c9559ff91107 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:33:21.673790 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1f1b2-6442-40f8-ac2c-c9559ff91107 service neutron] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:21.674071 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1f1b2-6442-40f8-ac2c-c9559ff91107 service neutron] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:21.674343 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1f1b2-6442-40f8-ac2c-c9559ff91107 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:21.675984 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-dcc1f1b2-6442-40f8-ac2c-c9559ff91107 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:21.769299 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:21.783924 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc1f1b2-6442-40f8-ac2c-c9559ff91107 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:33:21.785370 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc1f1b2-6442-40f8-ac2c-c9559ff91107 service neutron] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:33:21.803627 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 664/1322] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:33:21 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:33:24.847636 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdbde5f-d0af-47bf-a652-4a9ce83757c4 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:24.848091 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdbde5f-d0af-47bf-a652-4a9ce83757c4 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:24.848220 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdbde5f-d0af-47bf-a652-4a9ce83757c4 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:24.849629 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 659/1323] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:33:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:33:24.854810 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ff5dd-6ab5-417f-a156-9e93e7ceedea None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:24.855235 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ff5dd-6ab5-417f-a156-9e93e7ceedea None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:24.855370 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ff5dd-6ab5-417f-a156-9e93e7ceedea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:24.926619 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-757ff5dd-6ab5-417f-a156-9e93e7ceedea None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:33:24.927890 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-757ff5dd-6ab5-417f-a156-9e93e7ceedea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:25.025503 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 665/1324] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:33:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:33:25.063900 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdbde5f-d0af-47bf-a652-4a9ce83757c4 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:33:25.065465 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-2fdbde5f-d0af-47bf-a652-4a9ce83757c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:25.087409 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:25.185387 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdbde5f-d0af-47bf-a652-4a9ce83757c4 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:33:25.265809 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78190dc-6b0f-447f-a061-62c12eaee2f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:33:25.266463 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78190dc-6b0f-447f-a061-62c12eaee2f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:25.266746 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78190dc-6b0f-447f-a061-62c12eaee2f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:25.267020 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78190dc-6b0f-447f-a061-62c12eaee2f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:25.268672 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-e78190dc-6b0f-447f-a061-62c12eaee2f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:25.342523 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:25.380316 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78190dc-6b0f-447f-a061-62c12eaee2f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:33:25.381761 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78190dc-6b0f-447f-a061-62c12eaee2f3 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:33:25.399282 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 660/1325] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:33:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:33:27.517586 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a723a-8b75-4185-815e-1516ca57a670 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:27.518111 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a723a-8b75-4185-815e-1516ca57a670 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:27.518217 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a723a-8b75-4185-815e-1516ca57a670 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:27.519587 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 666/1326] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:33:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:33:27.524856 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf7d98-62e2-4fa2-b524-6ffb86c88042 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:27.525294 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf7d98-62e2-4fa2-b524-6ffb86c88042 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:27.525454 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf7d98-62e2-4fa2-b524-6ffb86c88042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:27.591048 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-dfdf7d98-62e2-4fa2-b524-6ffb86c88042 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:33:27.592243 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-dfdf7d98-62e2-4fa2-b524-6ffb86c88042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:27.688794 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 661/1327] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:33:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:33:27.725624 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a723a-8b75-4185-815e-1516ca57a670 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:33:27.727198 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-d89a723a-8b75-4185-815e-1516ca57a670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:27.788900 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:27.832298 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a723a-8b75-4185-815e-1516ca57a670 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:33:27.907748 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004e6d2e-2ee9-43b6-b06a-49e7a314e535 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:33:27.908395 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e6d2e-2ee9-43b6-b06a-49e7a314e535 service neutron] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:27.908676 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e6d2e-2ee9-43b6-b06a-49e7a314e535 service neutron] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:27.908951 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e6d2e-2ee9-43b6-b06a-49e7a314e535 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:27.910643 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-004e6d2e-2ee9-43b6-b06a-49e7a314e535 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:28.023218 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:28.025702 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004e6d2e-2ee9-43b6-b06a-49e7a314e535 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:33:28.027146 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004e6d2e-2ee9-43b6-b06a-49e7a314e535 service neutron] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:33:28.045777 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 667/1328] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:33:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:33:30.142524 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df55a66-1d25-4497-9b70-7f359ff7a437 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:30.143050 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df55a66-1d25-4497-9b70-7f359ff7a437 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:30.143281 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df55a66-1d25-4497-9b70-7f359ff7a437 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:30.144749 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 662/1329] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:33:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:33:30.150071 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b3727c-234d-4d7b-b914-21362632aa23 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:30.150515 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b3727c-234d-4d7b-b914-21362632aa23 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:30.150610 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b3727c-234d-4d7b-b914-21362632aa23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:30.218308 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-31b3727c-234d-4d7b-b914-21362632aa23 None None] MFA Rules not processed for user `7a03ae73926e423685124aabba9f801a`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:33:30.219507 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-31b3727c-234d-4d7b-b914-21362632aa23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:30.315121 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 668/1330] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:33:30 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:33:30.354358 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df55a66-1d25-4497-9b70-7f359ff7a437 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:33:30.355977 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-0df55a66-1d25-4497-9b70-7f359ff7a437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:30.391433 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:30.464980 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df55a66-1d25-4497-9b70-7f359ff7a437 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:33:30.540053 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a746c2c-97dc-48ef-afe0-e903bf13d575 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:33:30.540632 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a746c2c-97dc-48ef-afe0-e903bf13d575 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:30.540899 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a746c2c-97dc-48ef-afe0-e903bf13d575 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:30.541202 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a746c2c-97dc-48ef-afe0-e903bf13d575 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:30.542838 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-5a746c2c-97dc-48ef-afe0-e903bf13d575 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:30.624762 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:30.656686 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a746c2c-97dc-48ef-afe0-e903bf13d575 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:33:30.658176 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a746c2c-97dc-48ef-afe0-e903bf13d575 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:33:30.677414 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 663/1331] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:33:30 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:33:33.184060 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45bc4e8-63da-496d-a9ab-4e01a4982c5d None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:33.184591 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45bc4e8-63da-496d-a9ab-4e01a4982c5d None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:33.184591 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45bc4e8-63da-496d-a9ab-4e01a4982c5d None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:33.186739 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 669/1332] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:33:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:33:33.191931 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5377a9-996b-42b0-90de-0004a86681ea None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:33.192332 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5377a9-996b-42b0-90de-0004a86681ea None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:33.192487 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5377a9-996b-42b0-90de-0004a86681ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:33.257528 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-3e5377a9-996b-42b0-90de-0004a86681ea None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:33:33.258746 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-3e5377a9-996b-42b0-90de-0004a86681ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:33.352865 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 664/1333] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:33:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:33:33.390226 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45bc4e8-63da-496d-a9ab-4e01a4982c5d None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:33:33.391768 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-a45bc4e8-63da-496d-a9ab-4e01a4982c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:33.460434 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:33.495062 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45bc4e8-63da-496d-a9ab-4e01a4982c5d None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:33:33.568478 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd1382b-2ba9-4ace-95ec-df5ce2845c32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:33:33.569143 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd1382b-2ba9-4ace-95ec-df5ce2845c32 service neutron] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:33.569424 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd1382b-2ba9-4ace-95ec-df5ce2845c32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:33.569692 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd1382b-2ba9-4ace-95ec-df5ce2845c32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:33.571367 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-5cd1382b-2ba9-4ace-95ec-df5ce2845c32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:33.684706 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd1382b-2ba9-4ace-95ec-df5ce2845c32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:33:33.686190 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd1382b-2ba9-4ace-95ec-df5ce2845c32 service neutron] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:33:33.696035 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:33.704135 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 670/1334] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:33:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:33:35.824909 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d1fcf-c608-4400-847e-fd6bf1178d86 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:35.825496 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d1fcf-c608-4400-847e-fd6bf1178d86 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:35.825496 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d1fcf-c608-4400-847e-fd6bf1178d86 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:35.827427 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 665/1335] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:33:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:33:35.832659 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa86083-ebbc-4b63-9a60-6ea9b48ec5df None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:35.833106 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa86083-ebbc-4b63-9a60-6ea9b48ec5df None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:35.833239 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa86083-ebbc-4b63-9a60-6ea9b48ec5df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:35.896975 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-6fa86083-ebbc-4b63-9a60-6ea9b48ec5df None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:33:35.898207 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-6fa86083-ebbc-4b63-9a60-6ea9b48ec5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:35.992260 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 671/1336] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:33:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:33:36.033282 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d1fcf-c608-4400-847e-fd6bf1178d86 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:33:36.034825 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-109d1fcf-c608-4400-847e-fd6bf1178d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:36.074336 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:36.139731 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d1fcf-c608-4400-847e-fd6bf1178d86 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:33:36.211030 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0db633-651a-4a15-b790-6c7fd10ef486 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:33:36.211672 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0db633-651a-4a15-b790-6c7fd10ef486 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:36.211952 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0db633-651a-4a15-b790-6c7fd10ef486 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:36.212222 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0db633-651a-4a15-b790-6c7fd10ef486 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:36.213882 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-3b0db633-651a-4a15-b790-6c7fd10ef486 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:36.294275 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:36.322168 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0db633-651a-4a15-b790-6c7fd10ef486 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:33:36.323642 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0db633-651a-4a15-b790-6c7fd10ef486 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:33:36.341944 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 666/1337] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:33:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:33:38.924815 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e371073-04f8-4312-88d3-4278464799a2 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:38.925425 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e371073-04f8-4312-88d3-4278464799a2 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:38.925530 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e371073-04f8-4312-88d3-4278464799a2 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:38.926868 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 672/1338] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:33:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:33:38.932100 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a0daa-78a9-4f3f-861b-51bcb0524763 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:38.932583 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a0daa-78a9-4f3f-861b-51bcb0524763 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:38.932692 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a0daa-78a9-4f3f-861b-51bcb0524763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:38.997049 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-161a0daa-78a9-4f3f-861b-51bcb0524763 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:33:38.998319 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-161a0daa-78a9-4f3f-861b-51bcb0524763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:39.093698 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 667/1339] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:33:38 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:33:39.129773 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e371073-04f8-4312-88d3-4278464799a2 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:33:39.131333 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-9e371073-04f8-4312-88d3-4278464799a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:39.206918 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:39.234715 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e371073-04f8-4312-88d3-4278464799a2 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:33:39.311839 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d89dd4-fa32-45d5-927a-39a21d1a4a8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:33:39.312486 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d89dd4-fa32-45d5-927a-39a21d1a4a8f service neutron] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:39.312774 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d89dd4-fa32-45d5-927a-39a21d1a4a8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:39.313069 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d89dd4-fa32-45d5-927a-39a21d1a4a8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:39.314716 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-b5d89dd4-fa32-45d5-927a-39a21d1a4a8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:39.424425 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d89dd4-fa32-45d5-927a-39a21d1a4a8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:33:39.425799 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d89dd4-fa32-45d5-927a-39a21d1a4a8f service neutron] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:33:39.443448 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 673/1340] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:33:39 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:33:43.802897 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227ce68-e4a8-4fb3-b44f-5d554cf6f1f7 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:43.803411 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227ce68-e4a8-4fb3-b44f-5d554cf6f1f7 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:43.803534 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227ce68-e4a8-4fb3-b44f-5d554cf6f1f7 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:43.804823 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 668/1341] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:33:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:33:43.811186 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91079c90-fecf-4964-b936-5d167492aeb8 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:43.811634 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91079c90-fecf-4964-b936-5d167492aeb8 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:43.811765 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91079c90-fecf-4964-b936-5d167492aeb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:43.815994 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:43.883097 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-91079c90-fecf-4964-b936-5d167492aeb8 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:33:43.884575 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-91079c90-fecf-4964-b936-5d167492aeb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:43.986508 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 674/1342] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:33:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:33:44.025833 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e227ce68-e4a8-4fb3-b44f-5d554cf6f1f7 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:33:44.027369 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-e227ce68-e4a8-4fb3-b44f-5d554cf6f1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:44.077929 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:44.135083 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e227ce68-e4a8-4fb3-b44f-5d554cf6f1f7 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:33:44.208497 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2af269-6350-456b-93c1-3327c18f9d8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:33:44.209343 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2af269-6350-456b-93c1-3327c18f9d8f service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:44.209623 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2af269-6350-456b-93c1-3327c18f9d8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:44.209900 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2af269-6350-456b-93c1-3327c18f9d8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:44.211535 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-2f2af269-6350-456b-93c1-3327c18f9d8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:44.304339 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:44.321393 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2af269-6350-456b-93c1-3327c18f9d8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:33:44.322828 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2af269-6350-456b-93c1-3327c18f9d8f service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:33:44.342563 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 669/1343] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:33:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:33:47.364018 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a37a492-9e1f-4cc4-af59-401126d65e31 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:47.364543 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a37a492-9e1f-4cc4-af59-401126d65e31 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:47.364543 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a37a492-9e1f-4cc4-af59-401126d65e31 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:47.365913 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 675/1344] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:33:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:33:47.371246 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c94d59-fe59-4acd-9997-70902911a5a3 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:47.371663 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c94d59-fe59-4acd-9997-70902911a5a3 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:47.371813 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c94d59-fe59-4acd-9997-70902911a5a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:47.439911 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-94c94d59-fe59-4acd-9997-70902911a5a3 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:33:47.441151 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-94c94d59-fe59-4acd-9997-70902911a5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:47.541270 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 670/1345] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:33:47 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:33:47.580057 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a37a492-9e1f-4cc4-af59-401126d65e31 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:33:47.581632 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-1a37a492-9e1f-4cc4-af59-401126d65e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:47.670675 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:47.687512 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a37a492-9e1f-4cc4-af59-401126d65e31 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:33:47.763613 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd80749e-2811-4e08-b8af-7f0f1d28511a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:33:47.764423 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80749e-2811-4e08-b8af-7f0f1d28511a service neutron] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:47.764703 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80749e-2811-4e08-b8af-7f0f1d28511a service neutron] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:47.764970 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80749e-2811-4e08-b8af-7f0f1d28511a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:47.766762 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-fd80749e-2811-4e08-b8af-7f0f1d28511a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:47.879638 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd80749e-2811-4e08-b8af-7f0f1d28511a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:33:47.881094 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd80749e-2811-4e08-b8af-7f0f1d28511a service neutron] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:33:47.901316 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 676/1346] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:33:47 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:33:52.302171 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b266a-a7d9-43df-8e87-241a3632f7b3 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:52.302777 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b266a-a7d9-43df-8e87-241a3632f7b3 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:52.302777 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b266a-a7d9-43df-8e87-241a3632f7b3 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:52.304263 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 671/1347] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:33:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:33:52.310210 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1adea2-86ce-4999-bd67-69b418f0199b None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:52.310672 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1adea2-86ce-4999-bd67-69b418f0199b None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:52.310766 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1adea2-86ce-4999-bd67-69b418f0199b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:52.326214 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:52.382090 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-5b1adea2-86ce-4999-bd67-69b418f0199b None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:33:52.383335 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-5b1adea2-86ce-4999-bd67-69b418f0199b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:52.487412 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 677/1348] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:33:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:33:52.524883 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b266a-a7d9-43df-8e87-241a3632f7b3 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:33:52.526579 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-530b266a-a7d9-43df-8e87-241a3632f7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:52.587288 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:52.635736 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b266a-a7d9-43df-8e87-241a3632f7b3 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:33:52.712392 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e121dae-55ff-47b9-a352-34e01c59d9fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:33:52.713061 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e121dae-55ff-47b9-a352-34e01c59d9fd service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:52.713360 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e121dae-55ff-47b9-a352-34e01c59d9fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:52.713633 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e121dae-55ff-47b9-a352-34e01c59d9fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:52.715266 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-6e121dae-55ff-47b9-a352-34e01c59d9fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:52.820814 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:33:52.824290 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e121dae-55ff-47b9-a352-34e01c59d9fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:33:52.826607 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e121dae-55ff-47b9-a352-34e01c59d9fd service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:33:52.846101 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 672/1349] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:33:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:33:57.709684 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099dfff-9165-4c1f-8f9a-ad7c6ebd520c None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:57.710198 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099dfff-9165-4c1f-8f9a-ad7c6ebd520c None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:57.710378 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099dfff-9165-4c1f-8f9a-ad7c6ebd520c None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:57.712059 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 678/1350] 10.222.0.39 () {54 vars in 921 bytes} [Mon Jul 18 10:33:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:33:57.717945 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9846b2a-516f-4643-aecd-0eeab330e6ee None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:33:57.722507 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9846b2a-516f-4643-aecd-0eeab330e6ee None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:33:57.722507 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9846b2a-516f-4643-aecd-0eeab330e6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:33:57.859247 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-f9846b2a-516f-4643-aecd-0eeab330e6ee None None] MFA Rules not processed for user `2330638e80a941cd9aeeb2fd615900d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:33:57.860506 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-f9846b2a-516f-4643-aecd-0eeab330e6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:33:57.990587 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 673/1351] 10.222.0.39 () {58 vars in 1018 bytes} [Mon Jul 18 10:33:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:34:02.267433 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af00f1ed-6fd2-4f52-ba1b-45965b02c69b None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:02.267983 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af00f1ed-6fd2-4f52-ba1b-45965b02c69b None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:02.267983 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af00f1ed-6fd2-4f52-ba1b-45965b02c69b None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:02.269364 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 679/1352] 10.222.0.39 () {54 vars in 921 bytes} [Mon Jul 18 10:34:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:34:02.275811 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aad8bf-f095-48cd-99a7-98c26b4d19b8 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:02.276222 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aad8bf-f095-48cd-99a7-98c26b4d19b8 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:02.276383 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aad8bf-f095-48cd-99a7-98c26b4d19b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:02.331611 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:02.354628 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-69aad8bf-f095-48cd-99a7-98c26b4d19b8 None None] MFA Rules not processed for user `2330638e80a941cd9aeeb2fd615900d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:34:02.355865 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-69aad8bf-f095-48cd-99a7-98c26b4d19b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:02.479278 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 674/1353] 10.222.0.39 () {58 vars in 1018 bytes} [Mon Jul 18 10:34:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:34:02.485983 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=59 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:03.704629 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db07d31-4eb7-45a1-8459-d0fdb13662d2 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:03.705360 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db07d31-4eb7-45a1-8459-d0fdb13662d2 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:03.705360 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db07d31-4eb7-45a1-8459-d0fdb13662d2 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:03.706592 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 680/1354] 10.222.0.39 () {54 vars in 921 bytes} [Mon Jul 18 10:34:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:34:03.712109 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f68767-a417-418d-b122-f8d1a8f0e32a None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:03.712503 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f68767-a417-418d-b122-f8d1a8f0e32a None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:03.712659 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f68767-a417-418d-b122-f8d1a8f0e32a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:03.791598 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-67f68767-a417-418d-b122-f8d1a8f0e32a None None] MFA Rules not processed for user `2330638e80a941cd9aeeb2fd615900d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:34:03.792796 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-67f68767-a417-418d-b122-f8d1a8f0e32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:03.836126 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:03.903080 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 675/1355] 10.222.0.39 () {58 vars in 1018 bytes} [Mon Jul 18 10:34:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:34:07.311002 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63ea92-05bc-4c05-8c01-95e6fb3782a6 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:07.312881 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63ea92-05bc-4c05-8c01-95e6fb3782a6 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:07.313475 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63ea92-05bc-4c05-8c01-95e6fb3782a6 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:07.316119 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 681/1356] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:34:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:34:07.322243 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c72ed-e38c-41d0-9295-7bedbadae0b5 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:07.322697 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c72ed-e38c-41d0-9295-7bedbadae0b5 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:07.322800 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c72ed-e38c-41d0-9295-7bedbadae0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:07.400957 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-e66c72ed-e38c-41d0-9295-7bedbadae0b5 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:34:07.403371 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-e66c72ed-e38c-41d0-9295-7bedbadae0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:07.504295 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 676/1357] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:34:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:34:07.560429 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878b373-c6f6-4e31-902f-696719ae656f None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:07.561306 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878b373-c6f6-4e31-902f-696719ae656f None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:07.561795 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878b373-c6f6-4e31-902f-696719ae656f None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:07.564207 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 682/1358] 10.222.0.39 () {54 vars in 962 bytes} [Mon Jul 18 10:34:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:34:07.576604 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c467b-1334-47cb-8828-4cc68127daef None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:07.577021 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c467b-1334-47cb-8828-4cc68127daef None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:07.578381 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c467b-1334-47cb-8828-4cc68127daef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:07.595991 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:07.664568 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-1b2c467b-1334-47cb-8828-4cc68127daef None None] MFA Rules not processed for user `8bbebf16219943879df84bdc9a900516`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:34:07.666915 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-1b2c467b-1334-47cb-8828-4cc68127daef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:07.802672 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 677/1359] 10.222.0.39 () {58 vars in 1059 bytes} [Mon Jul 18 10:34:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:34:07.811059 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3878b373-c6f6-4e31-902f-696719ae656f None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:34:07.812887 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-3878b373-c6f6-4e31-902f-696719ae656f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:07.973620 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3878b373-c6f6-4e31-902f-696719ae656f None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:34:08.054352 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:08.103163 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf9691-48af-4f78-bd1a-1117b2cb7c4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bbebf16219943879df84bdc9a900516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:34:08.104031 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf9691-48af-4f78-bd1a-1117b2cb7c4d service nova] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:08.104896 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf9691-48af-4f78-bd1a-1117b2cb7c4d service nova] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:08.104896 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf9691-48af-4f78-bd1a-1117b2cb7c4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:08.107284 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-44bf9691-48af-4f78-bd1a-1117b2cb7c4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:08.206963 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf9691-48af-4f78-bd1a-1117b2cb7c4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:34:08.209886 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf9691-48af-4f78-bd1a-1117b2cb7c4d service nova] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:34:08.229315 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 683/1360] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:34:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:34:10.450956 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7449b578-2d2b-40a5-b361-a5d1ac76e9f4 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:10.451502 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7449b578-2d2b-40a5-b361-a5d1ac76e9f4 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:10.451502 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7449b578-2d2b-40a5-b361-a5d1ac76e9f4 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:10.452931 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 678/1361] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:34:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:34:10.458144 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322dc96-59d3-4df0-bae7-9a4dfc872b15 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:10.458564 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322dc96-59d3-4df0-bae7-9a4dfc872b15 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:10.458769 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322dc96-59d3-4df0-bae7-9a4dfc872b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:10.525753 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-2322dc96-59d3-4df0-bae7-9a4dfc872b15 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:34:10.527726 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-2322dc96-59d3-4df0-bae7-9a4dfc872b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:10.566292 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:10.630660 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 684/1362] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:34:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:34:10.675397 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7449b578-2d2b-40a5-b361-a5d1ac76e9f4 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:34:10.677105 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-7449b578-2d2b-40a5-b361-a5d1ac76e9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:10.753473 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:10.854228 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7449b578-2d2b-40a5-b361-a5d1ac76e9f4 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:34:10.993432 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9651986d-83ce-4820-9d8c-039a6c836e0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bbebf16219943879df84bdc9a900516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:34:10.994468 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651986d-83ce-4820-9d8c-039a6c836e0f service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:10.994831 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651986d-83ce-4820-9d8c-039a6c836e0f service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:10.995165 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9651986d-83ce-4820-9d8c-039a6c836e0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:10.997907 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-9651986d-83ce-4820-9d8c-039a6c836e0f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:11.032344 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:11.138232 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9651986d-83ce-4820-9d8c-039a6c836e0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:34:11.140206 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9651986d-83ce-4820-9d8c-039a6c836e0f service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:34:11.161176 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 679/1363] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:34:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:34:13.642237 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e43ce84-8181-483f-af86-4c321c2de245 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:13.643074 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e43ce84-8181-483f-af86-4c321c2de245 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:13.643529 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e43ce84-8181-483f-af86-4c321c2de245 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:13.644905 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 685/1364] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:34:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:34:13.650630 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e34318-0213-4eff-9fff-d70bec5b3f02 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:13.651060 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e34318-0213-4eff-9fff-d70bec5b3f02 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:13.651416 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e34318-0213-4eff-9fff-d70bec5b3f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:13.734186 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-78e34318-0213-4eff-9fff-d70bec5b3f02 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:34:13.735394 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-78e34318-0213-4eff-9fff-d70bec5b3f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:13.841030 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:13.845093 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 680/1365] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:34:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:34:13.894654 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3243310e-8dc8-463e-8fd1-205e7b12fbad None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:13.895103 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3243310e-8dc8-463e-8fd1-205e7b12fbad None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:13.895531 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3243310e-8dc8-463e-8fd1-205e7b12fbad None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:13.897126 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 686/1366] 10.222.0.39 () {54 vars in 962 bytes} [Mon Jul 18 10:34:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:34:13.903983 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a4b21-1f5a-4515-973c-eb3851cbc00b None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:13.908479 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a4b21-1f5a-4515-973c-eb3851cbc00b None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:13.908479 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a4b21-1f5a-4515-973c-eb3851cbc00b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:13.989127 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-f27a4b21-1f5a-4515-973c-eb3851cbc00b None None] MFA Rules not processed for user `8bbebf16219943879df84bdc9a900516`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:34:13.990487 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-f27a4b21-1f5a-4515-973c-eb3851cbc00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:14.123121 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 681/1367] 10.222.0.39 () {58 vars in 1059 bytes} [Mon Jul 18 10:34:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:34:14.131934 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3243310e-8dc8-463e-8fd1-205e7b12fbad None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:34:14.133815 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-3243310e-8dc8-463e-8fd1-205e7b12fbad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:14.299334 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3243310e-8dc8-463e-8fd1-205e7b12fbad None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:34:14.321798 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:14.423031 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c2e001-f9ef-4dc9-98d0-657fb124eef9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bbebf16219943879df84bdc9a900516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:34:14.423683 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2e001-f9ef-4dc9-98d0-657fb124eef9 service nova] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:14.423962 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2e001-f9ef-4dc9-98d0-657fb124eef9 service nova] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:14.424233 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2e001-f9ef-4dc9-98d0-657fb124eef9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:14.425899 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-75c2e001-f9ef-4dc9-98d0-657fb124eef9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:14.520086 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c2e001-f9ef-4dc9-98d0-657fb124eef9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:34:14.521728 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c2e001-f9ef-4dc9-98d0-657fb124eef9 service nova] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:34:14.541798 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 687/1368] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:34:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:34:15.605418 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26390d49-7411-42b1-a6d5-d1f7efd0a7e0 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:15.606053 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26390d49-7411-42b1-a6d5-d1f7efd0a7e0 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:15.606053 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26390d49-7411-42b1-a6d5-d1f7efd0a7e0 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:15.609161 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 682/1369] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:34:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:34:15.612874 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74260b8-05f6-4baa-8dd9-b4b8a5bba051 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:15.613611 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74260b8-05f6-4baa-8dd9-b4b8a5bba051 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:15.613991 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74260b8-05f6-4baa-8dd9-b4b8a5bba051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:15.647242 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:15.683368 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-d74260b8-05f6-4baa-8dd9-b4b8a5bba051 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:34:15.685573 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-d74260b8-05f6-4baa-8dd9-b4b8a5bba051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:15.789642 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 688/1370] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:34:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:34:16.142673 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70d2c1-c4a9-44c2-af57-cfbc0069d676 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:16.142673 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70d2c1-c4a9-44c2-af57-cfbc0069d676 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:16.142673 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e70d2c1-c4a9-44c2-af57-cfbc0069d676 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:16.146167 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 683/1371] 10.222.0.39 () {54 vars in 964 bytes} [Mon Jul 18 10:34:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:34:16.146612 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc31c32-2e67-4f97-846d-9e5ad1ecb676 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:16.146800 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc31c32-2e67-4f97-846d-9e5ad1ecb676 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:16.147063 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc31c32-2e67-4f97-846d-9e5ad1ecb676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:16.232021 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-ccc31c32-2e67-4f97-846d-9e5ad1ecb676 None None] MFA Rules not processed for user `7cc4f041a5b242138a92a54633dcece6`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:34:16.233252 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-ccc31c32-2e67-4f97-846d-9e5ad1ecb676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:16.281674 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:16.320741 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 689/1372] 10.222.0.39 () {58 vars in 1061 bytes} [Mon Jul 18 10:34:16 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:34:16.321889 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e70d2c1-c4a9-44c2-af57-cfbc0069d676 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:34:16.324682 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-5e70d2c1-c4a9-44c2-af57-cfbc0069d676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:16.391042 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:16.465074 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e70d2c1-c4a9-44c2-af57-cfbc0069d676 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:34:16.539947 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ae7b62-d5ae-4ea4-b88f-ff0646ef63a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:34:16.540605 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae7b62-d5ae-4ea4-b88f-ff0646ef63a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:16.540894 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae7b62-d5ae-4ea4-b88f-ff0646ef63a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:16.541218 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae7b62-d5ae-4ea4-b88f-ff0646ef63a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:16.543506 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-35ae7b62-d5ae-4ea4-b88f-ff0646ef63a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:16.649981 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:16.664121 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ae7b62-d5ae-4ea4-b88f-ff0646ef63a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:34:16.665592 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ae7b62-d5ae-4ea4-b88f-ff0646ef63a0 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:34:16.684564 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 684/1373] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:34:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:34:16.873122 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890945e-eb41-4c72-8840-dbe78b426390 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:16.873627 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890945e-eb41-4c72-8840-dbe78b426390 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:16.874067 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890945e-eb41-4c72-8840-dbe78b426390 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:16.875190 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 690/1374] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:34:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:34:16.880139 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e237e4-5e89-427c-9ebd-2643ec0fd813 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:16.880457 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e237e4-5e89-427c-9ebd-2643ec0fd813 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:16.880693 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e237e4-5e89-427c-9ebd-2643ec0fd813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:16.965929 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-42e237e4-5e89-427c-9ebd-2643ec0fd813 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:34:16.967648 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-42e237e4-5e89-427c-9ebd-2643ec0fd813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:17.071929 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 685/1375] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:34:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:34:17.117749 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3890945e-eb41-4c72-8840-dbe78b426390 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:34:17.119272 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-3890945e-eb41-4c72-8840-dbe78b426390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:17.266969 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3890945e-eb41-4c72-8840-dbe78b426390 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:34:17.319271 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:17.384356 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a639caa2-42e9-4acb-a9ea-fdb3676ace1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bbebf16219943879df84bdc9a900516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:34:17.385015 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639caa2-42e9-4acb-a9ea-fdb3676ace1c service nova] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:17.385339 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639caa2-42e9-4acb-a9ea-fdb3676ace1c service nova] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:17.385614 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a639caa2-42e9-4acb-a9ea-fdb3676ace1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:17.387330 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-a639caa2-42e9-4acb-a9ea-fdb3676ace1c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:17.479366 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a639caa2-42e9-4acb-a9ea-fdb3676ace1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:34:17.481229 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a639caa2-42e9-4acb-a9ea-fdb3676ace1c service nova] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:34:17.499382 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 691/1376] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:34:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:34:19.669425 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7b5b3-c575-45b4-8d82-3950496b316c None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:19.669954 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7b5b3-c575-45b4-8d82-3950496b316c None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:19.669954 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7b5b3-c575-45b4-8d82-3950496b316c None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:19.671329 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 686/1377] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:34:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:34:19.676400 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137835b-cc14-4f82-9c84-20eaf3b6d17c None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:19.676780 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137835b-cc14-4f82-9c84-20eaf3b6d17c None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:19.676955 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137835b-cc14-4f82-9c84-20eaf3b6d17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:19.745821 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-f137835b-cc14-4f82-9c84-20eaf3b6d17c None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:34:19.746793 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-f137835b-cc14-4f82-9c84-20eaf3b6d17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:19.753519 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:19.864634 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 692/1378] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:34:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:34:19.912841 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a7b5b3-c575-45b4-8d82-3950496b316c None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:34:19.914410 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-d8a7b5b3-c575-45b4-8d82-3950496b316c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:19.977030 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:20.065676 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a7b5b3-c575-45b4-8d82-3950496b316c None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:34:20.198506 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671e4a7d-7228-4fcc-a22c-561ee14a3bfe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bbebf16219943879df84bdc9a900516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:34:20.200321 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e4a7d-7228-4fcc-a22c-561ee14a3bfe service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:20.200607 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e4a7d-7228-4fcc-a22c-561ee14a3bfe service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:20.200885 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e4a7d-7228-4fcc-a22c-561ee14a3bfe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:20.202597 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-671e4a7d-7228-4fcc-a22c-561ee14a3bfe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:20.221789 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:20.324306 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671e4a7d-7228-4fcc-a22c-561ee14a3bfe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:34:20.326230 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671e4a7d-7228-4fcc-a22c-561ee14a3bfe service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:34:20.349295 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 687/1379] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:34:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:34:22.660984 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e85e62-cad9-42aa-9a65-ab0d2b662f02 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:22.661506 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e85e62-cad9-42aa-9a65-ab0d2b662f02 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:22.661591 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e85e62-cad9-42aa-9a65-ab0d2b662f02 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:22.663149 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 693/1380] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:34:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:34:22.668808 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a4b778-91d5-4a8f-af0c-d0b027b23318 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:22.669249 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a4b778-91d5-4a8f-af0c-d0b027b23318 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:22.669423 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a4b778-91d5-4a8f-af0c-d0b027b23318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:22.739932 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-98a4b778-91d5-4a8f-af0c-d0b027b23318 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:34:22.741668 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-98a4b778-91d5-4a8f-af0c-d0b027b23318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:22.840645 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:22.846490 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 688/1381] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:34:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:34:22.890977 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e85e62-cad9-42aa-9a65-ab0d2b662f02 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:34:22.892502 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-94e85e62-cad9-42aa-9a65-ab0d2b662f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:23.031568 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:23.041505 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e85e62-cad9-42aa-9a65-ab0d2b662f02 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:34:23.170760 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad655fcb-455a-4693-bc6c-d8e83e9e897e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bbebf16219943879df84bdc9a900516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:34:23.171322 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad655fcb-455a-4693-bc6c-d8e83e9e897e service nova] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:23.171605 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad655fcb-455a-4693-bc6c-d8e83e9e897e service nova] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:23.171876 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad655fcb-455a-4693-bc6c-d8e83e9e897e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:23.173629 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-ad655fcb-455a-4693-bc6c-d8e83e9e897e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:23.272500 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad655fcb-455a-4693-bc6c-d8e83e9e897e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:34:23.274126 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad655fcb-455a-4693-bc6c-d8e83e9e897e service nova] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:34:23.285604 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:23.295066 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 694/1382] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:34:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:34:25.482724 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4bf51-cd09-4d1f-a9ab-6d07d2590add None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:25.483446 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4bf51-cd09-4d1f-a9ab-6d07d2590add None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:25.483446 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4bf51-cd09-4d1f-a9ab-6d07d2590add None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:25.484614 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 689/1383] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:34:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:34:25.490131 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f111b-a025-45c8-a08b-c90450260d9e None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:25.490572 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f111b-a025-45c8-a08b-c90450260d9e None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:25.490687 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f111b-a025-45c8-a08b-c90450260d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:25.558637 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-719f111b-a025-45c8-a08b-c90450260d9e None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:34:25.559886 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-719f111b-a025-45c8-a08b-c90450260d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:25.660298 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 695/1384] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:34:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:34:25.712649 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b4bf51-cd09-4d1f-a9ab-6d07d2590add None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:34:25.714862 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-93b4bf51-cd09-4d1f-a9ab-6d07d2590add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:25.882794 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b4bf51-cd09-4d1f-a9ab-6d07d2590add None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:34:25.965505 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:26.023380 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65640c1a-2ed3-4110-b088-e6034db07fcd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bbebf16219943879df84bdc9a900516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:34:26.024195 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65640c1a-2ed3-4110-b088-e6034db07fcd service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:26.024731 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65640c1a-2ed3-4110-b088-e6034db07fcd service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:26.025108 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65640c1a-2ed3-4110-b088-e6034db07fcd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:26.028055 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-65640c1a-2ed3-4110-b088-e6034db07fcd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:26.129925 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65640c1a-2ed3-4110-b088-e6034db07fcd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:34:26.131535 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65640c1a-2ed3-4110-b088-e6034db07fcd service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:34:26.151439 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 690/1385] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:34:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:34:28.166311 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e76fd1-45e0-49dd-8b9f-5932b4bb74de None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:28.167009 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e76fd1-45e0-49dd-8b9f-5932b4bb74de None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:28.167096 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e76fd1-45e0-49dd-8b9f-5932b4bb74de None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:28.168463 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 696/1386] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:34:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:34:28.173784 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611afa1-71d4-41e6-9b31-be841f094e99 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:28.174237 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611afa1-71d4-41e6-9b31-be841f094e99 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:28.174334 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611afa1-71d4-41e6-9b31-be841f094e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:28.248439 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-7611afa1-71d4-41e6-9b31-be841f094e99 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:34:28.249738 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-7611afa1-71d4-41e6-9b31-be841f094e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:28.291250 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:28.362196 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 691/1387] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:34:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:34:28.415669 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e76fd1-45e0-49dd-8b9f-5932b4bb74de None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:34:28.417962 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-75e76fd1-45e0-49dd-8b9f-5932b4bb74de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:28.503686 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:28.580553 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e76fd1-45e0-49dd-8b9f-5932b4bb74de None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:34:28.710491 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c767869-e729-4829-af10-c656fd7d0534 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bbebf16219943879df84bdc9a900516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:34:28.711281 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c767869-e729-4829-af10-c656fd7d0534 service nova] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:28.711655 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c767869-e729-4829-af10-c656fd7d0534 service nova] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:28.712007 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c767869-e729-4829-af10-c656fd7d0534 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:28.714815 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-8c767869-e729-4829-af10-c656fd7d0534 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:28.766188 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:28.828918 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c767869-e729-4829-af10-c656fd7d0534 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:34:28.831030 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c767869-e729-4829-af10-c656fd7d0534 service nova] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:34:28.855914 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 697/1388] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:34:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:34:31.059248 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7587d-b1f4-4344-ac84-52644c9a0a72 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:31.059808 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7587d-b1f4-4344-ac84-52644c9a0a72 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:31.059808 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7587d-b1f4-4344-ac84-52644c9a0a72 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:31.061244 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 692/1389] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:34:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:34:31.066576 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e5326-4a64-417c-a8ec-2207e1c3f142 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:31.066995 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e5326-4a64-417c-a8ec-2207e1c3f142 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:31.071128 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e5326-4a64-417c-a8ec-2207e1c3f142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:31.136455 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-a11e5326-4a64-417c-a8ec-2207e1c3f142 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:34:31.137695 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-a11e5326-4a64-417c-a8ec-2207e1c3f142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:31.237572 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 698/1390] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:34:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:34:31.283176 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7587d-b1f4-4344-ac84-52644c9a0a72 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:34:31.284703 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-7bc7587d-b1f4-4344-ac84-52644c9a0a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:31.440673 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7587d-b1f4-4344-ac84-52644c9a0a72 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:34:31.458691 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:31.558847 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a9915-eb80-41f4-b3b8-8282ff578de1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bbebf16219943879df84bdc9a900516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:34:31.559499 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a9915-eb80-41f4-b3b8-8282ff578de1 service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:31.559781 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a9915-eb80-41f4-b3b8-8282ff578de1 service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:31.560064 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a9915-eb80-41f4-b3b8-8282ff578de1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:31.561764 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-4b8a9915-eb80-41f4-b3b8-8282ff578de1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:31.652012 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8a9915-eb80-41f4-b3b8-8282ff578de1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:34:31.653644 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8a9915-eb80-41f4-b3b8-8282ff578de1 service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:34:31.672550 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 693/1391] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:34:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:34:32.219342 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ffc8e-74cc-4e68-86af-a162cfcd1105 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:32.219874 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ffc8e-74cc-4e68-86af-a162cfcd1105 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:32.219874 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ffc8e-74cc-4e68-86af-a162cfcd1105 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:32.221446 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 699/1392] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:34:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:34:32.226583 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e63d0e-0954-49f9-b288-e89449472efc None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:32.226991 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e63d0e-0954-49f9-b288-e89449472efc None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:32.227138 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e63d0e-0954-49f9-b288-e89449472efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:32.251978 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:32.293764 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-53e63d0e-0954-49f9-b288-e89449472efc None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:34:32.294979 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-53e63d0e-0954-49f9-b288-e89449472efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:32.393610 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 694/1393] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:34:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:34:32.451265 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fed9ad-6979-4977-93c9-edfe14930f12 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:32.451694 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fed9ad-6979-4977-93c9-edfe14930f12 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:32.452106 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fed9ad-6979-4977-93c9-edfe14930f12 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:32.453597 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 700/1394] 10.222.0.39 () {54 vars in 961 bytes} [Mon Jul 18 10:34:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:34:32.459321 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4c6db-b3a6-4cbc-8f50-74dde3684db6 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:32.459610 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4c6db-b3a6-4cbc-8f50-74dde3684db6 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:32.459891 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4c6db-b3a6-4cbc-8f50-74dde3684db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:32.535181 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-ffa4c6db-b3a6-4cbc-8f50-74dde3684db6 None None] MFA Rules not processed for user `48d1f7d0286745a396905aee50c9410b`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:34:32.536386 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-ffa4c6db-b3a6-4cbc-8f50-74dde3684db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:32.577391 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:32.615417 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 695/1395] 10.222.0.39 () {58 vars in 1058 bytes} [Mon Jul 18 10:34:32 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:34:32.623609 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fed9ad-6979-4977-93c9-edfe14930f12 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:34:32.625147 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-19fed9ad-6979-4977-93c9-edfe14930f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:32.638659 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:32.727170 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fed9ad-6979-4977-93c9-edfe14930f12 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:34:32.800250 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f262c93d-7292-4e94-a44b-2eb5d4fdb1db service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d1f7d0286745a396905aee50c9410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:34:32.800892 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262c93d-7292-4e94-a44b-2eb5d4fdb1db service glance] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:32.801203 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262c93d-7292-4e94-a44b-2eb5d4fdb1db service glance] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:32.801477 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262c93d-7292-4e94-a44b-2eb5d4fdb1db service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:32.803177 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-f262c93d-7292-4e94-a44b-2eb5d4fdb1db service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:32.871291 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:32.917460 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f262c93d-7292-4e94-a44b-2eb5d4fdb1db service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:34:32.918724 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f262c93d-7292-4e94-a44b-2eb5d4fdb1db service glance] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:34:32.937436 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 701/1396] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:34:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:34:33.848196 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f5dff-bd9c-408b-bc6c-93cf50a257db None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:33.848670 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f5dff-bd9c-408b-bc6c-93cf50a257db None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:33.848780 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f5dff-bd9c-408b-bc6c-93cf50a257db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:33.875521 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a830d7-7520-4b06-8481-0bb972980663 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:33.876074 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a830d7-7520-4b06-8481-0bb972980663 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:33.876172 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a830d7-7520-4b06-8481-0bb972980663 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:33.877685 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 702/1397] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:34:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:34:33.883112 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce701f5-e1a5-4439-8fbe-2ee01a5fb642 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:33.883413 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce701f5-e1a5-4439-8fbe-2ee01a5fb642 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:33.883779 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce701f5-e1a5-4439-8fbe-2ee01a5fb642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:33.917371 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-e80f5dff-bd9c-408b-bc6c-93cf50a257db None None] MFA Rules not processed for user `88ad60446c5447a8bbd0096fa2133efb`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:34:33.918482 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-e80f5dff-bd9c-408b-bc6c-93cf50a257db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:33.955922 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-7ce701f5-e1a5-4439-8fbe-2ee01a5fb642 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:34:33.957433 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-7ce701f5-e1a5-4439-8fbe-2ee01a5fb642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:34.016159 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 696/1398] 10.222.0.39 () {58 vars in 1009 bytes} [Mon Jul 18 10:34:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:34:34.074492 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53918ce-d2f4-4c6b-81b2-2945d469285c None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:34.075063 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53918ce-d2f4-4c6b-81b2-2945d469285c None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:34.075063 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53918ce-d2f4-4c6b-81b2-2945d469285c None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:34.077516 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 697/1399] 10.222.0.39 () {54 vars in 943 bytes} [Mon Jul 18 10:34:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:34:34.077657 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 703/1400] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:34:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:34:34.089357 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785bcc07-e8d3-41a1-b53e-49c82eec57d9 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:34.089357 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785bcc07-e8d3-41a1-b53e-49c82eec57d9 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:34.089357 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785bcc07-e8d3-41a1-b53e-49c82eec57d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:34.124306 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce701f5-e1a5-4439-8fbe-2ee01a5fb642 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:34:34.125783 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-7ce701f5-e1a5-4439-8fbe-2ee01a5fb642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:34.155905 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:34.173086 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:34.181164 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-785bcc07-e8d3-41a1-b53e-49c82eec57d9 None None] MFA Rules not processed for user `2c548474a8d94591ba58dd40e40a28d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:34:34.184430 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-785bcc07-e8d3-41a1-b53e-49c82eec57d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:34.251250 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce701f5-e1a5-4439-8fbe-2ee01a5fb642 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:34:34.302593 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 698/1401] 10.222.0.39 () {58 vars in 1040 bytes} [Mon Jul 18 10:34:34 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:34:34.312482 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785bcc07-e8d3-41a1-b53e-49c82eec57d9 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:34:34.321768 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785bcc07-e8d3-41a1-b53e-49c82eec57d9 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:34:34.370757 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef1ce2f-f248-4fd6-b500-519c5d4b02f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bbebf16219943879df84bdc9a900516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:34:34.371415 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1ce2f-f248-4fd6-b500-519c5d4b02f1 service nova] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:34.371697 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1ce2f-f248-4fd6-b500-519c5d4b02f1 service nova] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:34.371975 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1ce2f-f248-4fd6-b500-519c5d4b02f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:34.373691 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-7ef1ce2f-f248-4fd6-b500-519c5d4b02f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:34.393190 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:34.427886 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd201d0-503f-40cb-ab06-9e157f278407 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c548474a8d94591ba58dd40e40a28d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:34:34.428454 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd201d0-503f-40cb-ab06-9e157f278407 service swift] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:34.428732 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd201d0-503f-40cb-ab06-9e157f278407 service swift] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:34.429004 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd201d0-503f-40cb-ab06-9e157f278407 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:34.430721 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-7fd201d0-503f-40cb-ab06-9e157f278407 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:34.433956 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:34.466395 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef1ce2f-f248-4fd6-b500-519c5d4b02f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:34:34.467970 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef1ce2f-f248-4fd6-b500-519c5d4b02f1 service nova] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:34:34.486804 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 704/1402] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:34:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:34:34.520261 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd201d0-503f-40cb-ab06-9e157f278407 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:34:34.521901 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd201d0-503f-40cb-ab06-9e157f278407 service swift] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:34:34.530480 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 699/1403] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Jul 18 10:34:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 18 10:34:36.769940 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566cdf7-5a2e-4905-9b2f-5fbd20e2ed9b None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:36.770538 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566cdf7-5a2e-4905-9b2f-5fbd20e2ed9b None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:36.770538 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c566cdf7-5a2e-4905-9b2f-5fbd20e2ed9b None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:36.771870 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 705/1404] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:34:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:34:36.777663 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9716b65-ec5d-42ec-aa49-417001713c31 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:36.778084 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9716b65-ec5d-42ec-aa49-417001713c31 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:36.778267 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9716b65-ec5d-42ec-aa49-417001713c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:36.850321 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-c9716b65-ec5d-42ec-aa49-417001713c31 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:34:36.851539 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c9716b65-ec5d-42ec-aa49-417001713c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:36.950157 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:36.957663 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 700/1405] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:34:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:34:37.002635 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566cdf7-5a2e-4905-9b2f-5fbd20e2ed9b None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:34:37.004157 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-c566cdf7-5a2e-4905-9b2f-5fbd20e2ed9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:37.172144 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:37.174798 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c566cdf7-5a2e-4905-9b2f-5fbd20e2ed9b None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:34:37.300961 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3404b7-9659-4378-acfb-e0dee53c1c83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bbebf16219943879df84bdc9a900516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:34:37.301677 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3404b7-9659-4378-acfb-e0dee53c1c83 service nova] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:37.301967 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3404b7-9659-4378-acfb-e0dee53c1c83 service nova] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:37.302252 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3404b7-9659-4378-acfb-e0dee53c1c83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:37.303988 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-db3404b7-9659-4378-acfb-e0dee53c1c83 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:37.408345 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3404b7-9659-4378-acfb-e0dee53c1c83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:34:37.409941 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3404b7-9659-4378-acfb-e0dee53c1c83 service nova] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:34:37.430085 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 706/1406] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:34:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:34:39.726052 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b85c67-26be-4a71-b3d8-cdebf2882541 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:39.726591 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b85c67-26be-4a71-b3d8-cdebf2882541 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:39.731646 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b85c67-26be-4a71-b3d8-cdebf2882541 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:39.733242 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 701/1407] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:34:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:34:39.738798 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b3deee-5b17-4fd9-bbe9-481186e4ffac None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:39.739262 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b3deee-5b17-4fd9-bbe9-481186e4ffac None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:39.739383 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b3deee-5b17-4fd9-bbe9-481186e4ffac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:39.742848 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:39.812745 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-41b3deee-5b17-4fd9-bbe9-481186e4ffac None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:34:39.814200 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-41b3deee-5b17-4fd9-bbe9-481186e4ffac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:39.924703 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 707/1408] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:34:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:34:39.973239 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b85c67-26be-4a71-b3d8-cdebf2882541 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:34:39.974891 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-85b85c67-26be-4a71-b3d8-cdebf2882541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:40.155541 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b85c67-26be-4a71-b3d8-cdebf2882541 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:34:40.235705 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:40.293973 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca2c32a-f109-44f8-b538-3d1841a02bd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bbebf16219943879df84bdc9a900516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:34:40.294630 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca2c32a-f109-44f8-b538-3d1841a02bd1 service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:40.295535 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca2c32a-f109-44f8-b538-3d1841a02bd1 service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:40.295824 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca2c32a-f109-44f8-b538-3d1841a02bd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:40.297539 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-8ca2c32a-f109-44f8-b538-3d1841a02bd1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:40.410203 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca2c32a-f109-44f8-b538-3d1841a02bd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:34:40.411789 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca2c32a-f109-44f8-b538-3d1841a02bd1 service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:34:40.433066 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 702/1409] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:34:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:34:49.922847 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=64 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:50.430592 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=64 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:58.056604 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e94f3-efda-402a-ba63-863fcfa82416 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:58.057294 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e94f3-efda-402a-ba63-863fcfa82416 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:58.057665 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e94f3-efda-402a-ba63-863fcfa82416 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:58.060217 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 708/1410] 10.222.0.39 () {54 vars in 918 bytes} [Mon Jul 18 10:34:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:34:58.069539 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246de21-5364-499b-8ad5-2b55ce0da64b None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:58.069539 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246de21-5364-499b-8ad5-2b55ce0da64b None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:58.069539 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246de21-5364-499b-8ad5-2b55ce0da64b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:58.150715 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-9246de21-5364-499b-8ad5-2b55ce0da64b None None] MFA Rules not processed for user `2330638e80a941cd9aeeb2fd615900d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:34:58.151993 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-9246de21-5364-499b-8ad5-2b55ce0da64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:58.264091 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 703/1411] 10.222.0.39 () {58 vars in 1015 bytes} [Mon Jul 18 10:34:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:34:58.280453 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a407ad9-6765-4bfd-ae1b-7ca048ba00fc None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:58.280743 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a407ad9-6765-4bfd-ae1b-7ca048ba00fc None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:58.281027 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a407ad9-6765-4bfd-ae1b-7ca048ba00fc None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:58.282440 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 709/1412] 10.222.0.39 () {54 vars in 918 bytes} [Mon Jul 18 10:34:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:34:58.287440 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cdb638-19b1-4dfd-9c61-159d4dc7cfcd None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:34:58.287728 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cdb638-19b1-4dfd-9c61-159d4dc7cfcd None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:34:58.288004 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cdb638-19b1-4dfd-9c61-159d4dc7cfcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:34:58.363790 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:34:58.366417 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-11cdb638-19b1-4dfd-9c61-159d4dc7cfcd None None] MFA Rules not processed for user `8bbebf16219943879df84bdc9a900516`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:34:58.367645 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-11cdb638-19b1-4dfd-9c61-159d4dc7cfcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:34:58.488473 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 704/1413] 10.222.0.39 () {58 vars in 1015 bytes} [Mon Jul 18 10:34:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:35:01.020835 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bc14f-0c50-4597-a38f-90e5c3eb36f0 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:35:01.021420 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bc14f-0c50-4597-a38f-90e5c3eb36f0 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:35:01.021420 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bc14f-0c50-4597-a38f-90e5c3eb36f0 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:35:01.022783 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 710/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 10:35:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:35:01.028117 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a50e552-154a-4565-8511-ff4a687fe045 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:35:01.028556 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a50e552-154a-4565-8511-ff4a687fe045 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:35:01.028713 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a50e552-154a-4565-8511-ff4a687fe045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:35:01.094289 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-9a50e552-154a-4565-8511-ff4a687fe045 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:35:01.095500 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-9a50e552-154a-4565-8511-ff4a687fe045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:35:01.151149 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:01.191928 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 705/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 10:35:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:35:01.234672 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816bc14f-0c50-4597-a38f-90e5c3eb36f0 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:35:01.236199 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-816bc14f-0c50-4597-a38f-90e5c3eb36f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:35:01.385272 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816bc14f-0c50-4597-a38f-90e5c3eb36f0 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:35:01.458309 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:01.498788 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b6d8d3-0ba3-4b4b-9b78-095ccf4b7a9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bbebf16219943879df84bdc9a900516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:35:01.499431 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6d8d3-0ba3-4b4b-9b78-095ccf4b7a9f service nova] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:35:01.499712 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6d8d3-0ba3-4b4b-9b78-095ccf4b7a9f service nova] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:35:01.499981 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6d8d3-0ba3-4b4b-9b78-095ccf4b7a9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:35:01.501651 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-a9b6d8d3-0ba3-4b4b-9b78-095ccf4b7a9f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:35:01.589142 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b6d8d3-0ba3-4b4b-9b78-095ccf4b7a9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:35:01.590737 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b6d8d3-0ba3-4b4b-9b78-095ccf4b7a9f service nova] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:35:01.610713 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 711/1416] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:35:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:35:02.510930 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960bfad-5ac3-433c-a9ef-6b0c6b8bcb40 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:35:02.511480 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960bfad-5ac3-433c-a9ef-6b0c6b8bcb40 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:35:02.511480 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960bfad-5ac3-433c-a9ef-6b0c6b8bcb40 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:35:02.512864 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 706/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 10:35:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:35:02.517717 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d574f-8c82-4c56-9d77-a0ed528dab77 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:35:02.518128 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d574f-8c82-4c56-9d77-a0ed528dab77 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:35:02.518276 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d574f-8c82-4c56-9d77-a0ed528dab77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:35:02.591576 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-715d574f-8c82-4c56-9d77-a0ed528dab77 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:35:02.592766 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-715d574f-8c82-4c56-9d77-a0ed528dab77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:35:02.620446 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:02.689756 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 712/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 10:35:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:35:02.839961 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d960bfad-5ac3-433c-a9ef-6b0c6b8bcb40 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:35:02.841422 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-d960bfad-5ac3-433c-a9ef-6b0c6b8bcb40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:35:02.984380 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d960bfad-5ac3-433c-a9ef-6b0c6b8bcb40 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:35:03.022758 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:03.096951 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c87aa4-2803-40ac-b635-d77171850838 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bbebf16219943879df84bdc9a900516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:35:03.097563 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c87aa4-2803-40ac-b635-d77171850838 service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:35:03.097848 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c87aa4-2803-40ac-b635-d77171850838 service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:35:03.098130 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c87aa4-2803-40ac-b635-d77171850838 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:35:03.099858 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-a4c87aa4-2803-40ac-b635-d77171850838 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:35:03.188125 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c87aa4-2803-40ac-b635-d77171850838 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:35:03.189741 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c87aa4-2803-40ac-b635-d77171850838 service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:35:03.208391 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 707/1419] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:35:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:35:04.109681 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e87334c-b83e-448b-9e6b-cc1ee50e8ca0 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:35:04.110086 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e87334c-b83e-448b-9e6b-cc1ee50e8ca0 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:35:04.110245 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e87334c-b83e-448b-9e6b-cc1ee50e8ca0 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:35:04.111637 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 713/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 10:35:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:35:04.116823 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b166b0c-7196-4384-b53d-a2798e031f2f None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:35:04.117275 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b166b0c-7196-4384-b53d-a2798e031f2f None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:35:04.117403 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b166b0c-7196-4384-b53d-a2798e031f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:35:04.171418 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:04.193073 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-0b166b0c-7196-4384-b53d-a2798e031f2f None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:35:04.194327 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-0b166b0c-7196-4384-b53d-a2798e031f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:35:04.289664 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 708/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 10:35:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:35:04.438597 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e87334c-b83e-448b-9e6b-cc1ee50e8ca0 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:35:04.439919 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-3e87334c-b83e-448b-9e6b-cc1ee50e8ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:35:04.584783 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e87334c-b83e-448b-9e6b-cc1ee50e8ca0 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:35:04.596700 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:04.699904 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc3839a-0d20-496d-b15f-3de2c4b71cc9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bbebf16219943879df84bdc9a900516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:35:04.700463 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3839a-0d20-496d-b15f-3de2c4b71cc9 service nova] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:35:04.700739 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3839a-0d20-496d-b15f-3de2c4b71cc9 service nova] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:35:04.701010 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3839a-0d20-496d-b15f-3de2c4b71cc9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:35:04.702674 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-efc3839a-0d20-496d-b15f-3de2c4b71cc9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:35:04.790980 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc3839a-0d20-496d-b15f-3de2c4b71cc9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:35:04.792633 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc3839a-0d20-496d-b15f-3de2c4b71cc9 service nova] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:35:04.810736 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 714/1422] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:35:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:35:05.675968 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe8c27-6e5d-4220-a365-308f976671e1 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:35:05.676538 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe8c27-6e5d-4220-a365-308f976671e1 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:35:05.676538 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe8c27-6e5d-4220-a365-308f976671e1 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:35:05.677909 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 709/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 10:35:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:35:05.683525 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2a5d0-b146-430d-95b4-af1fd2c2f898 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:35:05.683969 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2a5d0-b146-430d-95b4-af1fd2c2f898 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:35:05.684077 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2a5d0-b146-430d-95b4-af1fd2c2f898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:35:05.703383 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:05.760678 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-e1e2a5d0-b146-430d-95b4-af1fd2c2f898 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:35:05.761936 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-e1e2a5d0-b146-430d-95b4-af1fd2c2f898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:35:05.859083 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 715/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 10:35:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:35:06.015017 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe8c27-6e5d-4220-a365-308f976671e1 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:35:06.016529 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-28fe8c27-6e5d-4220-a365-308f976671e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:35:06.124167 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:06.159225 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe8c27-6e5d-4220-a365-308f976671e1 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:35:06.271624 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01f0e67-401e-4c04-b017-74ed958c6a51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bbebf16219943879df84bdc9a900516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:35:06.271988 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f0e67-401e-4c04-b017-74ed958c6a51 service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:35:06.272379 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f0e67-401e-4c04-b017-74ed958c6a51 service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:35:06.272531 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f0e67-401e-4c04-b017-74ed958c6a51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:35:06.274236 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-a01f0e67-401e-4c04-b017-74ed958c6a51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:35:06.354787 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:06.368007 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01f0e67-401e-4c04-b017-74ed958c6a51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:35:06.369701 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01f0e67-401e-4c04-b017-74ed958c6a51 service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:35:06.388198 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 710/1425] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:35:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:35:07.251224 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591fd111-e5e0-40e1-b9b8-720d7ac72c3f None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:35:07.251771 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591fd111-e5e0-40e1-b9b8-720d7ac72c3f None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:35:07.251771 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591fd111-e5e0-40e1-b9b8-720d7ac72c3f None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:35:07.253164 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 716/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 10:35:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:35:07.258642 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a2af5f-2e3f-42fb-8b49-c66cb79ef410 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:35:07.259141 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a2af5f-2e3f-42fb-8b49-c66cb79ef410 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:35:07.259234 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a2af5f-2e3f-42fb-8b49-c66cb79ef410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:35:07.464081 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-c6a2af5f-2e3f-42fb-8b49-c66cb79ef410 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:35:07.465798 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c6a2af5f-2e3f-42fb-8b49-c66cb79ef410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:35:07.561748 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 711/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 10:35:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:35:07.710448 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591fd111-e5e0-40e1-b9b8-720d7ac72c3f None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:35:07.712654 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-591fd111-e5e0-40e1-b9b8-720d7ac72c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:35:07.796318 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:07.860120 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591fd111-e5e0-40e1-b9b8-720d7ac72c3f None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:35:07.976071 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fcc0fb-de2b-4be6-a337-d4f536079831 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bbebf16219943879df84bdc9a900516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:35:07.977188 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fcc0fb-de2b-4be6-a337-d4f536079831 service nova] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:35:07.977480 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fcc0fb-de2b-4be6-a337-d4f536079831 service nova] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:35:07.977759 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fcc0fb-de2b-4be6-a337-d4f536079831 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:35:07.979420 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-d0fcc0fb-de2b-4be6-a337-d4f536079831 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:35:08.027949 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:08.069783 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fcc0fb-de2b-4be6-a337-d4f536079831 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:35:08.073681 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fcc0fb-de2b-4be6-a337-d4f536079831 service nova] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:35:08.092318 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 717/1428] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:35:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:35:09.026395 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4946b-c6da-467f-b6c3-6af534a188a9 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:35:09.026969 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4946b-c6da-467f-b6c3-6af534a188a9 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:35:09.026969 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f4946b-c6da-467f-b6c3-6af534a188a9 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:35:09.028293 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 712/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 10:35:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:35:09.033656 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68b2d1-9347-4daf-924f-baa452ee13ef None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:35:09.034131 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68b2d1-9347-4daf-924f-baa452ee13ef None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:35:09.034240 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68b2d1-9347-4daf-924f-baa452ee13ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:35:09.111988 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-6d68b2d1-9347-4daf-924f-baa452ee13ef None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:35:09.113236 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-6d68b2d1-9347-4daf-924f-baa452ee13ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:35:09.213957 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 718/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 10:35:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:35:09.366680 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f4946b-c6da-467f-b6c3-6af534a188a9 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:35:09.369183 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-10f4946b-c6da-467f-b6c3-6af534a188a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:35:09.419819 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:09.522298 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f4946b-c6da-467f-b6c3-6af534a188a9 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:35:09.637994 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a11a00-209f-443e-8814-33facf707b95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bbebf16219943879df84bdc9a900516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:35:09.638651 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a11a00-209f-443e-8814-33facf707b95 service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:35:09.638953 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a11a00-209f-443e-8814-33facf707b95 service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:35:09.639224 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a11a00-209f-443e-8814-33facf707b95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:35:09.640874 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-d2a11a00-209f-443e-8814-33facf707b95 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:35:09.647978 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:09.738072 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a11a00-209f-443e-8814-33facf707b95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:35:09.739677 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a11a00-209f-443e-8814-33facf707b95 service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:35:09.759431 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 713/1431] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:35:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:35:10.662372 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1c6cb-de70-4e65-907a-73f914cbadb9 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:35:10.662976 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1c6cb-de70-4e65-907a-73f914cbadb9 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:35:10.662976 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1c6cb-de70-4e65-907a-73f914cbadb9 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:35:10.664997 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 719/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 10:35:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:35:10.670178 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c0af7-ba6f-4d32-93b8-352f514d4683 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:35:10.670642 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c0af7-ba6f-4d32-93b8-352f514d4683 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:35:10.670740 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c0af7-ba6f-4d32-93b8-352f514d4683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:35:10.754826 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-4f5c0af7-ba6f-4d32-93b8-352f514d4683 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:35:10.756059 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-4f5c0af7-ba6f-4d32-93b8-352f514d4683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:35:10.826966 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:10.857139 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 714/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 10:35:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:35:11.013973 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d1c6cb-de70-4e65-907a-73f914cbadb9 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:35:11.015516 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-71d1c6cb-de70-4e65-907a-73f914cbadb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:35:11.034226 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:11.172369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d1c6cb-de70-4e65-907a-73f914cbadb9 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:35:11.285251 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:11.314733 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c7ac3-c028-4a16-9906-ce574eee7b5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bbebf16219943879df84bdc9a900516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:35:11.315498 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c7ac3-c028-4a16-9906-ce574eee7b5d service nova] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:35:11.316567 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c7ac3-c028-4a16-9906-ce574eee7b5d service nova] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:35:11.316567 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c7ac3-c028-4a16-9906-ce574eee7b5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:35:11.317784 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-b44c7ac3-c028-4a16-9906-ce574eee7b5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:35:11.419460 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44c7ac3-c028-4a16-9906-ce574eee7b5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:35:11.421712 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44c7ac3-c028-4a16-9906-ce574eee7b5d service nova] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:35:11.440419 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 720/1434] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:35:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:35:12.316391 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c85cda2-df71-4504-9f80-c6491f9fac35 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:35:12.316970 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c85cda2-df71-4504-9f80-c6491f9fac35 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:35:12.316970 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c85cda2-df71-4504-9f80-c6491f9fac35 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:35:12.318380 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 715/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 10:35:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:35:12.324366 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7536629d-3c0c-42a5-863a-c2f16a6bca48 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:35:12.324894 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7536629d-3c0c-42a5-863a-c2f16a6bca48 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:35:12.324894 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7536629d-3c0c-42a5-863a-c2f16a6bca48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:35:12.407213 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-7536629d-3c0c-42a5-863a-c2f16a6bca48 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:35:12.408362 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-7536629d-3c0c-42a5-863a-c2f16a6bca48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:35:12.452451 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:12.513858 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 721/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 10:35:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:35:12.667426 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c85cda2-df71-4504-9f80-c6491f9fac35 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:35:12.669130 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-5c85cda2-df71-4504-9f80-c6491f9fac35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:35:12.831315 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c85cda2-df71-4504-9f80-c6491f9fac35 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:35:12.897877 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:12.956967 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48f1c68-972f-4c5b-bab1-ad36489d2350 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bbebf16219943879df84bdc9a900516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:35:12.957662 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f1c68-972f-4c5b-bab1-ad36489d2350 service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:35:12.957944 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f1c68-972f-4c5b-bab1-ad36489d2350 service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:35:12.958217 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f1c68-972f-4c5b-bab1-ad36489d2350 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:35:12.959941 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-f48f1c68-972f-4c5b-bab1-ad36489d2350 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:35:13.059139 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48f1c68-972f-4c5b-bab1-ad36489d2350 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:35:13.060750 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48f1c68-972f-4c5b-bab1-ad36489d2350 service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:35:13.080339 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 716/1437] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:35:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:35:13.981925 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a97d2-428d-4078-bc20-cb0170935ae5 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:35:13.982499 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a97d2-428d-4078-bc20-cb0170935ae5 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:35:13.982499 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a97d2-428d-4078-bc20-cb0170935ae5 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:35:13.983844 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 722/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 10:35:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:35:13.988978 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01d34d-46c0-4204-b862-6c1b7ab714a5 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:35:13.989462 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01d34d-46c0-4204-b862-6c1b7ab714a5 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:35:13.989567 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01d34d-46c0-4204-b862-6c1b7ab714a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:35:14.066028 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-ae01d34d-46c0-4204-b862-6c1b7ab714a5 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:35:14.067260 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-ae01d34d-46c0-4204-b862-6c1b7ab714a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:35:14.069402 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:14.172229 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 717/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 10:35:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:35:14.324086 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a97d2-428d-4078-bc20-cb0170935ae5 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:35:14.325605 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-2a5a97d2-428d-4078-bc20-cb0170935ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:35:14.481784 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a97d2-428d-4078-bc20-cb0170935ae5 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:35:14.511819 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:14.602344 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432b30f2-a7ff-449d-95c4-e3447e7c6eb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bbebf16219943879df84bdc9a900516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:35:14.602881 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b30f2-a7ff-449d-95c4-e3447e7c6eb6 service nova] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:35:14.603163 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b30f2-a7ff-449d-95c4-e3447e7c6eb6 service nova] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:35:14.603435 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b30f2-a7ff-449d-95c4-e3447e7c6eb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:35:14.605128 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-432b30f2-a7ff-449d-95c4-e3447e7c6eb6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:35:14.694380 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432b30f2-a7ff-449d-95c4-e3447e7c6eb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:35:14.696063 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432b30f2-a7ff-449d-95c4-e3447e7c6eb6 service nova] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:35:14.714400 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 723/1440] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:35:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:35:16.673294 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca66fb5a-ea6f-4b94-80a6-9f062b85430b None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:35:16.673874 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca66fb5a-ea6f-4b94-80a6-9f062b85430b None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:35:16.673874 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca66fb5a-ea6f-4b94-80a6-9f062b85430b None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:35:16.675236 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 718/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 10:35:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:35:16.681645 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a7d71-1287-48b1-aa79-74ec712e5f60 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:35:16.682186 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a7d71-1287-48b1-aa79-74ec712e5f60 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:35:16.682186 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a7d71-1287-48b1-aa79-74ec712e5f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:35:16.728744 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:16.755462 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-722a7d71-1287-48b1-aa79-74ec712e5f60 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:35:16.756727 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-722a7d71-1287-48b1-aa79-74ec712e5f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:35:16.858746 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 724/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 10:35:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:35:16.896711 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca66fb5a-ea6f-4b94-80a6-9f062b85430b None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:35:16.898798 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-ca66fb5a-ea6f-4b94-80a6-9f062b85430b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:35:17.003684 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca66fb5a-ea6f-4b94-80a6-9f062b85430b None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:35:17.039443 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:17.088354 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd5ace2-4757-441f-bf44-73bc1e9e18ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:35:17.089019 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5ace2-4757-441f-bf44-73bc1e9e18ed service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:35:17.089338 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5ace2-4757-441f-bf44-73bc1e9e18ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:35:17.089614 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd5ace2-4757-441f-bf44-73bc1e9e18ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:35:17.091359 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-7fd5ace2-4757-441f-bf44-73bc1e9e18ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:35:17.210249 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd5ace2-4757-441f-bf44-73bc1e9e18ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:35:17.211838 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd5ace2-4757-441f-bf44-73bc1e9e18ed service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:35:17.234645 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 719/1443] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:35:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:35:19.470894 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd78f49-953b-494a-bcfe-aa1f85e07c7a None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:35:19.471433 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd78f49-953b-494a-bcfe-aa1f85e07c7a None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:35:19.471433 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd78f49-953b-494a-bcfe-aa1f85e07c7a None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:35:19.472828 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 725/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 10:35:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:35:19.479223 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01449e53-da09-4c28-849f-09ddd6f503ca None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:35:19.479784 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01449e53-da09-4c28-849f-09ddd6f503ca None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:35:19.479784 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01449e53-da09-4c28-849f-09ddd6f503ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:35:19.552731 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-01449e53-da09-4c28-849f-09ddd6f503ca None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:35:19.554035 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-01449e53-da09-4c28-849f-09ddd6f503ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:35:19.569489 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:19.667197 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 720/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 10:35:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:35:19.707235 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd78f49-953b-494a-bcfe-aa1f85e07c7a None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:35:19.708796 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-bfd78f49-953b-494a-bcfe-aa1f85e07c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:35:19.817458 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd78f49-953b-494a-bcfe-aa1f85e07c7a None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:35:19.831048 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:19.900258 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e012b412-4df9-4773-b5da-6db13d64dd72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:35:19.900911 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012b412-4df9-4773-b5da-6db13d64dd72 service neutron] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:35:19.901222 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012b412-4df9-4773-b5da-6db13d64dd72 service neutron] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:35:19.901497 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e012b412-4df9-4773-b5da-6db13d64dd72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:35:19.903203 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-e012b412-4df9-4773-b5da-6db13d64dd72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:35:20.032103 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e012b412-4df9-4773-b5da-6db13d64dd72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:35:20.033601 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e012b412-4df9-4773-b5da-6db13d64dd72 service neutron] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:35:20.055080 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 726/1446] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:35:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:35:22.642483 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a5de3-de65-4e25-a80a-d00d0c0a1ff8 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:35:22.643085 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a5de3-de65-4e25-a80a-d00d0c0a1ff8 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:35:22.643233 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a5de3-de65-4e25-a80a-d00d0c0a1ff8 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:35:22.644686 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 721/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 10:35:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:35:22.651212 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7893867-c7a9-41f8-8507-6a844c4136f0 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:35:22.651791 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7893867-c7a9-41f8-8507-6a844c4136f0 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:35:22.651791 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7893867-c7a9-41f8-8507-6a844c4136f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:35:22.702593 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:22.721972 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-f7893867-c7a9-41f8-8507-6a844c4136f0 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:35:22.725178 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-f7893867-c7a9-41f8-8507-6a844c4136f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:35:22.836307 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 727/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 10:35:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:35:22.876031 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a5de3-de65-4e25-a80a-d00d0c0a1ff8 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:35:22.877634 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-833a5de3-de65-4e25-a80a-d00d0c0a1ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:35:22.985207 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a5de3-de65-4e25-a80a-d00d0c0a1ff8 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:35:23.028054 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:23.063714 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d9c91-6be5-4900-8ae6-9bda94025086 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:35:23.064359 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d9c91-6be5-4900-8ae6-9bda94025086 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:35:23.064641 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d9c91-6be5-4900-8ae6-9bda94025086 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:35:23.064910 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d9c91-6be5-4900-8ae6-9bda94025086 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:35:23.066576 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-319d9c91-6be5-4900-8ae6-9bda94025086 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:35:23.189414 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319d9c91-6be5-4900-8ae6-9bda94025086 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:35:23.190768 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319d9c91-6be5-4900-8ae6-9bda94025086 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:35:23.212341 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 722/1449] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:35:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:35:25.426520 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb857e-f83b-4b34-b955-4f8206d9207b None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:35:25.427061 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb857e-f83b-4b34-b955-4f8206d9207b None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:35:25.427061 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb857e-f83b-4b34-b955-4f8206d9207b None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:35:25.429450 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 728/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 10:35:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:35:25.435314 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cad8b0-40b1-454d-8023-08100fd9082f None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:35:25.435785 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cad8b0-40b1-454d-8023-08100fd9082f None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:35:25.435878 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cad8b0-40b1-454d-8023-08100fd9082f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:35:25.510382 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-c9cad8b0-40b1-454d-8023-08100fd9082f None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:35:25.511616 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c9cad8b0-40b1-454d-8023-08100fd9082f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:35:25.532130 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:25.623648 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 723/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 10:35:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:35:25.662405 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acb857e-f83b-4b34-b955-4f8206d9207b None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:35:25.664511 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-6acb857e-f83b-4b34-b955-4f8206d9207b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:35:25.780765 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acb857e-f83b-4b34-b955-4f8206d9207b None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:35:25.801124 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:25.860253 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98598d67-c5cd-45b7-98dd-649920357815 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:35:25.860917 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98598d67-c5cd-45b7-98dd-649920357815 service neutron] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:35:25.861231 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98598d67-c5cd-45b7-98dd-649920357815 service neutron] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:35:25.861513 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98598d67-c5cd-45b7-98dd-649920357815 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:35:25.863212 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-98598d67-c5cd-45b7-98dd-649920357815 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:35:25.979474 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98598d67-c5cd-45b7-98dd-649920357815 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:35:25.980927 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98598d67-c5cd-45b7-98dd-649920357815 service neutron] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:35:26.000908 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 729/1452] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:35:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:35:28.122869 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820817e-9ea7-4293-a796-86a13b953049 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:35:28.123597 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820817e-9ea7-4293-a796-86a13b953049 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:35:28.123597 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820817e-9ea7-4293-a796-86a13b953049 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:35:28.124911 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 724/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 10:35:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:35:28.130598 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35938f2-cc14-4a29-ae0c-1bb452e121b9 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:35:28.131067 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35938f2-cc14-4a29-ae0c-1bb452e121b9 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:35:28.131190 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35938f2-cc14-4a29-ae0c-1bb452e121b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:35:28.199684 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:28.202806 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-d35938f2-cc14-4a29-ae0c-1bb452e121b9 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:35:28.204345 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-d35938f2-cc14-4a29-ae0c-1bb452e121b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:35:28.307989 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 730/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 10:35:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:35:28.348404 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6820817e-9ea7-4293-a796-86a13b953049 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:35:28.351443 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-6820817e-9ea7-4293-a796-86a13b953049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:35:28.472675 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6820817e-9ea7-4293-a796-86a13b953049 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:35:28.524618 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:28.550629 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf98d92-04b5-4abd-8bf7-1224e67ff47e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:35:28.551282 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf98d92-04b5-4abd-8bf7-1224e67ff47e service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:35:28.551566 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf98d92-04b5-4abd-8bf7-1224e67ff47e service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:35:28.551841 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf98d92-04b5-4abd-8bf7-1224e67ff47e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:35:28.554214 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-0cf98d92-04b5-4abd-8bf7-1224e67ff47e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:35:28.674437 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf98d92-04b5-4abd-8bf7-1224e67ff47e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:35:28.675863 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf98d92-04b5-4abd-8bf7-1224e67ff47e service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:35:28.696432 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 725/1455] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:35:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:35:30.857071 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded004da-b337-449b-ad7c-749fc6eabfe7 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:35:30.857615 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded004da-b337-449b-ad7c-749fc6eabfe7 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:35:30.857615 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded004da-b337-449b-ad7c-749fc6eabfe7 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:35:30.858915 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 731/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 10:35:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:35:30.864328 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e56282-06a8-4f9c-a66e-da6b8137fef6 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:35:30.864822 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e56282-06a8-4f9c-a66e-da6b8137fef6 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:35:30.864927 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e56282-06a8-4f9c-a66e-da6b8137fef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:35:30.932334 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-15e56282-06a8-4f9c-a66e-da6b8137fef6 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:35:30.933619 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-15e56282-06a8-4f9c-a66e-da6b8137fef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:35:30.967834 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:31.038659 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 726/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 10:35:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:35:31.078111 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded004da-b337-449b-ad7c-749fc6eabfe7 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:35:31.080659 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-ded004da-b337-449b-ad7c-749fc6eabfe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:35:31.195963 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded004da-b337-449b-ad7c-749fc6eabfe7 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:35:31.226368 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:31.274689 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6ad9a7-f7eb-4130-be7b-4de12db6ae21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:35:31.275341 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ad9a7-f7eb-4130-be7b-4de12db6ae21 service neutron] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:35:31.275622 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ad9a7-f7eb-4130-be7b-4de12db6ae21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:35:31.275897 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ad9a7-f7eb-4130-be7b-4de12db6ae21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:35:31.277611 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-9b6ad9a7-f7eb-4130-be7b-4de12db6ae21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:35:31.398246 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6ad9a7-f7eb-4130-be7b-4de12db6ae21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:35:31.399872 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6ad9a7-f7eb-4130-be7b-4de12db6ae21 service neutron] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:35:31.419379 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 732/1458] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:35:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:35:33.576656 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538600b9-8d20-4f2b-8bc4-2cbf367646c2 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:35:33.577247 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538600b9-8d20-4f2b-8bc4-2cbf367646c2 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:35:33.577247 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538600b9-8d20-4f2b-8bc4-2cbf367646c2 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:35:33.578858 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 727/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 10:35:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:35:33.584162 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d850c8-db1a-4160-9d96-1f5cf0b967b1 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:35:33.585362 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d850c8-db1a-4160-9d96-1f5cf0b967b1 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:35:33.585362 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d850c8-db1a-4160-9d96-1f5cf0b967b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:35:33.651499 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-c9d850c8-db1a-4160-9d96-1f5cf0b967b1 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:35:33.652762 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-c9d850c8-db1a-4160-9d96-1f5cf0b967b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:35:33.661301 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:33.749117 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 733/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 10:35:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:35:33.789542 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538600b9-8d20-4f2b-8bc4-2cbf367646c2 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:35:33.791137 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-538600b9-8d20-4f2b-8bc4-2cbf367646c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:35:33.899197 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538600b9-8d20-4f2b-8bc4-2cbf367646c2 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:35:33.960096 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:33.982190 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f185939-75f2-4013-a36e-388c3486c439 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:35:33.982848 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f185939-75f2-4013-a36e-388c3486c439 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:35:33.983126 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f185939-75f2-4013-a36e-388c3486c439 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:35:33.983404 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f185939-75f2-4013-a36e-388c3486c439 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:35:33.985162 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-4f185939-75f2-4013-a36e-388c3486c439 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:35:34.098825 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f185939-75f2-4013-a36e-388c3486c439 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:35:34.102164 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f185939-75f2-4013-a36e-388c3486c439 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:35:34.121300 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 728/1461] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:35:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:35:36.184951 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62575e9-276c-446a-af54-39e4615eef25 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:35:36.185554 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62575e9-276c-446a-af54-39e4615eef25 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:35:36.185554 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62575e9-276c-446a-af54-39e4615eef25 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:35:36.186906 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 734/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 10:35:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:35:36.192094 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47616ea-78b9-4966-abec-156af88bce7f None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:35:36.192531 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47616ea-78b9-4966-abec-156af88bce7f None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:35:36.192639 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47616ea-78b9-4966-abec-156af88bce7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:35:36.258116 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-b47616ea-78b9-4966-abec-156af88bce7f None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:35:36.259327 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-b47616ea-78b9-4966-abec-156af88bce7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:35:36.297321 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:36.358482 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 729/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 10:35:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:35:36.395857 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62575e9-276c-446a-af54-39e4615eef25 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:35:36.398083 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-e62575e9-276c-446a-af54-39e4615eef25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:35:36.500137 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62575e9-276c-446a-af54-39e4615eef25 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:35:36.538324 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:36.574651 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c89ebf8-0d50-498b-9237-8bea521b07b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:35:36.575291 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89ebf8-0d50-498b-9237-8bea521b07b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:35:36.575573 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89ebf8-0d50-498b-9237-8bea521b07b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:35:36.575845 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89ebf8-0d50-498b-9237-8bea521b07b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:35:36.577502 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-3c89ebf8-0d50-498b-9237-8bea521b07b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:35:36.691278 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c89ebf8-0d50-498b-9237-8bea521b07b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:35:36.692623 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c89ebf8-0d50-498b-9237-8bea521b07b3 service neutron] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:35:36.712533 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 735/1464] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:35:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:35:38.787557 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b009873-0219-41e9-a56c-993e3694c917 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:35:38.788377 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b009873-0219-41e9-a56c-993e3694c917 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:35:38.788377 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b009873-0219-41e9-a56c-993e3694c917 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:35:38.789529 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 730/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 10:35:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:35:38.794738 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959bb877-5d24-424a-bdc3-7f729cb17a2a None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:35:38.795193 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959bb877-5d24-424a-bdc3-7f729cb17a2a None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:35:38.795303 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959bb877-5d24-424a-bdc3-7f729cb17a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:35:38.860566 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-959bb877-5d24-424a-bdc3-7f729cb17a2a None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:35:38.861816 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-959bb877-5d24-424a-bdc3-7f729cb17a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:35:38.880105 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:38.960416 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 736/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 10:35:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:35:38.997676 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b009873-0219-41e9-a56c-993e3694c917 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:35:38.999285 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-5b009873-0219-41e9-a56c-993e3694c917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:35:39.102696 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b009873-0219-41e9-a56c-993e3694c917 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:35:39.169316 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:39.175812 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe14a5e4-9bbb-43f5-a02d-971f7bdf1d7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:35:39.176462 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14a5e4-9bbb-43f5-a02d-971f7bdf1d7f service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:35:39.176737 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14a5e4-9bbb-43f5-a02d-971f7bdf1d7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:35:39.177161 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14a5e4-9bbb-43f5-a02d-971f7bdf1d7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:35:39.182937 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-fe14a5e4-9bbb-43f5-a02d-971f7bdf1d7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:35:39.289102 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe14a5e4-9bbb-43f5-a02d-971f7bdf1d7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:35:39.290583 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe14a5e4-9bbb-43f5-a02d-971f7bdf1d7f service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:35:39.309629 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 731/1467] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:35:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:35:41.363896 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1550fe-cabb-4504-87b4-3647b931efa3 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:35:41.364495 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1550fe-cabb-4504-87b4-3647b931efa3 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:35:41.364495 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1550fe-cabb-4504-87b4-3647b931efa3 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:35:41.366579 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 737/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 10:35:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:35:41.372035 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043dd5d-0123-45ac-b6ac-d676e19c4cd1 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:35:41.372523 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043dd5d-0123-45ac-b6ac-d676e19c4cd1 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:35:41.372630 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043dd5d-0123-45ac-b6ac-d676e19c4cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:35:41.438084 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-7043dd5d-0123-45ac-b6ac-d676e19c4cd1 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:35:41.439309 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-7043dd5d-0123-45ac-b6ac-d676e19c4cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:35:41.489260 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:41.538985 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 732/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 10:35:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:35:41.575869 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1550fe-cabb-4504-87b4-3647b931efa3 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:35:41.577566 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-dd1550fe-cabb-4504-87b4-3647b931efa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:35:41.681272 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1550fe-cabb-4504-87b4-3647b931efa3 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:35:41.728240 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:41.754053 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4298356b-cc17-4f52-bc1d-9fb3cb8d7a55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:35:41.754700 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4298356b-cc17-4f52-bc1d-9fb3cb8d7a55 service neutron] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:35:41.754982 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4298356b-cc17-4f52-bc1d-9fb3cb8d7a55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:35:41.755256 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4298356b-cc17-4f52-bc1d-9fb3cb8d7a55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:35:41.756945 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-4298356b-cc17-4f52-bc1d-9fb3cb8d7a55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:35:41.866322 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4298356b-cc17-4f52-bc1d-9fb3cb8d7a55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:35:41.867760 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4298356b-cc17-4f52-bc1d-9fb3cb8d7a55 service neutron] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:35:41.886296 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 738/1470] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:35:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:35:51.536305 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=22 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:51.884059 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=66 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:36:01.652058 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c658d-871b-45c9-90cf-371b4447da62 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:36:01.652605 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c658d-871b-45c9-90cf-371b4447da62 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:36:01.652605 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c658d-871b-45c9-90cf-371b4447da62 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:36:01.654010 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 733/1471] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:36:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:36:01.659588 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a72168b-70bf-4dec-b912-d78fa9f35ffc None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:36:01.660023 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a72168b-70bf-4dec-b912-d78fa9f35ffc None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:36:01.660145 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a72168b-70bf-4dec-b912-d78fa9f35ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:36:01.730299 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-8a72168b-70bf-4dec-b912-d78fa9f35ffc None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:36:01.731542 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-8a72168b-70bf-4dec-b912-d78fa9f35ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:36:01.836279 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 739/1472] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:36:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:36:01.887361 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182432d-ed46-4a29-b8a1-697f9b986a91 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:36:01.887656 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182432d-ed46-4a29-b8a1-697f9b986a91 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:36:01.887935 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182432d-ed46-4a29-b8a1-697f9b986a91 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:36:01.889358 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 734/1473] 10.222.0.39 () {54 vars in 961 bytes} [Mon Jul 18 10:36:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:36:01.894222 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe95aa4-cf69-4fd4-bfad-95fd066d9943 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:36:01.894502 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe95aa4-cf69-4fd4-bfad-95fd066d9943 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:36:01.894777 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe95aa4-cf69-4fd4-bfad-95fd066d9943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:36:01.975315 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-4fe95aa4-cf69-4fd4-bfad-95fd066d9943 None None] MFA Rules not processed for user `48d1f7d0286745a396905aee50c9410b`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:36:01.976469 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-4fe95aa4-cf69-4fd4-bfad-95fd066d9943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:36:01.999105 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:36:02.060122 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 740/1474] 10.222.0.39 () {58 vars in 1058 bytes} [Mon Jul 18 10:36:01 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:36:02.068762 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a182432d-ed46-4a29-b8a1-697f9b986a91 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:36:02.071257 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-a182432d-ed46-4a29-b8a1-697f9b986a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:36:02.183484 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a182432d-ed46-4a29-b8a1-697f9b986a91 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:36:02.263887 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251144be-dc56-409b-90a4-268e2e6efdf1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d1f7d0286745a396905aee50c9410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:36:02.264538 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251144be-dc56-409b-90a4-268e2e6efdf1 service glance] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:36:02.264817 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251144be-dc56-409b-90a4-268e2e6efdf1 service glance] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:36:02.265118 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251144be-dc56-409b-90a4-268e2e6efdf1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:36:02.266874 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-251144be-dc56-409b-90a4-268e2e6efdf1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:36:02.323275 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:36:02.380619 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251144be-dc56-409b-90a4-268e2e6efdf1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:36:02.382098 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251144be-dc56-409b-90a4-268e2e6efdf1 service glance] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:36:02.402435 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 735/1475] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:36:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:36:04.591477 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f90ab1-d0af-43ec-b3c0-4f536302c0b0 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:36:04.592248 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f90ab1-d0af-43ec-b3c0-4f536302c0b0 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:36:04.592248 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f90ab1-d0af-43ec-b3c0-4f536302c0b0 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:36:04.593424 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 741/1476] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:36:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:36:04.599355 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23b71a-7f89-44bc-8128-36acb4066854 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:36:04.599812 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23b71a-7f89-44bc-8128-36acb4066854 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:36:04.599913 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23b71a-7f89-44bc-8128-36acb4066854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:36:04.678519 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-3a23b71a-7f89-44bc-8128-36acb4066854 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:36:04.680574 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-3a23b71a-7f89-44bc-8128-36acb4066854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:36:04.807769 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 736/1477] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:36:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:36:04.831319 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f90ab1-d0af-43ec-b3c0-4f536302c0b0 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:36:04.832884 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-a2f90ab1-d0af-43ec-b3c0-4f536302c0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:36:04.966054 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f90ab1-d0af-43ec-b3c0-4f536302c0b0 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:36:05.016162 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:36:05.062798 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff21891c-cbe4-40e6-9392-cf689089d5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:36:05.063470 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21891c-cbe4-40e6-9392-cf689089d5d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:36:05.063752 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21891c-cbe4-40e6-9392-cf689089d5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:36:05.064029 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21891c-cbe4-40e6-9392-cf689089d5d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:36:05.064767 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff21891c-cbe4-40e6-9392-cf689089d5d9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:36:05.066635 dv-cinder-837546-3-smb devstack@keystone.service[80392]: WARNING py.warnings [None req-ff21891c-cbe4-40e6-9392-cf689089d5d9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 10:36:05.066635 dv-cinder-837546-3-smb devstack@keystone.service[80392]: warnings.warn(msg) Jul 18 10:36:05.066635 dv-cinder-837546-3-smb devstack@keystone.service[80392]: Jul 18 10:36:05.068340 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff21891c-cbe4-40e6-9392-cf689089d5d9 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:36:05.088427 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 742/1478] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Jul 18 10:36:04 2022] GET /identity/v3/projects => generated 2553 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:36:07.177982 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02493c-6855-49f6-959c-dd772728e9ed None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:36:07.178559 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02493c-6855-49f6-959c-dd772728e9ed None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:36:07.178559 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02493c-6855-49f6-959c-dd772728e9ed None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:36:07.179975 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 737/1479] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:36:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:36:07.185559 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8de2c-fa64-4e0f-9534-8a5b1aa653ce None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:36:07.186036 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8de2c-fa64-4e0f-9534-8a5b1aa653ce None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:36:07.186172 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8de2c-fa64-4e0f-9534-8a5b1aa653ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:36:07.265899 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-b5b8de2c-fa64-4e0f-9534-8a5b1aa653ce None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:36:07.267157 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-b5b8de2c-fa64-4e0f-9534-8a5b1aa653ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:36:07.498071 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 743/1480] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:36:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:36:07.545491 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e02493c-6855-49f6-959c-dd772728e9ed None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:36:07.545491 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-0e02493c-6855-49f6-959c-dd772728e9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:36:07.554748 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:36:07.694967 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e02493c-6855-49f6-959c-dd772728e9ed None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:36:07.775333 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:36:07.811995 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d7ec0-0a44-4469-867c-f74d4abb335b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bbebf16219943879df84bdc9a900516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:36:07.812654 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d7ec0-0a44-4469-867c-f74d4abb335b service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:36:07.812946 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d7ec0-0a44-4469-867c-f74d4abb335b service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:36:07.813240 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d7ec0-0a44-4469-867c-f74d4abb335b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:36:07.814920 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-bd3d7ec0-0a44-4469-867c-f74d4abb335b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:36:07.907100 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3d7ec0-0a44-4469-867c-f74d4abb335b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:36:07.908685 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3d7ec0-0a44-4469-867c-f74d4abb335b service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:36:07.929774 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 738/1481] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:36:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:36:10.213070 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d33488-94a8-4967-9a61-d3729976527d None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:36:10.213674 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d33488-94a8-4967-9a61-d3729976527d None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:36:10.213674 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d33488-94a8-4967-9a61-d3729976527d None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:36:10.215007 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 744/1482] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:36:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:36:10.220927 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a042d3-9690-46ba-8ae0-b516ad397c97 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:36:10.221580 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a042d3-9690-46ba-8ae0-b516ad397c97 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:36:10.221580 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a042d3-9690-46ba-8ae0-b516ad397c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:36:10.291056 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-38a042d3-9690-46ba-8ae0-b516ad397c97 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:36:10.292297 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-38a042d3-9690-46ba-8ae0-b516ad397c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:36:10.343069 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:36:10.399263 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 739/1483] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:36:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:36:10.436183 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d33488-94a8-4967-9a61-d3729976527d None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:36:10.437884 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-57d33488-94a8-4967-9a61-d3729976527d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:36:10.462635 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:36:10.551709 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d33488-94a8-4967-9a61-d3729976527d None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:36:10.629683 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a068a8a1-8850-429c-813d-c11baeb7573a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:36:10.630639 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068a8a1-8850-429c-813d-c11baeb7573a service neutron] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:36:10.630917 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068a8a1-8850-429c-813d-c11baeb7573a service neutron] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:36:10.631193 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068a8a1-8850-429c-813d-c11baeb7573a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:36:10.632872 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-a068a8a1-8850-429c-813d-c11baeb7573a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:36:10.711251 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:36:10.747449 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a068a8a1-8850-429c-813d-c11baeb7573a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:36:10.748896 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a068a8a1-8850-429c-813d-c11baeb7573a service neutron] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:36:10.768651 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 745/1484] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:36:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:36:12.875321 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e4d43-bdd8-4d6e-ab85-b0b244135960 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:36:12.875914 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e4d43-bdd8-4d6e-ab85-b0b244135960 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:36:12.875914 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e4d43-bdd8-4d6e-ab85-b0b244135960 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:36:12.877275 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 740/1485] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:36:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:36:12.883858 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278762df-e0b8-45af-be5d-5815c27c4b00 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:36:12.884517 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278762df-e0b8-45af-be5d-5815c27c4b00 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:36:12.884517 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278762df-e0b8-45af-be5d-5815c27c4b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:36:12.958189 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-278762df-e0b8-45af-be5d-5815c27c4b00 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:36:12.959414 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-278762df-e0b8-45af-be5d-5815c27c4b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:36:13.057619 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 746/1486] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:36:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:36:13.096233 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e4d43-bdd8-4d6e-ab85-b0b244135960 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:36:13.099102 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-e03e4d43-bdd8-4d6e-ab85-b0b244135960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:36:13.220425 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e4d43-bdd8-4d6e-ab85-b0b244135960 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:36:13.295641 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:36:13.297640 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc138ef-a9f1-4cda-98f6-ac500beb6c69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:36:13.298294 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc138ef-a9f1-4cda-98f6-ac500beb6c69 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:36:13.298577 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc138ef-a9f1-4cda-98f6-ac500beb6c69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:36:13.298853 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc138ef-a9f1-4cda-98f6-ac500beb6c69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:36:13.300524 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-0cc138ef-a9f1-4cda-98f6-ac500beb6c69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:36:13.411517 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc138ef-a9f1-4cda-98f6-ac500beb6c69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:36:13.412973 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc138ef-a9f1-4cda-98f6-ac500beb6c69 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:36:13.431678 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 741/1487] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:36:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:36:15.575526 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52677aca-f5e8-4719-8b24-68cd54b7c0b7 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:36:15.576361 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52677aca-f5e8-4719-8b24-68cd54b7c0b7 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:36:15.576471 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52677aca-f5e8-4719-8b24-68cd54b7c0b7 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:36:15.577822 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 747/1488] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:36:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:36:15.583230 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc8b8ce-f9b6-405c-8097-0fa60764db54 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:36:15.583703 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc8b8ce-f9b6-405c-8097-0fa60764db54 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:36:15.583812 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc8b8ce-f9b6-405c-8097-0fa60764db54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:36:15.651361 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-8cc8b8ce-f9b6-405c-8097-0fa60764db54 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:36:15.652574 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-8cc8b8ce-f9b6-405c-8097-0fa60764db54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:36:15.707493 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:36:15.751920 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 742/1489] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:36:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:36:15.792995 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52677aca-f5e8-4719-8b24-68cd54b7c0b7 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:36:15.794564 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-52677aca-f5e8-4719-8b24-68cd54b7c0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:36:15.832391 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:36:15.900897 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52677aca-f5e8-4719-8b24-68cd54b7c0b7 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:36:15.976121 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2e05db-3ec4-49f4-93df-0c2b9ab655b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:36:15.976774 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e05db-3ec4-49f4-93df-0c2b9ab655b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:36:15.977087 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e05db-3ec4-49f4-93df-0c2b9ab655b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:36:15.977372 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e05db-3ec4-49f4-93df-0c2b9ab655b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:36:15.979021 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-5e2e05db-3ec4-49f4-93df-0c2b9ab655b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:36:16.060805 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:36:16.097897 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2e05db-3ec4-49f4-93df-0c2b9ab655b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:36:16.099464 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2e05db-3ec4-49f4-93df-0c2b9ab655b3 service neutron] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:36:16.124527 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 748/1490] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:36:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:36:18.630333 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520b5ae-8dfd-4a14-89e7-9df7725edc9b None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:36:18.630883 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520b5ae-8dfd-4a14-89e7-9df7725edc9b None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:36:18.630883 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520b5ae-8dfd-4a14-89e7-9df7725edc9b None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:36:18.632283 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 743/1491] 10.222.0.39 () {54 vars in 926 bytes} [Mon Jul 18 10:36:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:36:18.637573 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76559e4-594e-4e85-aa82-5420d136fe7e None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:36:18.638008 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76559e4-594e-4e85-aa82-5420d136fe7e None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:36:18.638135 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76559e4-594e-4e85-aa82-5420d136fe7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:36:18.704617 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-c76559e4-594e-4e85-aa82-5420d136fe7e None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:36:18.705878 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-c76559e4-594e-4e85-aa82-5420d136fe7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:36:18.804921 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 749/1492] 10.222.0.39 () {58 vars in 1023 bytes} [Mon Jul 18 10:36:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:36:18.845314 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520b5ae-8dfd-4a14-89e7-9df7725edc9b None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:36:18.846834 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-8520b5ae-8dfd-4a14-89e7-9df7725edc9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:36:18.952011 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8520b5ae-8dfd-4a14-89e7-9df7725edc9b None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:36:19.022919 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250453e9-bcc0-4f2a-9445-ce38fdc49e2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:36:19.023563 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250453e9-bcc0-4f2a-9445-ce38fdc49e2e service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:36:19.023841 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250453e9-bcc0-4f2a-9445-ce38fdc49e2e service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:36:19.024115 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250453e9-bcc0-4f2a-9445-ce38fdc49e2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:36:19.025777 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-250453e9-bcc0-4f2a-9445-ce38fdc49e2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:36:19.035151 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:36:19.137240 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250453e9-bcc0-4f2a-9445-ce38fdc49e2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:36:19.138679 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250453e9-bcc0-4f2a-9445-ce38fdc49e2e service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:36:19.156239 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 744/1493] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:36:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:36:28.803112 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=82 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:36:29.153952 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=50 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:37:55.399473 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d9a34-51ec-4e81-b3c3-17abe28e97bc None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:37:55.400132 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d9a34-51ec-4e81-b3c3-17abe28e97bc None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:37:55.400132 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d9a34-51ec-4e81-b3c3-17abe28e97bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:37:55.482182 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-9d0d9a34-51ec-4e81-b3c3-17abe28e97bc None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:37:55.483547 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-9d0d9a34-51ec-4e81-b3c3-17abe28e97bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:37:55.582180 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 750/1494] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:37:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:37:55.591036 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d3387-77ff-441d-a8df-7c2210efb519 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:37:55.591590 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d3387-77ff-441d-a8df-7c2210efb519 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:37:55.591590 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d3387-77ff-441d-a8df-7c2210efb519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:37:55.667944 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-0a4d3387-77ff-441d-a8df-7c2210efb519 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:37:55.669091 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-0a4d3387-77ff-441d-a8df-7c2210efb519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:37:55.766445 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 745/1495] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:37:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:37:55.771146 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d9a34-51ec-4e81-b3c3-17abe28e97bc None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:37:55.772369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-9d0d9a34-51ec-4e81-b3c3-17abe28e97bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:37:55.785011 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d9a34-51ec-4e81-b3c3-17abe28e97bc None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:37:55.851521 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:37:55.885061 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e660903-a696-4157-8ed0-d262c8789bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:37:55.885736 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e660903-a696-4157-8ed0-d262c8789bd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:37:55.886089 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e660903-a696-4157-8ed0-d262c8789bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:37:55.886383 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e660903-a696-4157-8ed0-d262c8789bd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:37:55.887392 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e660903-a696-4157-8ed0-d262c8789bd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:37:55.887883 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e660903-a696-4157-8ed0-d262c8789bd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:37:55.889094 dv-cinder-837546-3-smb devstack@keystone.service[80392]: WARNING py.warnings [None req-0e660903-a696-4157-8ed0-d262c8789bd4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 10:37:55.889094 dv-cinder-837546-3-smb devstack@keystone.service[80392]: warnings.warn(msg) Jul 18 10:37:55.889094 dv-cinder-837546-3-smb devstack@keystone.service[80392]: Jul 18 10:37:55.891457 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e660903-a696-4157-8ed0-d262c8789bd4 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:37:55.903787 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 751/1496] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 10:37:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:37:55.912740 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4d3387-77ff-441d-a8df-7c2210efb519 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:37:55.922303 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4d3387-77ff-441d-a8df-7c2210efb519 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:37:55.985118 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:37:56.019773 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2323835e-6f84-4cc5-a2a9-d9008647a69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:37:56.020486 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323835e-6f84-4cc5-a2a9-d9008647a69e admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:37:56.020766 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323835e-6f84-4cc5-a2a9-d9008647a69e admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:37:56.021068 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323835e-6f84-4cc5-a2a9-d9008647a69e admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:37:56.021754 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2323835e-6f84-4cc5-a2a9-d9008647a69e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:37:56.023514 dv-cinder-837546-3-smb devstack@keystone.service[80393]: WARNING py.warnings [None req-2323835e-6f84-4cc5-a2a9-d9008647a69e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 10:37:56.023514 dv-cinder-837546-3-smb devstack@keystone.service[80393]: warnings.warn(msg) Jul 18 10:37:56.023514 dv-cinder-837546-3-smb devstack@keystone.service[80393]: Jul 18 10:37:56.024703 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2323835e-6f84-4cc5-a2a9-d9008647a69e admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:37:56.211092 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 746/1497] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:37:55 2022] POST /identity/v3/projects => generated 379 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:37:56.215647 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e660903-a696-4157-8ed0-d262c8789bd4 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:37:56.217272 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-0e660903-a696-4157-8ed0-d262c8789bd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:37:56.253307 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e660903-a696-4157-8ed0-d262c8789bd4 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:37:56.351586 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25204fb3-e3ff-4929-8bee-ee3819b083ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:37:56.352261 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25204fb3-e3ff-4929-8bee-ee3819b083ba admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:37:56.352636 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25204fb3-e3ff-4929-8bee-ee3819b083ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:37:56.352988 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25204fb3-e3ff-4929-8bee-ee3819b083ba admin admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:37:56.353706 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25204fb3-e3ff-4929-8bee-ee3819b083ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:37:56.354717 dv-cinder-837546-3-smb devstack@keystone.service[80392]: WARNING py.warnings [None req-25204fb3-e3ff-4929-8bee-ee3819b083ba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 10:37:56.354717 dv-cinder-837546-3-smb devstack@keystone.service[80392]: warnings.warn(msg) Jul 18 10:37:56.354717 dv-cinder-837546-3-smb devstack@keystone.service[80392]: Jul 18 10:37:56.355917 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25204fb3-e3ff-4929-8bee-ee3819b083ba admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:37:56.472442 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 752/1498] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:37:56 2022] POST /identity/v3/users => generated 290 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:37:56.476556 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2323835e-6f84-4cc5-a2a9-d9008647a69e admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:37:56.478223 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-2323835e-6f84-4cc5-a2a9-d9008647a69e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:37:56.542172 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2323835e-6f84-4cc5-a2a9-d9008647a69e admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:37:56.627580 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:37:56.637896 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c2b66-727b-484d-b6d2-bcf27ee5e6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:37:56.643794 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c2b66-727b-484d-b6d2-bcf27ee5e6b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:37:56.643794 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c2b66-727b-484d-b6d2-bcf27ee5e6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:37:56.643794 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c2b66-727b-484d-b6d2-bcf27ee5e6b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:37:56.643794 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744c2b66-727b-484d-b6d2-bcf27ee5e6b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:37:56.643794 dv-cinder-837546-3-smb devstack@keystone.service[80393]: WARNING py.warnings [None req-744c2b66-727b-484d-b6d2-bcf27ee5e6b5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 10:37:56.643794 dv-cinder-837546-3-smb devstack@keystone.service[80393]: warnings.warn(msg) Jul 18 10:37:56.643794 dv-cinder-837546-3-smb devstack@keystone.service[80393]: Jul 18 10:37:56.644407 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744c2b66-727b-484d-b6d2-bcf27ee5e6b5 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:37:56.654620 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 747/1499] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:37:56.658950 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25204fb3-e3ff-4929-8bee-ee3819b083ba admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:37:56.660535 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-25204fb3-e3ff-4929-8bee-ee3819b083ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:37:56.673373 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25204fb3-e3ff-4929-8bee-ee3819b083ba admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:37:56.700787 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:37:56.778635 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c4a434-5bd8-415b-aae0-cb902e18f69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:37:56.779303 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c4a434-5bd8-415b-aae0-cb902e18f69c admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:37:56.779583 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c4a434-5bd8-415b-aae0-cb902e18f69c admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:37:56.779890 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c4a434-5bd8-415b-aae0-cb902e18f69c admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:37:56.780627 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c4a434-5bd8-415b-aae0-cb902e18f69c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:37:56.781812 dv-cinder-837546-3-smb devstack@keystone.service[80392]: WARNING py.warnings [None req-79c4a434-5bd8-415b-aae0-cb902e18f69c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 10:37:56.781812 dv-cinder-837546-3-smb devstack@keystone.service[80392]: warnings.warn(msg) Jul 18 10:37:56.781812 dv-cinder-837546-3-smb devstack@keystone.service[80392]: Jul 18 10:37:56.782791 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c4a434-5bd8-415b-aae0-cb902e18f69c admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:37:56.796859 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 753/1500] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:37:56.801291 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c2b66-727b-484d-b6d2-bcf27ee5e6b5 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:37:56.802861 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-744c2b66-727b-484d-b6d2-bcf27ee5e6b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:37:56.836885 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c2b66-727b-484d-b6d2-bcf27ee5e6b5 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:37:56.935764 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9003d02-504f-4ebc-a9e1-21b0b6c300b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:37:56.937340 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9003d02-504f-4ebc-a9e1-21b0b6c300b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:37:56.937622 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9003d02-504f-4ebc-a9e1-21b0b6c300b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:37:56.937896 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9003d02-504f-4ebc-a9e1-21b0b6c300b9 admin admin] PATH_INFO: `/v3/projects/123ceac2cb72477fb5e24a6208378cb4/users/623950bf70e44600a48e5af8ebcbbb14/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:37:56.961871 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9003d02-504f-4ebc-a9e1-21b0b6c300b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=123ceac2cb72477fb5e24a6208378cb4, user_id=623950bf70e44600a48e5af8ebcbbb14, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:37:56.962895 dv-cinder-837546-3-smb devstack@keystone.service[80393]: WARNING py.warnings [None req-d9003d02-504f-4ebc-a9e1-21b0b6c300b9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 10:37:56.962895 dv-cinder-837546-3-smb devstack@keystone.service[80393]: warnings.warn(msg) Jul 18 10:37:56.962895 dv-cinder-837546-3-smb devstack@keystone.service[80393]: Jul 18 10:37:56.964855 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9003d02-504f-4ebc-a9e1-21b0b6c300b9 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:37:57.347954 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 748/1501] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:37:56 2022] PUT /identity/v3/projects/123ceac2cb72477fb5e24a6208378cb4/users/623950bf70e44600a48e5af8ebcbbb14/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:37:57.366132 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924473a-7735-4d94-af88-26e6dc62b140 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:37:57.366132 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924473a-7735-4d94-af88-26e6dc62b140 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:37:57.366132 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924473a-7735-4d94-af88-26e6dc62b140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:37:57.425036 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-b924473a-7735-4d94-af88-26e6dc62b140 None None] MFA Rules not processed for user `623950bf70e44600a48e5af8ebcbbb14`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:37:57.426331 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-b924473a-7735-4d94-af88-26e6dc62b140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:37:57.507156 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 754/1502] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:37:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:37:57.522294 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d97f48-b056-47ce-bcd5-b680df15764a None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:37:57.522584 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d97f48-b056-47ce-bcd5-b680df15764a None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:37:57.522861 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d97f48-b056-47ce-bcd5-b680df15764a None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:37:57.524411 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 749/1503] 10.222.0.39 () {54 vars in 964 bytes} [Mon Jul 18 10:37:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:37:57.530953 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f758049-cb92-49b5-aa8f-dcb764532240 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:37:57.531243 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f758049-cb92-49b5-aa8f-dcb764532240 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:37:57.531518 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f758049-cb92-49b5-aa8f-dcb764532240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:37:57.566447 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:37:57.615640 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-5f758049-cb92-49b5-aa8f-dcb764532240 None None] MFA Rules not processed for user `7cc4f041a5b242138a92a54633dcece6`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:37:57.616925 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-5f758049-cb92-49b5-aa8f-dcb764532240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:37:57.694945 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 755/1504] 10.222.0.39 () {58 vars in 1061 bytes} [Mon Jul 18 10:37:57 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:37:57.703530 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d97f48-b056-47ce-bcd5-b680df15764a None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:37:57.705727 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-f3d97f48-b056-47ce-bcd5-b680df15764a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:37:57.759432 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:37:57.814923 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d97f48-b056-47ce-bcd5-b680df15764a None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:37:57.921906 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0283f-f234-486d-832d-7ffcdf6e2317 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:37:57.922895 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0283f-f234-486d-832d-7ffcdf6e2317 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:37:57.923371 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0283f-f234-486d-832d-7ffcdf6e2317 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:37:57.923842 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0283f-f234-486d-832d-7ffcdf6e2317 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:37:57.926881 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-dae0283f-f234-486d-832d-7ffcdf6e2317 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:37:58.095925 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae0283f-f234-486d-832d-7ffcdf6e2317 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:37:58.098667 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae0283f-f234-486d-832d-7ffcdf6e2317 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:37:58.105729 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:37:58.131456 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 750/1505] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:37:57 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:37:58.177842 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39d6e7-341d-448c-8852-b91a43b3e82f None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:37:58.178136 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39d6e7-341d-448c-8852-b91a43b3e82f None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:37:58.178420 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39d6e7-341d-448c-8852-b91a43b3e82f None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:37:58.179757 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 756/1506] 10.222.0.39 () {52 vars in 829 bytes} [Mon Jul 18 10:37:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:37:58.183329 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0283f-f234-486d-832d-7ffcdf6e2317 service cinder] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:37:58.184570 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-dae0283f-f234-486d-832d-7ffcdf6e2317 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:37:58.292437 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0283f-f234-486d-832d-7ffcdf6e2317 service cinder] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:37:58.391561 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e84b63-7665-4b98-9c85-a1e9145a4272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:37:58.392530 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e84b63-7665-4b98-9c85-a1e9145a4272 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:37:58.392809 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e84b63-7665-4b98-9c85-a1e9145a4272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:37:58.393114 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e84b63-7665-4b98-9c85-a1e9145a4272 admin admin] PATH_INFO: `/v3/users/623950bf70e44600a48e5af8ebcbbb14` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:37:58.407497 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e84b63-7665-4b98-9c85-a1e9145a4272 admin admin] RBAC: Authorizing `identity:delete_user(user_id=623950bf70e44600a48e5af8ebcbbb14)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:37:58.408519 dv-cinder-837546-3-smb devstack@keystone.service[80393]: WARNING py.warnings [None req-15e84b63-7665-4b98-9c85-a1e9145a4272 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 10:37:58.408519 dv-cinder-837546-3-smb devstack@keystone.service[80393]: warnings.warn(msg) Jul 18 10:37:58.408519 dv-cinder-837546-3-smb devstack@keystone.service[80393]: Jul 18 10:37:58.409785 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e84b63-7665-4b98-9c85-a1e9145a4272 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:37:58.419915 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:37:58.576399 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-15e84b63-7665-4b98-9c85-a1e9145a4272 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '623950bf70e44600a48e5af8ebcbbb14'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:37:58.647061 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-15e84b63-7665-4b98-9c85-a1e9145a4272 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '623950bf70e44600a48e5af8ebcbbb14'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:37:58.647499 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-15e84b63-7665-4b98-9c85-a1e9145a4272 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '623950bf70e44600a48e5af8ebcbbb14'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:37:58.666533 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-15e84b63-7665-4b98-9c85-a1e9145a4272 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '623950bf70e44600a48e5af8ebcbbb14'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:37:58.681934 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-15e84b63-7665-4b98-9c85-a1e9145a4272 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '623950bf70e44600a48e5af8ebcbbb14'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:37:58.688437 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 751/1507] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:37:58 2022] DELETE /identity/v3/users/623950bf70e44600a48e5af8ebcbbb14 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:37:58.694014 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5294f9ca-31c2-44ea-afd2-f0529a0b9d9a None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:37:58.694499 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5294f9ca-31c2-44ea-afd2-f0529a0b9d9a None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:37:58.694604 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5294f9ca-31c2-44ea-afd2-f0529a0b9d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:37:58.753286 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-5294f9ca-31c2-44ea-afd2-f0529a0b9d9a None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:37:58.754522 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-5294f9ca-31c2-44ea-afd2-f0529a0b9d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:37:58.832823 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:37:58.847634 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 757/1508] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:37:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:37:58.857865 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e84b63-7665-4b98-9c85-a1e9145a4272 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:37:58.859395 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-15e84b63-7665-4b98-9c85-a1e9145a4272 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:37:58.973441 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e84b63-7665-4b98-9c85-a1e9145a4272 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:37:59.034306 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:37:59.054532 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e1a64-21b6-4ee0-9065-957e65847cc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:37:59.055224 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e1a64-21b6-4ee0-9065-957e65847cc1 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:37:59.055508 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e1a64-21b6-4ee0-9065-957e65847cc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:37:59.063222 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e1a64-21b6-4ee0-9065-957e65847cc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:37:59.063222 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-a07e1a64-21b6-4ee0-9065-957e65847cc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:37:59.174888 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07e1a64-21b6-4ee0-9065-957e65847cc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:37:59.176344 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07e1a64-21b6-4ee0-9065-957e65847cc1 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:37:59.196753 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 752/1509] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:37:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:37:59.757942 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5294f9ca-31c2-44ea-afd2-f0529a0b9d9a None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:37:59.759189 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-5294f9ca-31c2-44ea-afd2-f0529a0b9d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:37:59.771584 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5294f9ca-31c2-44ea-afd2-f0529a0b9d9a None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:37:59.874325 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e04fd5b-ab63-46cb-84bb-f6235825ba0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:37:59.875210 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04fd5b-ab63-46cb-84bb-f6235825ba0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:37:59.875488 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04fd5b-ab63-46cb-84bb-f6235825ba0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:37:59.875757 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04fd5b-ab63-46cb-84bb-f6235825ba0e admin admin] PATH_INFO: `/v3/projects/123ceac2cb72477fb5e24a6208378cb4` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:37:59.886130 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e04fd5b-ab63-46cb-84bb-f6235825ba0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=123ceac2cb72477fb5e24a6208378cb4)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:37:59.887165 dv-cinder-837546-3-smb devstack@keystone.service[80392]: WARNING py.warnings [None req-9e04fd5b-ab63-46cb-84bb-f6235825ba0e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 10:37:59.887165 dv-cinder-837546-3-smb devstack@keystone.service[80392]: warnings.warn(msg) Jul 18 10:37:59.887165 dv-cinder-837546-3-smb devstack@keystone.service[80392]: Jul 18 10:37:59.888367 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e04fd5b-ab63-46cb-84bb-f6235825ba0e admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:38:00.000103 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-9e04fd5b-ab63-46cb-84bb-f6235825ba0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '123ceac2cb72477fb5e24a6208378cb4', 'request_id': 'req-9e04fd5b-ab63-46cb-84bb-f6235825ba0e'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:38:00.006631 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-9e04fd5b-ab63-46cb-84bb-f6235825ba0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '123ceac2cb72477fb5e24a6208378cb4', 'request_id': 'req-9e04fd5b-ab63-46cb-84bb-f6235825ba0e'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:38:00.022414 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-9e04fd5b-ab63-46cb-84bb-f6235825ba0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '123ceac2cb72477fb5e24a6208378cb4', 'request_id': 'req-9e04fd5b-ab63-46cb-84bb-f6235825ba0e'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:38:00.134206 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-9e04fd5b-ab63-46cb-84bb-f6235825ba0e admin admin] The token cache is being invalidate because project 123ceac2cb72477fb5e24a6208378cb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80392) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:38:00.134498 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-9e04fd5b-ab63-46cb-84bb-f6235825ba0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:38:00.134931 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-9e04fd5b-ab63-46cb-84bb-f6235825ba0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:38:00.136520 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 758/1510] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:37:59 2022] DELETE /identity/v3/projects/123ceac2cb72477fb5e24a6208378cb4 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:38:09.194105 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=62 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:38:10.132191 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:39:46.542228 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4587b83e-1579-4d5f-9ae7-e720db04e7b9 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:39:46.542845 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4587b83e-1579-4d5f-9ae7-e720db04e7b9 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:39:46.542845 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4587b83e-1579-4d5f-9ae7-e720db04e7b9 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:39:46.544194 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 753/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 10:39:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:39:46.550882 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9301c66-9246-4334-ae60-3276858abb94 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:39:46.551412 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9301c66-9246-4334-ae60-3276858abb94 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:39:46.551412 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9301c66-9246-4334-ae60-3276858abb94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:39:46.637606 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-e9301c66-9246-4334-ae60-3276858abb94 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:39:46.638924 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-e9301c66-9246-4334-ae60-3276858abb94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:39:46.761124 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 759/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 10:39:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:39:46.916475 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4587b83e-1579-4d5f-9ae7-e720db04e7b9 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:39:46.918986 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-4587b83e-1579-4d5f-9ae7-e720db04e7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:39:47.051153 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4587b83e-1579-4d5f-9ae7-e720db04e7b9 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:39:47.056944 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f905d03-162b-426d-8525-af15ea328f2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bbebf16219943879df84bdc9a900516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:39:47.057642 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f905d03-162b-426d-8525-af15ea328f2c service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:39:47.057958 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f905d03-162b-426d-8525-af15ea328f2c service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:39:47.058240 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f905d03-162b-426d-8525-af15ea328f2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:39:47.068509 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f905d03-162b-426d-8525-af15ea328f2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:39:47.070147 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f905d03-162b-426d-8525-af15ea328f2c service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:39:47.081497 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 754/1513] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:39:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:39:47.940985 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ebaf5-0217-46ec-be53-ecdf44927ca0 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:39:47.941563 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ebaf5-0217-46ec-be53-ecdf44927ca0 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:39:47.941563 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ebaf5-0217-46ec-be53-ecdf44927ca0 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:39:47.942942 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 760/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 10:39:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:39:47.947736 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d16cc9-b19e-4738-9423-c859d739610a None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:39:47.948191 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d16cc9-b19e-4738-9423-c859d739610a None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:39:47.948290 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d16cc9-b19e-4738-9423-c859d739610a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:39:47.968204 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-64d16cc9-b19e-4738-9423-c859d739610a None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:39:47.969465 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-64d16cc9-b19e-4738-9423-c859d739610a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:39:47.977519 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 755/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 10:39:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:39:48.026119 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475cf8bb-34bf-4809-b44e-8e883c9ce229 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:39:48.026412 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475cf8bb-34bf-4809-b44e-8e883c9ce229 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:39:48.026696 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475cf8bb-34bf-4809-b44e-8e883c9ce229 None None] PATH_INFO: `/v3` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:39:48.028049 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 761/1516] 10.222.0.61 () {54 vars in 925 bytes} [Mon Jul 18 10:39:48 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:39:48.034704 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a592fbe-7fe0-4aa0-b5ff-d5e684fab2e0 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:39:48.034991 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a592fbe-7fe0-4aa0-b5ff-d5e684fab2e0 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:39:48.035261 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a592fbe-7fe0-4aa0-b5ff-d5e684fab2e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:39:48.097578 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-0a592fbe-7fe0-4aa0-b5ff-d5e684fab2e0 None None] MFA Rules not processed for user `2330638e80a941cd9aeeb2fd615900d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:39:48.102238 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-0a592fbe-7fe0-4aa0-b5ff-d5e684fab2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:39:48.130833 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475cf8bb-34bf-4809-b44e-8e883c9ce229 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:39:48.146503 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475cf8bb-34bf-4809-b44e-8e883c9ce229 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:39:48.152027 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac76f87-67bb-426d-86e3-13bc3b06c5e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bbebf16219943879df84bdc9a900516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:39:48.152673 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac76f87-67bb-426d-86e3-13bc3b06c5e0 service nova] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:39:48.152958 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac76f87-67bb-426d-86e3-13bc3b06c5e0 service nova] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:39:48.153284 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac76f87-67bb-426d-86e3-13bc3b06c5e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:39:48.157027 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:39:48.162528 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac76f87-67bb-426d-86e3-13bc3b06c5e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:39:48.164170 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac76f87-67bb-426d-86e3-13bc3b06c5e0 service nova] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:39:48.174318 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 762/1517] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:39:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:39:48.176669 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 756/1518] 10.222.0.61 () {58 vars in 1015 bytes} [Mon Jul 18 10:39:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:39:57.190752 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1e898-409c-4793-8733-7751fd0c5145 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:39:57.191297 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1e898-409c-4793-8733-7751fd0c5145 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:39:57.191297 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1e898-409c-4793-8733-7751fd0c5145 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:39:57.192620 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 763/1519] 10.222.0.39 () {54 vars in 961 bytes} [Mon Jul 18 10:39:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:39:57.197630 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3487215-7ce2-44a6-bf20-e44455906d97 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:39:57.198055 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3487215-7ce2-44a6-bf20-e44455906d97 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:39:57.198186 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3487215-7ce2-44a6-bf20-e44455906d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:39:57.216150 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-f3487215-7ce2-44a6-bf20-e44455906d97 None None] MFA Rules not processed for user `2330638e80a941cd9aeeb2fd615900d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:39:57.217687 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-f3487215-7ce2-44a6-bf20-e44455906d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:39:57.226882 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 757/1520] 10.222.0.39 () {58 vars in 1058 bytes} [Mon Jul 18 10:39:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:39:57.235265 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e1e898-409c-4793-8733-7751fd0c5145 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:39:57.249229 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e1e898-409c-4793-8733-7751fd0c5145 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:39:57.254598 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae3cc3-a3bf-45e0-a446-5ab10c0959cd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2330638e80a941cd9aeeb2fd615900d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:39:57.255230 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae3cc3-a3bf-45e0-a446-5ab10c0959cd service placement] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:39:57.255510 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae3cc3-a3bf-45e0-a446-5ab10c0959cd service placement] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:39:57.255783 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae3cc3-a3bf-45e0-a446-5ab10c0959cd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:39:57.264343 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae3cc3-a3bf-45e0-a446-5ab10c0959cd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:39:57.265984 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae3cc3-a3bf-45e0-a446-5ab10c0959cd service placement] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:39:57.276010 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 764/1521] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:39:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:39:59.393241 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777a706-5801-4b25-8f79-e729ec77c1f3 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:39:59.393768 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777a706-5801-4b25-8f79-e729ec77c1f3 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:39:59.393768 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777a706-5801-4b25-8f79-e729ec77c1f3 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:39:59.395097 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 758/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 10:39:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:39:59.400405 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee939b95-f709-4f25-bef7-e5693e02e306 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:39:59.400893 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee939b95-f709-4f25-bef7-e5693e02e306 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:39:59.400993 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee939b95-f709-4f25-bef7-e5693e02e306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:39:59.419066 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-ee939b95-f709-4f25-bef7-e5693e02e306 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:39:59.420279 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-ee939b95-f709-4f25-bef7-e5693e02e306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:39:59.429106 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 765/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 10:39:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:39:59.584253 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6777a706-5801-4b25-8f79-e729ec77c1f3 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:39:59.598580 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6777a706-5801-4b25-8f79-e729ec77c1f3 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:39:59.604088 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b61628-1bab-4080-8b01-0b4eaf688b3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bbebf16219943879df84bdc9a900516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:39:59.604720 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b61628-1bab-4080-8b01-0b4eaf688b3c service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:39:59.605000 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b61628-1bab-4080-8b01-0b4eaf688b3c service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:39:59.605386 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b61628-1bab-4080-8b01-0b4eaf688b3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:39:59.614352 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b61628-1bab-4080-8b01-0b4eaf688b3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:39:59.616018 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b61628-1bab-4080-8b01-0b4eaf688b3c service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:39:59.626271 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 759/1524] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:39:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:40:00.447065 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec27efb5-d079-4232-983c-95d9b4137703 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:00.447616 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec27efb5-d079-4232-983c-95d9b4137703 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:00.447616 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec27efb5-d079-4232-983c-95d9b4137703 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:00.448889 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 766/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 10:40:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:40:00.454383 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c24a9-e4a2-4b38-81e4-c63e5eacf440 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:00.454806 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c24a9-e4a2-4b38-81e4-c63e5eacf440 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:00.454948 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c24a9-e4a2-4b38-81e4-c63e5eacf440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:00.473785 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-e78c24a9-e4a2-4b38-81e4-c63e5eacf440 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:40:00.474999 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-e78c24a9-e4a2-4b38-81e4-c63e5eacf440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:00.482917 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 760/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 10:40:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:40:00.634538 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec27efb5-d079-4232-983c-95d9b4137703 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:00.648786 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec27efb5-d079-4232-983c-95d9b4137703 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:00.654224 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa546d49-927f-4373-882c-298aaef8fd51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bbebf16219943879df84bdc9a900516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:00.654864 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa546d49-927f-4373-882c-298aaef8fd51 service nova] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:00.655732 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa546d49-927f-4373-882c-298aaef8fd51 service nova] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:00.655732 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa546d49-927f-4373-882c-298aaef8fd51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:00.664138 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa546d49-927f-4373-882c-298aaef8fd51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:00.665754 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa546d49-927f-4373-882c-298aaef8fd51 service nova] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:00.676131 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 767/1527] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:40:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:40:04.630299 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4103e3-425e-4169-a013-883c1947e059 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:04.630896 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4103e3-425e-4169-a013-883c1947e059 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:04.630896 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4103e3-425e-4169-a013-883c1947e059 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:04.632284 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 761/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 10:40:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:40:04.637396 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188483f2-9049-4023-8567-78253e36e099 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:04.637805 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188483f2-9049-4023-8567-78253e36e099 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:04.637959 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188483f2-9049-4023-8567-78253e36e099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:04.657583 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-188483f2-9049-4023-8567-78253e36e099 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:40:04.658805 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-188483f2-9049-4023-8567-78253e36e099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:04.666982 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 768/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 10:40:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:40:04.706535 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4103e3-425e-4169-a013-883c1947e059 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:04.708492 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-8f4103e3-425e-4169-a013-883c1947e059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:04.788885 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4103e3-425e-4169-a013-883c1947e059 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:04.792464 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7b11a5-5f8e-4c3b-83b5-4907fd5a33b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:04.793143 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b11a5-5f8e-4c3b-83b5-4907fd5a33b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:04.793424 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b11a5-5f8e-4c3b-83b5-4907fd5a33b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:04.793700 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7b11a5-5f8e-4c3b-83b5-4907fd5a33b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:04.802833 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7b11a5-5f8e-4c3b-83b5-4907fd5a33b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:04.804249 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7b11a5-5f8e-4c3b-83b5-4907fd5a33b2 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:04.814026 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 762/1530] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:40:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:40:06.837264 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50cd572-8b66-4545-8c03-7bb1b8b74fe8 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:06.837844 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50cd572-8b66-4545-8c03-7bb1b8b74fe8 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:06.837844 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50cd572-8b66-4545-8c03-7bb1b8b74fe8 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:06.839168 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 769/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 10:40:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:40:06.845016 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818acef-efaa-443e-8c87-584faf35052a None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:06.845463 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818acef-efaa-443e-8c87-584faf35052a None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:06.845598 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818acef-efaa-443e-8c87-584faf35052a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:06.863341 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-b818acef-efaa-443e-8c87-584faf35052a None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:40:06.864552 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-b818acef-efaa-443e-8c87-584faf35052a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:06.872659 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 763/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 10:40:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:40:06.909425 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50cd572-8b66-4545-8c03-7bb1b8b74fe8 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:06.919975 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50cd572-8b66-4545-8c03-7bb1b8b74fe8 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:06.924166 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05674e8f-6870-466d-9981-e342590a9648 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:06.924796 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05674e8f-6870-466d-9981-e342590a9648 service neutron] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:06.925103 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05674e8f-6870-466d-9981-e342590a9648 service neutron] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:06.925378 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05674e8f-6870-466d-9981-e342590a9648 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:06.934114 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05674e8f-6870-466d-9981-e342590a9648 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:06.935521 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05674e8f-6870-466d-9981-e342590a9648 service neutron] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:06.945926 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 770/1533] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:40:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:40:10.565626 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8fc48e-1ba1-4f1b-9761-7bb6d0d8c77c None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:10.566188 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8fc48e-1ba1-4f1b-9761-7bb6d0d8c77c None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:10.566188 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8fc48e-1ba1-4f1b-9761-7bb6d0d8c77c None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:10.567547 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 764/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 10:40:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:40:10.572802 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be555a94-998c-47e3-9d5e-ca437ceb4db6 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:10.573281 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be555a94-998c-47e3-9d5e-ca437ceb4db6 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:10.573405 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be555a94-998c-47e3-9d5e-ca437ceb4db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:10.580279 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:40:10.592028 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-be555a94-998c-47e3-9d5e-ca437ceb4db6 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:40:10.593918 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-be555a94-998c-47e3-9d5e-ca437ceb4db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:10.602085 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 771/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 10:40:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:40:10.908672 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8fc48e-1ba1-4f1b-9761-7bb6d0d8c77c None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:10.911086 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-ce8fc48e-1ba1-4f1b-9761-7bb6d0d8c77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:10.992458 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8fc48e-1ba1-4f1b-9761-7bb6d0d8c77c None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:10.996026 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0be251-806c-49fe-83d7-570cc4420725 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:10.996671 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0be251-806c-49fe-83d7-570cc4420725 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:10.996953 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0be251-806c-49fe-83d7-570cc4420725 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:10.997255 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0be251-806c-49fe-83d7-570cc4420725 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:11.006777 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0be251-806c-49fe-83d7-570cc4420725 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:11.008193 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0be251-806c-49fe-83d7-570cc4420725 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:11.018585 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 765/1536] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:40:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:40:13.064360 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1854e-c492-4bc3-ba12-8adc91c4b375 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:13.064927 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1854e-c492-4bc3-ba12-8adc91c4b375 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:13.064927 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1854e-c492-4bc3-ba12-8adc91c4b375 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:13.066323 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 772/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 10:40:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:40:13.071620 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa057cce-dbb6-42f4-8e1b-7213c43297dc None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:13.072092 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa057cce-dbb6-42f4-8e1b-7213c43297dc None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:13.072199 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa057cce-dbb6-42f4-8e1b-7213c43297dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:13.089962 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-aa057cce-dbb6-42f4-8e1b-7213c43297dc None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:40:13.091232 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-aa057cce-dbb6-42f4-8e1b-7213c43297dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:13.099461 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 766/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 10:40:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:40:13.408438 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf1854e-c492-4bc3-ba12-8adc91c4b375 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:40:13.410428 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-bbf1854e-c492-4bc3-ba12-8adc91c4b375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:40:13.424332 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf1854e-c492-4bc3-ba12-8adc91c4b375 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:40:13.427869 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e98591-7d7e-411c-847a-210568efedbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:40:13.433717 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e98591-7d7e-411c-847a-210568efedbf service cinder] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:40:13.433717 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e98591-7d7e-411c-847a-210568efedbf service cinder] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:40:13.433717 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e98591-7d7e-411c-847a-210568efedbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:40:13.438247 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e98591-7d7e-411c-847a-210568efedbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:40:13.439754 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e98591-7d7e-411c-847a-210568efedbf service cinder] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:40:13.449140 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 773/1539] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:40:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:40:23.085063 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=92 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:40:23.444968 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=8 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:46.334333 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db57c049-ebe9-48cb-a84e-87ab84eef10f None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:46.336780 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db57c049-ebe9-48cb-a84e-87ab84eef10f None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:46.336780 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db57c049-ebe9-48cb-a84e-87ab84eef10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:46.357833 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-db57c049-ebe9-48cb-a84e-87ab84eef10f None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:46.358995 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-db57c049-ebe9-48cb-a84e-87ab84eef10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:46.371657 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 767/1540] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:41:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:46.380540 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92ff07-396a-4c7a-ae3f-912740322eb3 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:46.381631 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92ff07-396a-4c7a-ae3f-912740322eb3 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:46.382124 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92ff07-396a-4c7a-ae3f-912740322eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:46.411506 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-7b92ff07-396a-4c7a-ae3f-912740322eb3 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:46.413155 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-7b92ff07-396a-4c7a-ae3f-912740322eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:46.430938 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 774/1541] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:41:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:46.436337 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db57c049-ebe9-48cb-a84e-87ab84eef10f None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:46.454003 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db57c049-ebe9-48cb-a84e-87ab84eef10f None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:46.461834 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee7cb6a-fb4f-477d-ad87-7c891ac92472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:46.462550 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee7cb6a-fb4f-477d-ad87-7c891ac92472 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:46.462840 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee7cb6a-fb4f-477d-ad87-7c891ac92472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:46.463118 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee7cb6a-fb4f-477d-ad87-7c891ac92472 admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:46.464100 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee7cb6a-fb4f-477d-ad87-7c891ac92472 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:41:46.464417 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee7cb6a-fb4f-477d-ad87-7c891ac92472 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:46.465526 dv-cinder-837546-3-smb devstack@keystone.service[80393]: WARNING py.warnings [None req-7ee7cb6a-fb4f-477d-ad87-7c891ac92472 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 10:41:46.465526 dv-cinder-837546-3-smb devstack@keystone.service[80393]: warnings.warn(msg) Jul 18 10:41:46.465526 dv-cinder-837546-3-smb devstack@keystone.service[80393]: Jul 18 10:41:46.466445 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee7cb6a-fb4f-477d-ad87-7c891ac92472 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:46.493124 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 768/1542] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 10:41:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:41:46.502240 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b92ff07-396a-4c7a-ae3f-912740322eb3 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:46.513729 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b92ff07-396a-4c7a-ae3f-912740322eb3 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:46.526498 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b036913d-9027-44f6-9a1e-b0ef24f45aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:46.527609 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036913d-9027-44f6-9a1e-b0ef24f45aae admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:46.528147 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036913d-9027-44f6-9a1e-b0ef24f45aae admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:46.528640 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b036913d-9027-44f6-9a1e-b0ef24f45aae admin admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:46.529586 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b036913d-9027-44f6-9a1e-b0ef24f45aae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:46.530843 dv-cinder-837546-3-smb devstack@keystone.service[80392]: WARNING py.warnings [None req-b036913d-9027-44f6-9a1e-b0ef24f45aae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 10:41:46.530843 dv-cinder-837546-3-smb devstack@keystone.service[80392]: warnings.warn(msg) Jul 18 10:41:46.530843 dv-cinder-837546-3-smb devstack@keystone.service[80392]: Jul 18 10:41:46.532434 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b036913d-9027-44f6-9a1e-b0ef24f45aae admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:46.637823 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5551dae4-512a-4edb-8569-d48fcf409fd3 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:46.638023 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5551dae4-512a-4edb-8569-d48fcf409fd3 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:46.638335 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5551dae4-512a-4edb-8569-d48fcf409fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:46.661978 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 775/1543] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:41:46 2022] POST /identity/v3/projects => generated 379 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:46.665431 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911dda0-41e8-4052-89de-44865a1edcc5 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:46.665431 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911dda0-41e8-4052-89de-44865a1edcc5 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:46.665431 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911dda0-41e8-4052-89de-44865a1edcc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:46.665716 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-5551dae4-512a-4edb-8569-d48fcf409fd3 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:46.667226 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-5551dae4-512a-4edb-8569-d48fcf409fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:46.695156 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-4911dda0-41e8-4052-89de-44865a1edcc5 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:46.696710 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-4911dda0-41e8-4052-89de-44865a1edcc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:46.759696 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 769/1544] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:41:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:41:46.760743 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5551dae4-512a-4edb-8569-d48fcf409fd3 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:46.778718 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5551dae4-512a-4edb-8569-d48fcf409fd3 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:46.782514 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 776/1545] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:41:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:46.787370 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e3da0-4a9f-40de-8de7-ea7f7d8c9dab None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:46.787656 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e3da0-4a9f-40de-8de7-ea7f7d8c9dab None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:46.788660 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f01106-9bbd-44f1-97a6-80eaba92e7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:46.789369 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f01106-9bbd-44f1-97a6-80eaba92e7b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:46.789645 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f01106-9bbd-44f1-97a6-80eaba92e7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:46.789915 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f01106-9bbd-44f1-97a6-80eaba92e7b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:46.790608 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f01106-9bbd-44f1-97a6-80eaba92e7b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:46.791612 dv-cinder-837546-3-smb devstack@keystone.service[80393]: WARNING py.warnings [None req-f7f01106-9bbd-44f1-97a6-80eaba92e7b8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 10:41:46.791612 dv-cinder-837546-3-smb devstack@keystone.service[80393]: warnings.warn(msg) Jul 18 10:41:46.791612 dv-cinder-837546-3-smb devstack@keystone.service[80393]: Jul 18 10:41:46.792832 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f01106-9bbd-44f1-97a6-80eaba92e7b8 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:46.794251 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0e3da0-4a9f-40de-8de7-ea7f7d8c9dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:46.822945 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-fe0e3da0-4a9f-40de-8de7-ea7f7d8c9dab None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:46.824419 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-fe0e3da0-4a9f-40de-8de7-ea7f7d8c9dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:46.833955 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 777/1546] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:41:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:46.837068 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092bb71a-887c-457c-8050-ad9d844ffeb7 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:46.837068 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092bb71a-887c-457c-8050-ad9d844ffeb7 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:46.837068 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092bb71a-887c-457c-8050-ad9d844ffeb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:46.855896 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-092bb71a-887c-457c-8050-ad9d844ffeb7 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:46.857147 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-092bb71a-887c-457c-8050-ad9d844ffeb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:46.866301 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 778/1547] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:41:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:46.868085 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc07aef-2456-4a4e-be2a-51d55cc53ca5 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:46.868085 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc07aef-2456-4a4e-be2a-51d55cc53ca5 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:46.868273 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc07aef-2456-4a4e-be2a-51d55cc53ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:46.886325 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-1fc07aef-2456-4a4e-be2a-51d55cc53ca5 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:46.887533 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-1fc07aef-2456-4a4e-be2a-51d55cc53ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:46.900163 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 770/1548] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:41:46 2022] POST /identity/v3/users => generated 290 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:46.900370 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 779/1549] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:41:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:46.900370 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc07aef-2456-4a4e-be2a-51d55cc53ca5 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:46.900550 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c5923e-8ec0-4dc4-86f5-7a04a3324453 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:46.900550 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c5923e-8ec0-4dc4-86f5-7a04a3324453 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:46.900550 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c5923e-8ec0-4dc4-86f5-7a04a3324453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:46.915711 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc07aef-2456-4a4e-be2a-51d55cc53ca5 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:46.920549 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-39c5923e-8ec0-4dc4-86f5-7a04a3324453 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:46.921863 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-39c5923e-8ec0-4dc4-86f5-7a04a3324453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:46.926664 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f39ebf-c21d-4687-a1ee-f116cfe3c988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:46.927511 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f39ebf-c21d-4687-a1ee-f116cfe3c988 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:46.927816 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f39ebf-c21d-4687-a1ee-f116cfe3c988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:46.928095 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f39ebf-c21d-4687-a1ee-f116cfe3c988 admin admin] PATH_INFO: `/v3/domains` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:46.928890 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f39ebf-c21d-4687-a1ee-f116cfe3c988 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:41:46.929239 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f39ebf-c21d-4687-a1ee-f116cfe3c988 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:46.930861 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f39ebf-c21d-4687-a1ee-f116cfe3c988 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:46.931695 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 771/1550] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:41:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:46.933991 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f91ea-6044-4b9f-ac72-469514768911 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:46.934310 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f91ea-6044-4b9f-ac72-469514768911 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:46.934602 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f91ea-6044-4b9f-ac72-469514768911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:46.946465 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 780/1551] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 10:41:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:41:46.947589 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135dc55f-f000-42d1-907b-93b9f34ec0fe None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:46.947881 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135dc55f-f000-42d1-907b-93b9f34ec0fe None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:46.948159 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135dc55f-f000-42d1-907b-93b9f34ec0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:46.954753 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-461f91ea-6044-4b9f-ac72-469514768911 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:46.956003 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-461f91ea-6044-4b9f-ac72-469514768911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:46.964035 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 772/1552] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:41:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:46.964819 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f91ea-6044-4b9f-ac72-469514768911 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:46.974997 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f91ea-6044-4b9f-ac72-469514768911 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:46.975832 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-135dc55f-f000-42d1-907b-93b9f34ec0fe None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:46.977164 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-135dc55f-f000-42d1-907b-93b9f34ec0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:46.979622 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d41390a-cec5-473f-8f3d-b497b6664969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:46.980273 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d41390a-cec5-473f-8f3d-b497b6664969 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:46.980550 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d41390a-cec5-473f-8f3d-b497b6664969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:46.980823 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d41390a-cec5-473f-8f3d-b497b6664969 admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:46.981584 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d41390a-cec5-473f-8f3d-b497b6664969 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:41:46.981889 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d41390a-cec5-473f-8f3d-b497b6664969 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:46.983469 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d41390a-cec5-473f-8f3d-b497b6664969 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:46.985458 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 781/1553] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:41:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:46.987452 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135dc55f-f000-42d1-907b-93b9f34ec0fe None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:46.998339 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135dc55f-f000-42d1-907b-93b9f34ec0fe None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:47.003523 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebe6c58-8fbe-4763-8399-66dce43a180c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:47.003931 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 773/1554] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 10:41:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:41:47.004192 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe6c58-8fbe-4763-8399-66dce43a180c admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:47.004526 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe6c58-8fbe-4763-8399-66dce43a180c admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:47.004798 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe6c58-8fbe-4763-8399-66dce43a180c admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:47.005359 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afdeca9-f784-43b6-a0ba-f8ea6ff5c360 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:47.005585 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebe6c58-8fbe-4763-8399-66dce43a180c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:47.005698 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afdeca9-f784-43b6-a0ba-f8ea6ff5c360 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:47.005922 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afdeca9-f784-43b6-a0ba-f8ea6ff5c360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:47.007301 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebe6c58-8fbe-4763-8399-66dce43a180c admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:47.021085 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 782/1555] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:47.021085 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11353b8c-33d9-4ee0-b82d-40bfb09b8028 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:47.021085 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11353b8c-33d9-4ee0-b82d-40bfb09b8028 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:47.021085 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11353b8c-33d9-4ee0-b82d-40bfb09b8028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:47.027706 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-5afdeca9-f784-43b6-a0ba-f8ea6ff5c360 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:47.028930 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-5afdeca9-f784-43b6-a0ba-f8ea6ff5c360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:47.037652 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 774/1556] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:41:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:47.038331 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-11353b8c-33d9-4ee0-b82d-40bfb09b8028 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:47.039036 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728602b-44b8-410c-9ff7-4d8f3ef757aa None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:47.039324 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728602b-44b8-410c-9ff7-4d8f3ef757aa None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:47.039518 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-11353b8c-33d9-4ee0-b82d-40bfb09b8028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:47.039618 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728602b-44b8-410c-9ff7-4d8f3ef757aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:47.047882 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 783/1557] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:41:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:47.049341 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11353b8c-33d9-4ee0-b82d-40bfb09b8028 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:47.059282 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-6728602b-44b8-410c-9ff7-4d8f3ef757aa None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:47.059686 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11353b8c-33d9-4ee0-b82d-40bfb09b8028 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:47.060496 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-6728602b-44b8-410c-9ff7-4d8f3ef757aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:47.064899 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef21447-1989-41ee-8c3f-16c6f20ea852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:47.065692 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef21447-1989-41ee-8c3f-16c6f20ea852 admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:47.065979 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef21447-1989-41ee-8c3f-16c6f20ea852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:47.066430 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef21447-1989-41ee-8c3f-16c6f20ea852 admin admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:47.067132 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef21447-1989-41ee-8c3f-16c6f20ea852 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:47.069010 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 775/1558] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:41:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:47.069159 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef21447-1989-41ee-8c3f-16c6f20ea852 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:47.070379 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583eacc-ddf5-4dfe-9a5e-cb0040fdf0ee None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:47.070703 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583eacc-ddf5-4dfe-9a5e-cb0040fdf0ee None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:47.070943 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583eacc-ddf5-4dfe-9a5e-cb0040fdf0ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:47.089179 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-2583eacc-ddf5-4dfe-9a5e-cb0040fdf0ee None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:47.090386 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-2583eacc-ddf5-4dfe-9a5e-cb0040fdf0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:47.099690 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 776/1559] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:41:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:47.101142 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1358f3-1a3b-4c57-b13a-608f7ff74c0f None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:47.101577 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1358f3-1a3b-4c57-b13a-608f7ff74c0f None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:47.101921 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1358f3-1a3b-4c57-b13a-608f7ff74c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:47.121901 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-ae1358f3-1a3b-4c57-b13a-608f7ff74c0f None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:47.123115 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-ae1358f3-1a3b-4c57-b13a-608f7ff74c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:47.137609 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 777/1560] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:41:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:47.137609 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1358f3-1a3b-4c57-b13a-608f7ff74c0f None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:47.141587 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1358f3-1a3b-4c57-b13a-608f7ff74c0f None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:47.146412 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b91a9e-5250-41ff-a1ae-e0a3f0902ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:47.147052 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b91a9e-5250-41ff-a1ae-e0a3f0902ef0 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:47.147330 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b91a9e-5250-41ff-a1ae-e0a3f0902ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:47.147602 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b91a9e-5250-41ff-a1ae-e0a3f0902ef0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:47.148283 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b91a9e-5250-41ff-a1ae-e0a3f0902ef0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:47.150303 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b91a9e-5250-41ff-a1ae-e0a3f0902ef0 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:47.171284 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 784/1561] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:41:47 2022] POST /identity/v3/projects => generated 365 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:47.172269 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef21447-1989-41ee-8c3f-16c6f20ea852 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:47.219293 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:47.235501 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef21447-1989-41ee-8c3f-16c6f20ea852 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:47.240357 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c968905b-f661-4dd7-aa29-7ff86d20d2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:47.241258 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968905b-f661-4dd7-aa29-7ff86d20d2d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:47.241547 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968905b-f661-4dd7-aa29-7ff86d20d2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:47.241829 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968905b-f661-4dd7-aa29-7ff86d20d2d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:47.242628 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c968905b-f661-4dd7-aa29-7ff86d20d2d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:47.244150 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c968905b-f661-4dd7-aa29-7ff86d20d2d5 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:47.249835 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 778/1562] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:41:47 2022] POST /identity/v3/projects => generated 393 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:47.250736 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b91a9e-5250-41ff-a1ae-e0a3f0902ef0 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:47.257123 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 785/1563] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:47.261760 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92eca32-8322-41f1-ba73-b5ae3bf3c90b None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:47.262057 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92eca32-8322-41f1-ba73-b5ae3bf3c90b None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:47.262339 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92eca32-8322-41f1-ba73-b5ae3bf3c90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:47.281989 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-b92eca32-8322-41f1-ba73-b5ae3bf3c90b None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:47.284553 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-b92eca32-8322-41f1-ba73-b5ae3bf3c90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:47.305420 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:47.319557 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b91a9e-5250-41ff-a1ae-e0a3f0902ef0 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:47.324723 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8280eb10-d7e3-4f8e-bbc4-5c41a29184fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:47.325424 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280eb10-d7e3-4f8e-bbc4-5c41a29184fa admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:47.328211 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280eb10-d7e3-4f8e-bbc4-5c41a29184fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:47.328211 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8280eb10-d7e3-4f8e-bbc4-5c41a29184fa admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:47.328211 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8280eb10-d7e3-4f8e-bbc4-5c41a29184fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:41:47.328211 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8280eb10-d7e3-4f8e-bbc4-5c41a29184fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:47.328660 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8280eb10-d7e3-4f8e-bbc4-5c41a29184fa admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:47.341609 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 779/1564] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 10:41:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:41:47.342437 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8280eb10-d7e3-4f8e-bbc4-5c41a29184fa admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:47.353112 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8280eb10-d7e3-4f8e-bbc4-5c41a29184fa admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:47.354359 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 786/1565] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:41:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:47.355322 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92eca32-8322-41f1-ba73-b5ae3bf3c90b None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:47.360829 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a67e835-3ab9-4367-8c0e-4deccadd9974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:47.361758 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67e835-3ab9-4367-8c0e-4deccadd9974 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:47.362037 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67e835-3ab9-4367-8c0e-4deccadd9974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:47.362311 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a67e835-3ab9-4367-8c0e-4deccadd9974 admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:47.363037 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a67e835-3ab9-4367-8c0e-4deccadd9974 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:41:47.363345 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a67e835-3ab9-4367-8c0e-4deccadd9974 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:47.364930 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a67e835-3ab9-4367-8c0e-4deccadd9974 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:47.365527 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92eca32-8322-41f1-ba73-b5ae3bf3c90b None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:47.370517 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4975bbef-4f17-4e6e-afaa-20d1231d9624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:47.371179 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975bbef-4f17-4e6e-afaa-20d1231d9624 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:47.371470 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975bbef-4f17-4e6e-afaa-20d1231d9624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:47.371743 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975bbef-4f17-4e6e-afaa-20d1231d9624 admin admin] PATH_INFO: `/v3/domains` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:47.372473 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4975bbef-4f17-4e6e-afaa-20d1231d9624 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:41:47.372773 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4975bbef-4f17-4e6e-afaa-20d1231d9624 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:47.374470 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4975bbef-4f17-4e6e-afaa-20d1231d9624 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:47.377275 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 780/1566] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 10:41:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:41:47.377928 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a67e835-3ab9-4367-8c0e-4deccadd9974 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:47.388343 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a67e835-3ab9-4367-8c0e-4deccadd9974 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:47.394172 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae06b61-e422-4582-8ca1-62a1eb1a4c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:47.394833 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae06b61-e422-4582-8ca1-62a1eb1a4c20 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:47.395112 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae06b61-e422-4582-8ca1-62a1eb1a4c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:47.395480 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae06b61-e422-4582-8ca1-62a1eb1a4c20 admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:47.395781 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 787/1567] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 10:41:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:41:47.396271 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae06b61-e422-4582-8ca1-62a1eb1a4c20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:41:47.396537 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae06b61-e422-4582-8ca1-62a1eb1a4c20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:47.396650 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4975bbef-4f17-4e6e-afaa-20d1231d9624 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:47.398818 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae06b61-e422-4582-8ca1-62a1eb1a4c20 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:47.411704 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4975bbef-4f17-4e6e-afaa-20d1231d9624 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:47.416310 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 781/1568] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 10:41:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:41:47.416310 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae06b61-e422-4582-8ca1-62a1eb1a4c20 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:47.418267 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf3e50-3175-44f5-9e3c-eb580daadaed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:47.418947 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf3e50-3175-44f5-9e3c-eb580daadaed admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:47.419227 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf3e50-3175-44f5-9e3c-eb580daadaed admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:47.419501 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf3e50-3175-44f5-9e3c-eb580daadaed admin admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:47.420411 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabf3e50-3175-44f5-9e3c-eb580daadaed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:47.422353 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabf3e50-3175-44f5-9e3c-eb580daadaed admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:47.425599 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae06b61-e422-4582-8ca1-62a1eb1a4c20 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:47.430861 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06e0364-9736-4997-892a-2b52286df54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:47.435135 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06e0364-9736-4997-892a-2b52286df54e admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:47.435135 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06e0364-9736-4997-892a-2b52286df54e admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:47.435135 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06e0364-9736-4997-892a-2b52286df54e admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:47.435135 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06e0364-9736-4997-892a-2b52286df54e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:47.436498 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06e0364-9736-4997-892a-2b52286df54e admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:47.545830 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 788/1569] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:41:47 2022] POST /identity/v3/users => generated 283 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:47.546663 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf3e50-3175-44f5-9e3c-eb580daadaed admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:47.557381 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf3e50-3175-44f5-9e3c-eb580daadaed admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:47.562146 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ece21-fae6-47db-af26-389ce878ebe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:47.563010 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ece21-fae6-47db-af26-389ce878ebe1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:47.563290 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ece21-fae6-47db-af26-389ce878ebe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:47.563564 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ece21-fae6-47db-af26-389ce878ebe1 admin admin] PATH_INFO: `/v3/projects/3a2cf0e205094e49be2285b4e29c979f/users/9c9e231d65334b6994e511c08cb74fe2/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:47.578541 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642ece21-fae6-47db-af26-389ce878ebe1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a2cf0e205094e49be2285b4e29c979f, user_id=9c9e231d65334b6994e511c08cb74fe2, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:47.580192 dv-cinder-837546-3-smb devstack@keystone.service[80392]: WARNING py.warnings [None req-642ece21-fae6-47db-af26-389ce878ebe1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 10:41:47.580192 dv-cinder-837546-3-smb devstack@keystone.service[80392]: warnings.warn(msg) Jul 18 10:41:47.580192 dv-cinder-837546-3-smb devstack@keystone.service[80392]: Jul 18 10:41:47.582157 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642ece21-fae6-47db-af26-389ce878ebe1 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:47.597458 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 782/1570] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:41:47 2022] POST /identity/v3/users => generated 297 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:47.598168 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06e0364-9736-4997-892a-2b52286df54e admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:47.608640 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06e0364-9736-4997-892a-2b52286df54e admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:47.613621 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e693e91-e429-4b5d-85a9-e1e51d4c22f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:47.614270 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e693e91-e429-4b5d-85a9-e1e51d4c22f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:47.614555 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e693e91-e429-4b5d-85a9-e1e51d4c22f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:47.614833 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e693e91-e429-4b5d-85a9-e1e51d4c22f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:47.615517 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e693e91-e429-4b5d-85a9-e1e51d4c22f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:47.617634 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e693e91-e429-4b5d-85a9-e1e51d4c22f5 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:47.667833 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 789/1571] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:41:47 2022] PUT /identity/v3/projects/3a2cf0e205094e49be2285b4e29c979f/users/9c9e231d65334b6994e511c08cb74fe2/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:47.668983 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ece21-fae6-47db-af26-389ce878ebe1 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:47.696389 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 783/1572] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:41:47 2022] POST /identity/v3/projects => generated 375 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:47.696389 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e693e91-e429-4b5d-85a9-e1e51d4c22f5 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:47.768206 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e693e91-e429-4b5d-85a9-e1e51d4c22f5 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:47.769520 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ece21-fae6-47db-af26-389ce878ebe1 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:47.772936 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f8d9c-5edb-41f8-aafa-c93d39553243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:47.773591 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f8d9c-5edb-41f8-aafa-c93d39553243 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:47.773877 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f8d9c-5edb-41f8-aafa-c93d39553243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:47.774147 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f8d9c-5edb-41f8-aafa-c93d39553243 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:47.774555 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6086b116-a2e6-456f-9900-708faefe10cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:47.774828 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4f8d9c-5edb-41f8-aafa-c93d39553243 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:47.775224 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086b116-a2e6-456f-9900-708faefe10cd admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:47.775510 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086b116-a2e6-456f-9900-708faefe10cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:47.775783 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086b116-a2e6-456f-9900-708faefe10cd admin admin] PATH_INFO: `/v3/domains` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:47.776507 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6086b116-a2e6-456f-9900-708faefe10cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:41:47.776714 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4f8d9c-5edb-41f8-aafa-c93d39553243 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:47.776848 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6086b116-a2e6-456f-9900-708faefe10cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:47.778505 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6086b116-a2e6-456f-9900-708faefe10cd admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:47.791121 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 790/1573] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 10:41:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:41:47.792040 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6086b116-a2e6-456f-9900-708faefe10cd admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:47.802838 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6086b116-a2e6-456f-9900-708faefe10cd admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:47.807975 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28bf69-d89d-42e1-8ba9-243dbcc4a20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:47.808633 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28bf69-d89d-42e1-8ba9-243dbcc4a20b admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:47.808914 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28bf69-d89d-42e1-8ba9-243dbcc4a20b admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:47.809225 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28bf69-d89d-42e1-8ba9-243dbcc4a20b admin admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:47.813159 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a28bf69-d89d-42e1-8ba9-243dbcc4a20b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:47.813159 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a28bf69-d89d-42e1-8ba9-243dbcc4a20b admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:47.903142 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 784/1574] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:41:47 2022] POST /identity/v3/projects => generated 375 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:47.903957 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f8d9c-5edb-41f8-aafa-c93d39553243 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:47.908023 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:47.916096 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 791/1575] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:41:47 2022] POST /identity/v3/projects => generated 401 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:47.920270 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28bf69-d89d-42e1-8ba9-243dbcc4a20b admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:47.970118 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f8d9c-5edb-41f8-aafa-c93d39553243 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:47.975608 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:47.988248 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28bf69-d89d-42e1-8ba9-243dbcc4a20b admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:47.993883 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84550389-5057-40c5-9609-c4c5f8089310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:47.994552 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84550389-5057-40c5-9609-c4c5f8089310 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:47.994837 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84550389-5057-40c5-9609-c4c5f8089310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:47.995114 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84550389-5057-40c5-9609-c4c5f8089310 admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:47.995840 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84550389-5057-40c5-9609-c4c5f8089310 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:47.997493 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84550389-5057-40c5-9609-c4c5f8089310 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:48.008379 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 792/1576] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:48.009235 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84550389-5057-40c5-9609-c4c5f8089310 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:48.018800 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84550389-5057-40c5-9609-c4c5f8089310 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:48.023488 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439334a4-ebb3-4504-8186-79ce7cd40ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:48.024226 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439334a4-ebb3-4504-8186-79ce7cd40ee8 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:48.024432 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439334a4-ebb3-4504-8186-79ce7cd40ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:48.024712 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439334a4-ebb3-4504-8186-79ce7cd40ee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:48.025470 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439334a4-ebb3-4504-8186-79ce7cd40ee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:48.027075 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439334a4-ebb3-4504-8186-79ce7cd40ee8 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:48.028827 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c55c9-129f-4895-af7b-7d9f96a5e198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:48.029526 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c55c9-129f-4895-af7b-7d9f96a5e198 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:48.029835 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c55c9-129f-4895-af7b-7d9f96a5e198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:48.030119 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c55c9-129f-4895-af7b-7d9f96a5e198 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:48.030813 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8c55c9-129f-4895-af7b-7d9f96a5e198 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:48.033175 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8c55c9-129f-4895-af7b-7d9f96a5e198 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:48.038707 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 793/1577] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:48.038707 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03bfdf-98e7-4271-af4b-90eae16d4642 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:48.039852 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03bfdf-98e7-4271-af4b-90eae16d4642 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:48.039852 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03bfdf-98e7-4271-af4b-90eae16d4642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:48.066638 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-5f03bfdf-98e7-4271-af4b-90eae16d4642 None None] MFA Rules not processed for user `9c9e231d65334b6994e511c08cb74fe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:48.067866 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-5f03bfdf-98e7-4271-af4b-90eae16d4642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:48.134403 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 794/1578] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:41:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:48.135375 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f03bfdf-98e7-4271-af4b-90eae16d4642 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:48.145478 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f03bfdf-98e7-4271-af4b-90eae16d4642 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:48.150040 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d5617-251e-4624-9896-24d2fa6e9a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:48.150699 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d5617-251e-4624-9896-24d2fa6e9a93 admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:48.152944 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d5617-251e-4624-9896-24d2fa6e9a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:48.152944 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d5617-251e-4624-9896-24d2fa6e9a93 admin admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:48.152944 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979d5617-251e-4624-9896-24d2fa6e9a93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:48.153841 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979d5617-251e-4624-9896-24d2fa6e9a93 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:48.154302 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 785/1579] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:41:47 2022] POST /identity/v3/projects => generated 367 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:48.155122 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c55c9-129f-4895-af7b-7d9f96a5e198 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:48.217301 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c55c9-129f-4895-af7b-7d9f96a5e198 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:48.222358 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce02092a-0667-41d9-832a-450cdd4d508b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:48.223011 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02092a-0667-41d9-832a-450cdd4d508b admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:48.223299 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02092a-0667-41d9-832a-450cdd4d508b admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:48.223569 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02092a-0667-41d9-832a-450cdd4d508b admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:48.224251 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce02092a-0667-41d9-832a-450cdd4d508b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:48.226173 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce02092a-0667-41d9-832a-450cdd4d508b admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:48.257882 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 795/1580] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:41:48 2022] POST /identity/v3/users => generated 288 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:48.258842 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d5617-251e-4624-9896-24d2fa6e9a93 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:48.269355 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d5617-251e-4624-9896-24d2fa6e9a93 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:48.275507 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3f68aa-a30e-4a07-99bb-6a2c0a5c2ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:48.276193 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f68aa-a30e-4a07-99bb-6a2c0a5c2ab5 admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:48.276584 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f68aa-a30e-4a07-99bb-6a2c0a5c2ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:48.276884 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f68aa-a30e-4a07-99bb-6a2c0a5c2ab5 admin admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:48.277624 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3f68aa-a30e-4a07-99bb-6a2c0a5c2ab5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:48.279563 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3f68aa-a30e-4a07-99bb-6a2c0a5c2ab5 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:48.319972 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 786/1581] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:41:48 2022] POST /identity/v3/projects => generated 389 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:48.320812 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce02092a-0667-41d9-832a-450cdd4d508b admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:48.371767 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 796/1582] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:41:48 2022] POST /identity/v3/users => generated 288 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:48.372877 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3f68aa-a30e-4a07-99bb-6a2c0a5c2ab5 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:48.384346 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3f68aa-a30e-4a07-99bb-6a2c0a5c2ab5 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:48.386203 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce02092a-0667-41d9-832a-450cdd4d508b admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:48.389057 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b1c16-807c-42cd-8b53-a42954e54206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:48.389728 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b1c16-807c-42cd-8b53-a42954e54206 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:48.398587 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b1c16-807c-42cd-8b53-a42954e54206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:48.398587 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b1c16-807c-42cd-8b53-a42954e54206 admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:48.399339 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ca6a5-3027-49fb-9f84-6dee2943cc95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:48.399470 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b1c16-807c-42cd-8b53-a42954e54206 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:48.399565 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ca6a5-3027-49fb-9f84-6dee2943cc95 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:48.399565 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ca6a5-3027-49fb-9f84-6dee2943cc95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:48.399565 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ca6a5-3027-49fb-9f84-6dee2943cc95 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:48.399565 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1ca6a5-3027-49fb-9f84-6dee2943cc95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:48.399901 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719b1c16-807c-42cd-8b53-a42954e54206 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:48.399997 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1ca6a5-3027-49fb-9f84-6dee2943cc95 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:48.404698 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 797/1583] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:48.405536 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b1c16-807c-42cd-8b53-a42954e54206 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:48.416495 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b1c16-807c-42cd-8b53-a42954e54206 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:48.421298 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81293c82-f124-41c0-988d-b48ba5e4149a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:48.422096 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81293c82-f124-41c0-988d-b48ba5e4149a admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:48.422398 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81293c82-f124-41c0-988d-b48ba5e4149a admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:48.422673 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81293c82-f124-41c0-988d-b48ba5e4149a admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:48.424036 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81293c82-f124-41c0-988d-b48ba5e4149a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:48.425734 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81293c82-f124-41c0-988d-b48ba5e4149a admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:48.438201 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 798/1584] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:48.438201 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81293c82-f124-41c0-988d-b48ba5e4149a admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:48.446327 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81293c82-f124-41c0-988d-b48ba5e4149a admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:48.450819 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb17075-c5dc-4b57-babe-e40fcca40f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:48.451439 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb17075-c5dc-4b57-babe-e40fcca40f09 admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:48.451717 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb17075-c5dc-4b57-babe-e40fcca40f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:48.452003 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb17075-c5dc-4b57-babe-e40fcca40f09 admin admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:48.452657 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb17075-c5dc-4b57-babe-e40fcca40f09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:48.454584 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb17075-c5dc-4b57-babe-e40fcca40f09 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:48.472567 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:48.500061 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 787/1585] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:41:48 2022] POST /identity/v3/users => generated 301 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:48.501139 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ca6a5-3027-49fb-9f84-6dee2943cc95 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:48.511601 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ca6a5-3027-49fb-9f84-6dee2943cc95 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:48.516235 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ca9db-5111-4f35-a607-d0b673628a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:48.516882 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ca9db-5111-4f35-a607-d0b673628a02 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:48.517805 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ca9db-5111-4f35-a607-d0b673628a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:48.518099 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ca9db-5111-4f35-a607-d0b673628a02 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:48.518810 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3ca9db-5111-4f35-a607-d0b673628a02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:48.520742 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3ca9db-5111-4f35-a607-d0b673628a02 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:48.528530 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:48.588801 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 799/1586] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:41:48 2022] POST /identity/v3/projects => generated 377 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:48.589718 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb17075-c5dc-4b57-babe-e40fcca40f09 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:48.621141 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 788/1587] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:41:48 2022] POST /identity/v3/users => generated 284 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:48.621989 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ca9db-5111-4f35-a607-d0b673628a02 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:48.632480 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ca9db-5111-4f35-a607-d0b673628a02 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:48.667337 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb17075-c5dc-4b57-babe-e40fcca40f09 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:48.675047 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f21146f-937e-4a81-b940-7616f51d40fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:48.676090 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21146f-937e-4a81-b940-7616f51d40fa admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:48.676449 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21146f-937e-4a81-b940-7616f51d40fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:48.676854 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21146f-937e-4a81-b940-7616f51d40fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:48.677741 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f21146f-937e-4a81-b940-7616f51d40fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:48.679472 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f21146f-937e-4a81-b940-7616f51d40fa admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:48.693617 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 800/1588] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:48.693617 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f21146f-937e-4a81-b940-7616f51d40fa admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:48.701404 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f21146f-937e-4a81-b940-7616f51d40fa admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:48.703802 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5078bf-ec9e-4d87-98b4-935479a20b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:48.705089 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5078bf-ec9e-4d87-98b4-935479a20b83 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:48.705679 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5078bf-ec9e-4d87-98b4-935479a20b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:48.705679 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5078bf-ec9e-4d87-98b4-935479a20b83 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:48.706366 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5078bf-ec9e-4d87-98b4-935479a20b83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:48.706674 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a38031-cb05-4b35-961e-7c1cdf8d7603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:48.707327 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a38031-cb05-4b35-961e-7c1cdf8d7603 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:48.707612 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a38031-cb05-4b35-961e-7c1cdf8d7603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:48.707890 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a38031-cb05-4b35-961e-7c1cdf8d7603 admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:48.708350 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5078bf-ec9e-4d87-98b4-935479a20b83 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:48.708618 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a38031-cb05-4b35-961e-7c1cdf8d7603 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:48.710270 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a38031-cb05-4b35-961e-7c1cdf8d7603 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:48.721702 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 801/1589] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:48.722505 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a38031-cb05-4b35-961e-7c1cdf8d7603 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:48.732562 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a38031-cb05-4b35-961e-7c1cdf8d7603 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:48.737558 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db1d19-bf91-4f07-955f-5e512e46b661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:48.738429 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db1d19-bf91-4f07-955f-5e512e46b661 admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:48.738716 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db1d19-bf91-4f07-955f-5e512e46b661 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:48.738994 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db1d19-bf91-4f07-955f-5e512e46b661 admin admin] PATH_INFO: `/v3/projects/b4558334c4144c7c858576712326d541/users/3bd0fc0e7c4a459291c872e6289f7afc/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:48.754188 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db1d19-bf91-4f07-955f-5e512e46b661 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4558334c4144c7c858576712326d541, user_id=3bd0fc0e7c4a459291c872e6289f7afc, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:48.756905 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db1d19-bf91-4f07-955f-5e512e46b661 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:48.820024 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 789/1590] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:41:48 2022] POST /identity/v3/users => generated 295 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:48.821062 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5078bf-ec9e-4d87-98b4-935479a20b83 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:48.831800 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5078bf-ec9e-4d87-98b4-935479a20b83 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:48.836586 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d04a3a-2cca-483d-91d0-f1a1b4a10cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:48.837507 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d04a3a-2cca-483d-91d0-f1a1b4a10cda admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:48.837792 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d04a3a-2cca-483d-91d0-f1a1b4a10cda admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:48.838068 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d04a3a-2cca-483d-91d0-f1a1b4a10cda admin admin] PATH_INFO: `/v3/projects/ad00644a97a94ecf9de9a14d8a8ad721/users/de532a6dce8247e79bd8285220297a50/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:48.851101 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 802/1591] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:41:48 2022] PUT /identity/v3/projects/b4558334c4144c7c858576712326d541/users/3bd0fc0e7c4a459291c872e6289f7afc/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:48.852023 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db1d19-bf91-4f07-955f-5e512e46b661 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:48.855767 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d04a3a-2cca-483d-91d0-f1a1b4a10cda admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad00644a97a94ecf9de9a14d8a8ad721, user_id=de532a6dce8247e79bd8285220297a50, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:48.865934 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d04a3a-2cca-483d-91d0-f1a1b4a10cda admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:48.913817 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db1d19-bf91-4f07-955f-5e512e46b661 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:48.918459 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03b06e6-4796-4e22-8246-32bf2d960727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:48.919120 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b06e6-4796-4e22-8246-32bf2d960727 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:48.919410 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b06e6-4796-4e22-8246-32bf2d960727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:48.919683 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b06e6-4796-4e22-8246-32bf2d960727 admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:48.920403 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03b06e6-4796-4e22-8246-32bf2d960727 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:48.922036 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03b06e6-4796-4e22-8246-32bf2d960727 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:48.932859 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 803/1592] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:48.933777 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03b06e6-4796-4e22-8246-32bf2d960727 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:48.940041 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 790/1593] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:41:48 2022] PUT /identity/v3/projects/ad00644a97a94ecf9de9a14d8a8ad721/users/de532a6dce8247e79bd8285220297a50/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:48.940041 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d04a3a-2cca-483d-91d0-f1a1b4a10cda admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:48.944615 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03b06e6-4796-4e22-8246-32bf2d960727 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:48.992337 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:49.001466 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf544a0-8b60-4bba-b2f5-84753953fe89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:49.002291 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf544a0-8b60-4bba-b2f5-84753953fe89 admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:49.002615 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf544a0-8b60-4bba-b2f5-84753953fe89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:49.002888 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf544a0-8b60-4bba-b2f5-84753953fe89 admin admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:49.003690 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf544a0-8b60-4bba-b2f5-84753953fe89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:49.005555 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf544a0-8b60-4bba-b2f5-84753953fe89 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:49.006454 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d04a3a-2cca-483d-91d0-f1a1b4a10cda admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:49.011208 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116eaf89-35f9-46fd-ba08-72c0097fabe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:49.016381 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116eaf89-35f9-46fd-ba08-72c0097fabe0 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:49.016381 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116eaf89-35f9-46fd-ba08-72c0097fabe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:49.016381 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116eaf89-35f9-46fd-ba08-72c0097fabe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:49.016381 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116eaf89-35f9-46fd-ba08-72c0097fabe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:49.016381 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116eaf89-35f9-46fd-ba08-72c0097fabe0 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:49.025877 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 791/1594] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:49.026639 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116eaf89-35f9-46fd-ba08-72c0097fabe0 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:49.037174 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116eaf89-35f9-46fd-ba08-72c0097fabe0 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:49.041785 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5ebee3-9613-4118-91a6-5a467ee1bd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:49.042565 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ebee3-9613-4118-91a6-5a467ee1bd30 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:49.042824 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ebee3-9613-4118-91a6-5a467ee1bd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:49.043104 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ebee3-9613-4118-91a6-5a467ee1bd30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:49.043860 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5ebee3-9613-4118-91a6-5a467ee1bd30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:49.045490 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5ebee3-9613-4118-91a6-5a467ee1bd30 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:49.055639 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 792/1595] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:49.056465 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5ebee3-9613-4118-91a6-5a467ee1bd30 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:49.067437 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5ebee3-9613-4118-91a6-5a467ee1bd30 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:49.072164 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f96d9-98fc-45b9-b01c-e2761a47f85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:49.072824 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f96d9-98fc-45b9-b01c-e2761a47f85d admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:49.073149 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f96d9-98fc-45b9-b01c-e2761a47f85d admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:49.073447 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f96d9-98fc-45b9-b01c-e2761a47f85d admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:49.074156 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057f96d9-98fc-45b9-b01c-e2761a47f85d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:49.075727 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057f96d9-98fc-45b9-b01c-e2761a47f85d admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:49.089768 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 793/1596] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:49.089768 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f96d9-98fc-45b9-b01c-e2761a47f85d admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:49.099382 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f96d9-98fc-45b9-b01c-e2761a47f85d admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:49.104327 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ac9cb-5a03-42a6-9d79-c3ec164b8624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:49.104993 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ac9cb-5a03-42a6-9d79-c3ec164b8624 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:49.105348 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ac9cb-5a03-42a6-9d79-c3ec164b8624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:49.105627 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ac9cb-5a03-42a6-9d79-c3ec164b8624 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:49.106357 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8ac9cb-5a03-42a6-9d79-c3ec164b8624 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:49.107951 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8ac9cb-5a03-42a6-9d79-c3ec164b8624 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:49.121812 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 804/1597] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:41:48 2022] POST /identity/v3/users => generated 295 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:49.121999 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 794/1598] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:49.121999 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ac9cb-5a03-42a6-9d79-c3ec164b8624 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:49.122206 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0649097-8997-47c5-b4d7-e5b928d07427 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:49.122206 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0649097-8997-47c5-b4d7-e5b928d07427 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:49.122206 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0649097-8997-47c5-b4d7-e5b928d07427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:49.130316 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ac9cb-5a03-42a6-9d79-c3ec164b8624 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:49.135680 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ef9b28-6ec0-4c20-895e-fd7040875285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:49.136428 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef9b28-6ec0-4c20-895e-fd7040875285 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:49.136599 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef9b28-6ec0-4c20-895e-fd7040875285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:49.136858 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef9b28-6ec0-4c20-895e-fd7040875285 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:49.137615 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ef9b28-6ec0-4c20-895e-fd7040875285 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:49.139694 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ef9b28-6ec0-4c20-895e-fd7040875285 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:49.150335 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 795/1599] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:49.151701 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13743472-8f59-4e4a-8dc5-db32edfce985 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:49.157130 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13743472-8f59-4e4a-8dc5-db32edfce985 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:49.157130 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13743472-8f59-4e4a-8dc5-db32edfce985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:49.157354 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-a0649097-8997-47c5-b4d7-e5b928d07427 None None] MFA Rules not processed for user `3bd0fc0e7c4a459291c872e6289f7afc`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:49.157354 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-a0649097-8997-47c5-b4d7-e5b928d07427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:49.170105 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-13743472-8f59-4e4a-8dc5-db32edfce985 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:49.171309 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-13743472-8f59-4e4a-8dc5-db32edfce985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:49.187931 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 796/1600] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:41:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:49.187931 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13743472-8f59-4e4a-8dc5-db32edfce985 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:49.193560 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:49.199327 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13743472-8f59-4e4a-8dc5-db32edfce985 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:49.206666 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb529b-7180-4ef2-8fe6-2131dac724dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:49.206666 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb529b-7180-4ef2-8fe6-2131dac724dd admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:49.206666 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb529b-7180-4ef2-8fe6-2131dac724dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:49.206968 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb529b-7180-4ef2-8fe6-2131dac724dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:49.207662 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbb529b-7180-4ef2-8fe6-2131dac724dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:49.209284 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbb529b-7180-4ef2-8fe6-2131dac724dd admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:49.221214 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 797/1601] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:49.221214 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb529b-7180-4ef2-8fe6-2131dac724dd admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:49.227992 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 805/1602] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:41:49 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:49.228865 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0649097-8997-47c5-b4d7-e5b928d07427 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:49.236416 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb529b-7180-4ef2-8fe6-2131dac724dd admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:49.241227 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ba157-f5e2-45a7-8e63-1640f701e985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:49.241384 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0649097-8997-47c5-b4d7-e5b928d07427 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:49.242126 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ba157-f5e2-45a7-8e63-1640f701e985 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:49.246668 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ba157-f5e2-45a7-8e63-1640f701e985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:49.246668 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ba157-f5e2-45a7-8e63-1640f701e985 admin admin] PATH_INFO: `/v3/projects/4e847ee4adc14bdf90f671c448f5895c/users/f94ab499b0c8447c9e9e4165b342757b/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:49.246916 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d318325c-a63c-4867-994d-5ada050dc69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:49.246916 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318325c-a63c-4867-994d-5ada050dc69f admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:49.246916 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318325c-a63c-4867-994d-5ada050dc69f admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:49.247239 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318325c-a63c-4867-994d-5ada050dc69f admin admin] PATH_INFO: `/v3/projects/816e1fd7377f4931951eccc5fc378571/users/8f6a43da18834f22b4422623ce0799ac/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:49.258034 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667ba157-f5e2-45a7-8e63-1640f701e985 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e847ee4adc14bdf90f671c448f5895c, user_id=f94ab499b0c8447c9e9e4165b342757b, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:49.260705 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667ba157-f5e2-45a7-8e63-1640f701e985 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:49.262202 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d318325c-a63c-4867-994d-5ada050dc69f admin admin] RBAC: Authorizing `identity:create_grant(project_id=816e1fd7377f4931951eccc5fc378571, user_id=8f6a43da18834f22b4422623ce0799ac, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:49.264839 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d318325c-a63c-4867-994d-5ada050dc69f admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:49.358992 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 798/1603] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:41:49 2022] PUT /identity/v3/projects/4e847ee4adc14bdf90f671c448f5895c/users/f94ab499b0c8447c9e9e4165b342757b/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:49.360719 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ba157-f5e2-45a7-8e63-1640f701e985 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:49.374247 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 806/1604] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:41:49 2022] PUT /identity/v3/projects/816e1fd7377f4931951eccc5fc378571/users/8f6a43da18834f22b4422623ce0799ac/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:49.375154 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d318325c-a63c-4867-994d-5ada050dc69f admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:49.433477 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ba157-f5e2-45a7-8e63-1640f701e985 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:49.444299 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d318325c-a63c-4867-994d-5ada050dc69f admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:49.450172 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ddc82-b2bc-40a8-9ab1-4e59a426bea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:49.451717 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ddc82-b2bc-40a8-9ab1-4e59a426bea7 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:49.452009 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ddc82-b2bc-40a8-9ab1-4e59a426bea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:49.452716 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ddc82-b2bc-40a8-9ab1-4e59a426bea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:49.453639 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927ddc82-b2bc-40a8-9ab1-4e59a426bea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:49.456882 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927ddc82-b2bc-40a8-9ab1-4e59a426bea7 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:49.477913 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 807/1605] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:49.477913 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ddc82-b2bc-40a8-9ab1-4e59a426bea7 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:49.488810 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ddc82-b2bc-40a8-9ab1-4e59a426bea7 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:49.493744 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bafa54-827c-47d5-b471-700691feef07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:49.494713 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bafa54-827c-47d5-b471-700691feef07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:49.494997 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bafa54-827c-47d5-b471-700691feef07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:49.495247 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bafa54-827c-47d5-b471-700691feef07 admin admin] PATH_INFO: `/v3/projects/143ff9c6530745acaf489af3df7c6603/users/8c4f16aaf71845e29abd35c4617ecbb3/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:49.507035 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba943e-86a4-4926-bef7-4a4549bc3c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:49.507626 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba943e-86a4-4926-bef7-4a4549bc3c0a admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:49.507912 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba943e-86a4-4926-bef7-4a4549bc3c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:49.508192 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba943e-86a4-4926-bef7-4a4549bc3c0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:49.508927 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eba943e-86a4-4926-bef7-4a4549bc3c0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:49.510556 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eba943e-86a4-4926-bef7-4a4549bc3c0a admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:49.510857 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bafa54-827c-47d5-b471-700691feef07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=143ff9c6530745acaf489af3df7c6603, user_id=8c4f16aaf71845e29abd35c4617ecbb3, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:49.513583 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bafa54-827c-47d5-b471-700691feef07 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:49.521713 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 799/1606] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:49.522558 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba943e-86a4-4926-bef7-4a4549bc3c0a admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:49.575978 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba943e-86a4-4926-bef7-4a4549bc3c0a admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:49.580237 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b47560f-5fb7-4edd-ae60-952ffdd7876b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:49.580888 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b47560f-5fb7-4edd-ae60-952ffdd7876b service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:49.581202 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b47560f-5fb7-4edd-ae60-952ffdd7876b service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:49.581482 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b47560f-5fb7-4edd-ae60-952ffdd7876b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:49.590847 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b47560f-5fb7-4edd-ae60-952ffdd7876b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:49.592290 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b47560f-5fb7-4edd-ae60-952ffdd7876b service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:49.603387 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 800/1607] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:41:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:41:49.604249 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b47560f-5fb7-4edd-ae60-952ffdd7876b service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:49.604544 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 808/1608] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:41:49 2022] PUT /identity/v3/projects/143ff9c6530745acaf489af3df7c6603/users/8c4f16aaf71845e29abd35c4617ecbb3/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:49.613845 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bafa54-827c-47d5-b471-700691feef07 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:49.614272 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b47560f-5fb7-4edd-ae60-952ffdd7876b service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:49.629838 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:49.632722 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:49.680014 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bc95ed-7e07-4248-a307-ff6c2ee88fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:49.680287 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bafa54-827c-47d5-b471-700691feef07 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:49.680965 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc95ed-7e07-4248-a307-ff6c2ee88fa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:49.681283 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc95ed-7e07-4248-a307-ff6c2ee88fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:49.681556 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc95ed-7e07-4248-a307-ff6c2ee88fa6 admin admin] PATH_INFO: `/v3/projects/bb4a9e334dc040beb3623fecdcb3a506/users/e662dd4427ad4372a0183992e93cf8db/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:49.685152 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63997456-037e-4aa4-96f8-3a830bf68a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:49.685873 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63997456-037e-4aa4-96f8-3a830bf68a6a admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:49.686165 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63997456-037e-4aa4-96f8-3a830bf68a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:49.686447 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63997456-037e-4aa4-96f8-3a830bf68a6a admin admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:49.687144 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63997456-037e-4aa4-96f8-3a830bf68a6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:49.689841 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63997456-037e-4aa4-96f8-3a830bf68a6a admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:49.696641 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bc95ed-7e07-4248-a307-ff6c2ee88fa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb4a9e334dc040beb3623fecdcb3a506, user_id=e662dd4427ad4372a0183992e93cf8db, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:49.699324 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bc95ed-7e07-4248-a307-ff6c2ee88fa6 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:49.809998 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 801/1609] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:41:49 2022] PUT /identity/v3/projects/bb4a9e334dc040beb3623fecdcb3a506/users/e662dd4427ad4372a0183992e93cf8db/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:49.812724 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494e28d-5eac-4e83-85c2-377f20e0618d None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:49.812724 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494e28d-5eac-4e83-85c2-377f20e0618d None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:49.812724 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494e28d-5eac-4e83-85c2-377f20e0618d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:49.829514 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-1494e28d-5eac-4e83-85c2-377f20e0618d None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:49.831394 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-1494e28d-5eac-4e83-85c2-377f20e0618d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:49.840632 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 809/1610] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:41:49 2022] POST /identity/v3/projects => generated 365 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:49.842143 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109e6ca-80e2-4405-920e-5ab9aaf1de98 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:49.842431 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109e6ca-80e2-4405-920e-5ab9aaf1de98 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:49.842705 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109e6ca-80e2-4405-920e-5ab9aaf1de98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:49.861451 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-6109e6ca-80e2-4405-920e-5ab9aaf1de98 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:49.862600 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-6109e6ca-80e2-4405-920e-5ab9aaf1de98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:49.901299 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 802/1611] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:41:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:49.901586 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1494e28d-5eac-4e83-85c2-377f20e0618d None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:49.911507 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1494e28d-5eac-4e83-85c2-377f20e0618d None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:49.946897 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 810/1612] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:41:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:49.957711 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6109e6ca-80e2-4405-920e-5ab9aaf1de98 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:49.974541 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6109e6ca-80e2-4405-920e-5ab9aaf1de98 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:49.981711 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a3c22-fd7d-4e21-8b65-31c8a10818aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:49.982618 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a3c22-fd7d-4e21-8b65-31c8a10818aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:49.982974 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a3c22-fd7d-4e21-8b65-31c8a10818aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:49.983259 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a3c22-fd7d-4e21-8b65-31c8a10818aa admin admin] PATH_INFO: `/v3/projects/446f4029b1744d5294a70016c6f9b445/users/429c4fbd783d4fc080efa808234d7075/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:49.986358 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023f3194-92e2-467b-9f8c-e5d716c34d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:49.987412 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f3194-92e2-467b-9f8c-e5d716c34d12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:49.989418 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f3194-92e2-467b-9f8c-e5d716c34d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:49.989923 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f3194-92e2-467b-9f8c-e5d716c34d12 admin admin] PATH_INFO: `/v3/projects/8487c0ae2e1f471292034b079218bb81/users/b336af28da0742f5a66df010b8f5176a/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:50.000091 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744a3c22-fd7d-4e21-8b65-31c8a10818aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=446f4029b1744d5294a70016c6f9b445, user_id=429c4fbd783d4fc080efa808234d7075, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:50.003903 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744a3c22-fd7d-4e21-8b65-31c8a10818aa admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:50.010458 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023f3194-92e2-467b-9f8c-e5d716c34d12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8487c0ae2e1f471292034b079218bb81, user_id=b336af28da0742f5a66df010b8f5176a, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:50.014458 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023f3194-92e2-467b-9f8c-e5d716c34d12 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:50.068244 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 811/1613] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:41:49 2022] PUT /identity/v3/projects/446f4029b1744d5294a70016c6f9b445/users/429c4fbd783d4fc080efa808234d7075/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:50.070390 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55a6d0-41f6-4b77-b974-be96eb33b9ed None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:50.070832 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55a6d0-41f6-4b77-b974-be96eb33b9ed None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:50.071116 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55a6d0-41f6-4b77-b974-be96eb33b9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:50.102760 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 803/1614] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:41:49 2022] PUT /identity/v3/projects/8487c0ae2e1f471292034b079218bb81/users/b336af28da0742f5a66df010b8f5176a/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:50.102760 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f94d55-0b54-4244-be74-8910729cc5c3 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:50.102760 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f94d55-0b54-4244-be74-8910729cc5c3 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:50.103754 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f94d55-0b54-4244-be74-8910729cc5c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:50.109571 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-3e55a6d0-41f6-4b77-b974-be96eb33b9ed None None] MFA Rules not processed for user `8c4f16aaf71845e29abd35c4617ecbb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:50.112493 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-3e55a6d0-41f6-4b77-b974-be96eb33b9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:50.133539 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-29f94d55-0b54-4244-be74-8910729cc5c3 None None] MFA Rules not processed for user `e662dd4427ad4372a0183992e93cf8db`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:50.134957 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-29f94d55-0b54-4244-be74-8910729cc5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:50.145622 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:50.191545 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 812/1615] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:41:50 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:50.192278 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e55a6d0-41f6-4b77-b974-be96eb33b9ed None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:50.204559 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:50.229452 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 804/1616] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:41:50 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:50.230138 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f94d55-0b54-4244-be74-8910729cc5c3 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:50.241209 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-29f94d55-0b54-4244-be74-8910729cc5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:50.272362 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e55a6d0-41f6-4b77-b974-be96eb33b9ed None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:50.278567 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee70aef6-fe52-4c5c-a04f-ee895f6b4f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:50.279277 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70aef6-fe52-4c5c-a04f-ee895f6b4f98 admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:50.279563 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70aef6-fe52-4c5c-a04f-ee895f6b4f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:50.279841 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70aef6-fe52-4c5c-a04f-ee895f6b4f98 admin admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:50.280534 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee70aef6-fe52-4c5c-a04f-ee895f6b4f98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:50.282726 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee70aef6-fe52-4c5c-a04f-ee895f6b4f98 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:50.297227 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f94d55-0b54-4244-be74-8910729cc5c3 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:50.301784 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c2294-f108-4c93-8faf-a9c2b56cb848 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:50.302439 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c2294-f108-4c93-8faf-a9c2b56cb848 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:50.302720 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c2294-f108-4c93-8faf-a9c2b56cb848 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:50.302997 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c2294-f108-4c93-8faf-a9c2b56cb848 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:50.312725 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85c2294-f108-4c93-8faf-a9c2b56cb848 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:50.314989 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85c2294-f108-4c93-8faf-a9c2b56cb848 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:50.326370 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 805/1617] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:41:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:41:50.326523 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c2294-f108-4c93-8faf-a9c2b56cb848 service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:50.335639 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c2294-f108-4c93-8faf-a9c2b56cb848 service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:50.340541 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d11dd-2eb4-4639-9de0-c0c20d03cdba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:50.341035 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d11dd-2eb4-4639-9de0-c0c20d03cdba service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:50.341336 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d11dd-2eb4-4639-9de0-c0c20d03cdba service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:50.341609 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d11dd-2eb4-4639-9de0-c0c20d03cdba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:50.354159 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02d11dd-2eb4-4639-9de0-c0c20d03cdba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:50.355819 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02d11dd-2eb4-4639-9de0-c0c20d03cdba service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:50.367694 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 806/1618] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:41:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:41:50.368604 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d11dd-2eb4-4639-9de0-c0c20d03cdba service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:50.378608 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d11dd-2eb4-4639-9de0-c0c20d03cdba service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:50.383315 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9429b6-52b7-4654-9acf-f4aa12112240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:50.383924 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9429b6-52b7-4654-9acf-f4aa12112240 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:50.384280 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9429b6-52b7-4654-9acf-f4aa12112240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:50.384564 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9429b6-52b7-4654-9acf-f4aa12112240 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:50.386034 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9429b6-52b7-4654-9acf-f4aa12112240 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:50.386952 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9429b6-52b7-4654-9acf-f4aa12112240 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:50.398653 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 807/1619] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:50.400744 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985fe31-55af-4a87-949f-5d159ccc411a None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:50.400744 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985fe31-55af-4a87-949f-5d159ccc411a None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:50.400744 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985fe31-55af-4a87-949f-5d159ccc411a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:50.407665 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 813/1620] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:41:50 2022] POST /identity/v3/users => generated 289 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:50.410618 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee70aef6-fe52-4c5c-a04f-ee895f6b4f98 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:50.420762 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee70aef6-fe52-4c5c-a04f-ee895f6b4f98 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:50.426606 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-f985fe31-55af-4a87-949f-5d159ccc411a None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:50.427864 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3531cbad-ae6b-4012-afd4-9eb629ac4012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:50.428378 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-f985fe31-55af-4a87-949f-5d159ccc411a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:50.428750 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531cbad-ae6b-4012-afd4-9eb629ac4012 admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:50.429151 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531cbad-ae6b-4012-afd4-9eb629ac4012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:50.429625 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531cbad-ae6b-4012-afd4-9eb629ac4012 admin admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:50.430454 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3531cbad-ae6b-4012-afd4-9eb629ac4012 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:50.432737 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3531cbad-ae6b-4012-afd4-9eb629ac4012 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:50.443810 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 808/1621] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:41:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:50.445802 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f985fe31-55af-4a87-949f-5d159ccc411a None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:50.456307 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f985fe31-55af-4a87-949f-5d159ccc411a None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:50.462854 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178bb9ac-402a-4824-a60f-d37ea9918e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:50.470003 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178bb9ac-402a-4824-a60f-d37ea9918e31 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:50.470003 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178bb9ac-402a-4824-a60f-d37ea9918e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:50.470003 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178bb9ac-402a-4824-a60f-d37ea9918e31 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:50.470003 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178bb9ac-402a-4824-a60f-d37ea9918e31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:50.470003 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178bb9ac-402a-4824-a60f-d37ea9918e31 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:50.555754 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 814/1622] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:41:50 2022] POST /identity/v3/projects => generated 405 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:50.556691 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3531cbad-ae6b-4012-afd4-9eb629ac4012 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:50.585989 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 809/1623] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:41:50 2022] POST /identity/v3/projects => generated 369 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:50.587563 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178bb9ac-402a-4824-a60f-d37ea9918e31 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:50.643147 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3531cbad-ae6b-4012-afd4-9eb629ac4012 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:50.674387 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178bb9ac-402a-4824-a60f-d37ea9918e31 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:50.681083 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68691c00-f6ea-4ea2-8984-e54e2060e1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:50.682585 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68691c00-f6ea-4ea2-8984-e54e2060e1a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:50.683137 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68691c00-f6ea-4ea2-8984-e54e2060e1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:50.683846 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68691c00-f6ea-4ea2-8984-e54e2060e1a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:50.684847 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68691c00-f6ea-4ea2-8984-e54e2060e1a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:50.686628 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68691c00-f6ea-4ea2-8984-e54e2060e1a7 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:50.688281 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:50.707474 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 810/1624] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:50 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:50.709190 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68691c00-f6ea-4ea2-8984-e54e2060e1a7 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:50.720304 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b91e56-8c09-4022-a6fc-2733bb467dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:50.721299 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b91e56-8c09-4022-a6fc-2733bb467dbb admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:50.721592 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b91e56-8c09-4022-a6fc-2733bb467dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:50.721871 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b91e56-8c09-4022-a6fc-2733bb467dbb admin admin] PATH_INFO: `/v3/projects/446f4029b1744d5294a70016c6f9b445/users/429c4fbd783d4fc080efa808234d7075/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:50.723983 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b91e56-8c09-4022-a6fc-2733bb467dbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=446f4029b1744d5294a70016c6f9b445, user_id=429c4fbd783d4fc080efa808234d7075, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:50.727346 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b91e56-8c09-4022-a6fc-2733bb467dbb admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:50.741133 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 815/1625] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:41:50 2022] PUT /identity/v3/projects/446f4029b1744d5294a70016c6f9b445/users/429c4fbd783d4fc080efa808234d7075/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:50.742177 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b91e56-8c09-4022-a6fc-2733bb467dbb admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:50.773755 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:50.781375 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68691c00-f6ea-4ea2-8984-e54e2060e1a7 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:50.837801 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b91e56-8c09-4022-a6fc-2733bb467dbb admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:50.838670 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe114767-715e-47e7-96cd-9d6ee4331b92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:50.839358 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe114767-715e-47e7-96cd-9d6ee4331b92 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:50.839641 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe114767-715e-47e7-96cd-9d6ee4331b92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:50.839929 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe114767-715e-47e7-96cd-9d6ee4331b92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:50.842608 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eebfeb-871a-4bce-8f37-355b7ec44f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:50.843277 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eebfeb-871a-4bce-8f37-355b7ec44f65 admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:50.843561 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eebfeb-871a-4bce-8f37-355b7ec44f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:50.843836 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eebfeb-871a-4bce-8f37-355b7ec44f65 admin admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:50.844526 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eebfeb-871a-4bce-8f37-355b7ec44f65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:50.846791 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eebfeb-871a-4bce-8f37-355b7ec44f65 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:50.849870 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe114767-715e-47e7-96cd-9d6ee4331b92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:50.851320 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe114767-715e-47e7-96cd-9d6ee4331b92 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:50.862912 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 811/1626] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:41:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:41:50.863268 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe114767-715e-47e7-96cd-9d6ee4331b92 service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:50.872863 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe114767-715e-47e7-96cd-9d6ee4331b92 service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:50.878183 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066adf42-2403-4a16-8ddc-2499c422bc15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:50.878856 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066adf42-2403-4a16-8ddc-2499c422bc15 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:50.879135 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066adf42-2403-4a16-8ddc-2499c422bc15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:50.879408 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066adf42-2403-4a16-8ddc-2499c422bc15 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:50.880231 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066adf42-2403-4a16-8ddc-2499c422bc15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:50.882179 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066adf42-2403-4a16-8ddc-2499c422bc15 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:51.001922 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 812/1627] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:41:50 2022] POST /identity/v3/users => generated 291 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:51.001922 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066adf42-2403-4a16-8ddc-2499c422bc15 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:51.002260 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 816/1628] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:41:50 2022] POST /identity/v3/users => generated 309 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:41:51.002260 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c4791-17ed-4cdf-ade0-fff8f4af0687 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:51.002809 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c4791-17ed-4cdf-ade0-fff8f4af0687 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:51.003400 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c4791-17ed-4cdf-ade0-fff8f4af0687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:51.016032 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066adf42-2403-4a16-8ddc-2499c422bc15 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:51.021527 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a4bf60-a078-40af-b2b0-9f972ce4ecac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:51.022442 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4bf60-a078-40af-b2b0-9f972ce4ecac admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:51.022714 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4bf60-a078-40af-b2b0-9f972ce4ecac admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:51.023007 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4bf60-a078-40af-b2b0-9f972ce4ecac admin admin] PATH_INFO: `/v3/projects/1f9ee2463c224ea5b25ceacbf124bea3/users/b0a9bfbb1be240d9904e06891f405614/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:51.037679 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-2d3c4791-17ed-4cdf-ade0-fff8f4af0687 None None] MFA Rules not processed for user `429c4fbd783d4fc080efa808234d7075`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:51.039624 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-2d3c4791-17ed-4cdf-ade0-fff8f4af0687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:51.053341 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a4bf60-a078-40af-b2b0-9f972ce4ecac admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f9ee2463c224ea5b25ceacbf124bea3, user_id=b0a9bfbb1be240d9904e06891f405614, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:51.053341 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a4bf60-a078-40af-b2b0-9f972ce4ecac admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:51.138221 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 817/1629] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:41:51 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:51.139012 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c4791-17ed-4cdf-ade0-fff8f4af0687 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:51.152223 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c4791-17ed-4cdf-ade0-fff8f4af0687 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:51.157564 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 813/1630] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:41:50 2022] PUT /identity/v3/projects/1f9ee2463c224ea5b25ceacbf124bea3/users/b0a9bfbb1be240d9904e06891f405614/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:51.157889 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a4bf60-a078-40af-b2b0-9f972ce4ecac admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:51.231906 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1169a1-d76a-4874-9240-fd4cedb601f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:51.232806 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1169a1-d76a-4874-9240-fd4cedb601f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:51.233173 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1169a1-d76a-4874-9240-fd4cedb601f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:51.233449 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1169a1-d76a-4874-9240-fd4cedb601f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:51.234630 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1169a1-d76a-4874-9240-fd4cedb601f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:51.238428 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1169a1-d76a-4874-9240-fd4cedb601f6 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:51.252460 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 818/1631] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:51 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:51.253995 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1169a1-d76a-4874-9240-fd4cedb601f6 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:51.260335 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a4bf60-a078-40af-b2b0-9f972ce4ecac admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:51.265776 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3ffdc-5f0f-49d9-bd21-df427beda0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:51.266552 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3ffdc-5f0f-49d9-bd21-df427beda0bf admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:51.266908 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3ffdc-5f0f-49d9-bd21-df427beda0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:51.267205 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3ffdc-5f0f-49d9-bd21-df427beda0bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:51.268179 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe3ffdc-5f0f-49d9-bd21-df427beda0bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:51.270625 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe3ffdc-5f0f-49d9-bd21-df427beda0bf admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:51.287079 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 814/1632] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:51 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:51.287991 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3ffdc-5f0f-49d9-bd21-df427beda0bf admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:51.299034 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:51.301731 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3ffdc-5f0f-49d9-bd21-df427beda0bf admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:51.308403 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a814fb56-347b-42f9-8ff1-5ddac75ff2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:51.309226 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814fb56-347b-42f9-8ff1-5ddac75ff2d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:51.314539 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814fb56-347b-42f9-8ff1-5ddac75ff2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:51.314539 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814fb56-347b-42f9-8ff1-5ddac75ff2d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:51.314539 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a814fb56-347b-42f9-8ff1-5ddac75ff2d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:51.314539 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a814fb56-347b-42f9-8ff1-5ddac75ff2d4 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:51.316178 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:51.325830 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 815/1633] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:51 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:51.327777 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a814fb56-347b-42f9-8ff1-5ddac75ff2d4 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:51.335149 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1169a1-d76a-4874-9240-fd4cedb601f6 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:51.340943 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3a0998-1a17-4af2-85e7-d7cce590630c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:51.343471 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a0998-1a17-4af2-85e7-d7cce590630c service cinder] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:51.343471 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a0998-1a17-4af2-85e7-d7cce590630c service cinder] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:51.343471 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a0998-1a17-4af2-85e7-d7cce590630c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:51.344065 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a814fb56-347b-42f9-8ff1-5ddac75ff2d4 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:51.351347 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c281f6-3ec7-4bf2-8ecb-046f781a376c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:51.352680 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c281f6-3ec7-4bf2-8ecb-046f781a376c admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:51.353693 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c281f6-3ec7-4bf2-8ecb-046f781a376c admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:51.354118 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c281f6-3ec7-4bf2-8ecb-046f781a376c admin admin] PATH_INFO: `/v3/projects/5c90afe8a3ba4c7c9258e470984271a4/users/0d1e159da0934b3880ba29271975e9fb/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:51.377359 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c281f6-3ec7-4bf2-8ecb-046f781a376c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c90afe8a3ba4c7c9258e470984271a4, user_id=0d1e159da0934b3880ba29271975e9fb, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:51.380067 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c281f6-3ec7-4bf2-8ecb-046f781a376c admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:51.435204 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3a0998-1a17-4af2-85e7-d7cce590630c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:51.436717 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3a0998-1a17-4af2-85e7-d7cce590630c service cinder] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:51.447809 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 819/1634] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:41:51 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:41:51.448687 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3a0998-1a17-4af2-85e7-d7cce590630c service cinder] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:51.461025 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3a0998-1a17-4af2-85e7-d7cce590630c service cinder] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:51.467999 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299d708d-ca9b-4b18-9c37-3dbfa14d389b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:51.468970 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d708d-ca9b-4b18-9c37-3dbfa14d389b admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:51.469300 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d708d-ca9b-4b18-9c37-3dbfa14d389b admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:51.469647 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d708d-ca9b-4b18-9c37-3dbfa14d389b admin admin] PATH_INFO: `/v3/projects/9960212230e142acbdae2eabe0d6e502/users/8ee688368a2840bbb8c77c9664f69888/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:51.505719 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299d708d-ca9b-4b18-9c37-3dbfa14d389b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9960212230e142acbdae2eabe0d6e502, user_id=8ee688368a2840bbb8c77c9664f69888, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:51.512322 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299d708d-ca9b-4b18-9c37-3dbfa14d389b admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:51.519654 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 816/1635] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:41:51 2022] PUT /identity/v3/projects/5c90afe8a3ba4c7c9258e470984271a4/users/0d1e159da0934b3880ba29271975e9fb/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:51.521974 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c281f6-3ec7-4bf2-8ecb-046f781a376c admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:51.623027 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 820/1636] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:41:51 2022] PUT /identity/v3/projects/9960212230e142acbdae2eabe0d6e502/users/8ee688368a2840bbb8c77c9664f69888/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:51.624213 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299d708d-ca9b-4b18-9c37-3dbfa14d389b admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:51.645125 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c281f6-3ec7-4bf2-8ecb-046f781a376c admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:51.740638 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d104ec-8a00-4ac7-a515-6a250f7cf85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:51.742060 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d104ec-8a00-4ac7-a515-6a250f7cf85b admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:51.742530 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d104ec-8a00-4ac7-a515-6a250f7cf85b admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:51.742969 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d104ec-8a00-4ac7-a515-6a250f7cf85b admin admin] PATH_INFO: `/v3/projects/1f9ee2463c224ea5b25ceacbf124bea3/users/b0a9bfbb1be240d9904e06891f405614/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:51.745820 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d104ec-8a00-4ac7-a515-6a250f7cf85b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f9ee2463c224ea5b25ceacbf124bea3, user_id=b0a9bfbb1be240d9904e06891f405614, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:51.749315 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d104ec-8a00-4ac7-a515-6a250f7cf85b admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:51.757568 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299d708d-ca9b-4b18-9c37-3dbfa14d389b admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:51.762237 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 817/1637] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:41:51 2022] PUT /identity/v3/projects/1f9ee2463c224ea5b25ceacbf124bea3/users/b0a9bfbb1be240d9904e06891f405614/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:51.763370 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d104ec-8a00-4ac7-a515-6a250f7cf85b admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:51.773245 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c178eb-b62a-4212-aa34-e276c3a53893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:51.774695 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c178eb-b62a-4212-aa34-e276c3a53893 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:51.774695 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c178eb-b62a-4212-aa34-e276c3a53893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:51.774695 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c178eb-b62a-4212-aa34-e276c3a53893 admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:51.776775 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c178eb-b62a-4212-aa34-e276c3a53893 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:51.780577 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c178eb-b62a-4212-aa34-e276c3a53893 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:51.797965 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 821/1638] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:51 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:51.808565 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99570ff5-036d-4038-ae08-f9b1c4c06ba9 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:51.808883 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99570ff5-036d-4038-ae08-f9b1c4c06ba9 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:51.809160 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99570ff5-036d-4038-ae08-f9b1c4c06ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:51.870846 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d104ec-8a00-4ac7-a515-6a250f7cf85b admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:51.873907 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-99570ff5-036d-4038-ae08-f9b1c4c06ba9 None None] MFA Rules not processed for user `b0a9bfbb1be240d9904e06891f405614`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:51.875700 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-99570ff5-036d-4038-ae08-f9b1c4c06ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:51.877546 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa07414-1abb-4c37-91a0-2a53eda1fcf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:51.878451 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa07414-1abb-4c37-91a0-2a53eda1fcf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:51.878803 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa07414-1abb-4c37-91a0-2a53eda1fcf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:51.879265 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa07414-1abb-4c37-91a0-2a53eda1fcf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:51.880338 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa07414-1abb-4c37-91a0-2a53eda1fcf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:51.882302 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa07414-1abb-4c37-91a0-2a53eda1fcf8 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:51.898454 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 818/1639] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:41:51 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:41:51.899489 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa07414-1abb-4c37-91a0-2a53eda1fcf8 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:51.915472 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa07414-1abb-4c37-91a0-2a53eda1fcf8 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:51.920965 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f615e-088f-400d-ba84-6a75c51b1a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:51.922182 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f615e-088f-400d-ba84-6a75c51b1a03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:51.923992 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f615e-088f-400d-ba84-6a75c51b1a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:51.924305 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f615e-088f-400d-ba84-6a75c51b1a03 admin admin] PATH_INFO: `/v3/projects/5c90afe8a3ba4c7c9258e470984271a4/users/0d1e159da0934b3880ba29271975e9fb/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:51.926925 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f615e-088f-400d-ba84-6a75c51b1a03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c90afe8a3ba4c7c9258e470984271a4, user_id=0d1e159da0934b3880ba29271975e9fb, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:51.929931 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f615e-088f-400d-ba84-6a75c51b1a03 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:51.946434 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:51.956716 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:51.958080 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 819/1640] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:41:51 2022] PUT /identity/v3/projects/5c90afe8a3ba4c7c9258e470984271a4/users/0d1e159da0934b3880ba29271975e9fb/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:51.958080 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f615e-088f-400d-ba84-6a75c51b1a03 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:52.025577 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 822/1641] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:41:51 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:52.029714 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31cc92-4e68-45ce-970a-93488c6afe4c None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:52.030413 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31cc92-4e68-45ce-970a-93488c6afe4c None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:52.034136 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31cc92-4e68-45ce-970a-93488c6afe4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:52.088302 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f615e-088f-400d-ba84-6a75c51b1a03 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:52.100034 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-fb31cc92-4e68-45ce-970a-93488c6afe4c None None] MFA Rules not processed for user `0d1e159da0934b3880ba29271975e9fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:52.102573 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aa41f2-9f65-4445-9032-4508a8826f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:52.102922 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-fb31cc92-4e68-45ce-970a-93488c6afe4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:52.107310 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa41f2-9f65-4445-9032-4508a8826f04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:52.107310 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa41f2-9f65-4445-9032-4508a8826f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:52.107310 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa41f2-9f65-4445-9032-4508a8826f04 admin admin] PATH_INFO: `/v3/projects/9960212230e142acbdae2eabe0d6e502/users/8ee688368a2840bbb8c77c9664f69888/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:52.111761 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aa41f2-9f65-4445-9032-4508a8826f04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9960212230e142acbdae2eabe0d6e502, user_id=8ee688368a2840bbb8c77c9664f69888, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:52.118019 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aa41f2-9f65-4445-9032-4508a8826f04 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:52.145145 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 820/1642] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:41:51 2022] PUT /identity/v3/projects/9960212230e142acbdae2eabe0d6e502/users/8ee688368a2840bbb8c77c9664f69888/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:52.145145 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aa41f2-9f65-4445-9032-4508a8826f04 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:52.208945 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aa41f2-9f65-4445-9032-4508a8826f04 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:52.217431 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556b5bbd-efa5-4f1b-94ec-6ecb1d21d039 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:52.217431 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b5bbd-efa5-4f1b-94ec-6ecb1d21d039 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:52.217431 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b5bbd-efa5-4f1b-94ec-6ecb1d21d039 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:52.217431 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b5bbd-efa5-4f1b-94ec-6ecb1d21d039 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:52.229283 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 823/1643] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:41:52 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:52.236447 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222b0a6-644e-4c80-a1c8-1b46adde9ce0 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:52.236755 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222b0a6-644e-4c80-a1c8-1b46adde9ce0 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:52.237013 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222b0a6-644e-4c80-a1c8-1b46adde9ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:52.269529 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-f222b0a6-644e-4c80-a1c8-1b46adde9ce0 None None] MFA Rules not processed for user `8ee688368a2840bbb8c77c9664f69888`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:52.274854 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-f222b0a6-644e-4c80-a1c8-1b46adde9ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:52.313100 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556b5bbd-efa5-4f1b-94ec-6ecb1d21d039 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:52.314789 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556b5bbd-efa5-4f1b-94ec-6ecb1d21d039 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:52.333564 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 821/1644] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:41:52 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:41:52.419929 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 824/1645] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:41:52 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:52.529807 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556b5bbd-efa5-4f1b-94ec-6ecb1d21d039 service cinder] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:52.547097 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556b5bbd-efa5-4f1b-94ec-6ecb1d21d039 service cinder] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:52.553199 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae6eac6-6755-4b75-83fe-996190682ff3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:52.554655 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6eac6-6755-4b75-83fe-996190682ff3 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:52.555078 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6eac6-6755-4b75-83fe-996190682ff3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:52.555990 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6eac6-6755-4b75-83fe-996190682ff3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:52.635458 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:52.680579 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae6eac6-6755-4b75-83fe-996190682ff3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:52.680579 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae6eac6-6755-4b75-83fe-996190682ff3 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:52.692228 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 822/1646] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:41:52 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:41:52.820970 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222b0a6-644e-4c80-a1c8-1b46adde9ce0 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:52.834167 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222b0a6-644e-4c80-a1c8-1b46adde9ce0 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:52.839548 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e846b55-bd81-49ea-8234-365580f0ff9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:52.840456 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e846b55-bd81-49ea-8234-365580f0ff9e service cinder] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:52.840900 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e846b55-bd81-49ea-8234-365580f0ff9e service cinder] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:52.841394 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e846b55-bd81-49ea-8234-365580f0ff9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:52.853582 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e846b55-bd81-49ea-8234-365580f0ff9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:52.856277 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e846b55-bd81-49ea-8234-365580f0ff9e service cinder] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:52.869823 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 825/1647] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:41:52 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:41:53.577288 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae6eac6-6755-4b75-83fe-996190682ff3 service cinder] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:53.724018 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae6eac6-6755-4b75-83fe-996190682ff3 service cinder] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:53.731708 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb9e57a-d152-4a38-8fe7-901e35fbd7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:53.733016 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9e57a-d152-4a38-8fe7-901e35fbd7ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:53.733525 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9e57a-d152-4a38-8fe7-901e35fbd7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:53.733935 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9e57a-d152-4a38-8fe7-901e35fbd7ad admin admin] PATH_INFO: `/v3/users/8c4f16aaf71845e29abd35c4617ecbb3` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:53.736785 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb9e57a-d152-4a38-8fe7-901e35fbd7ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c4f16aaf71845e29abd35c4617ecbb3)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:53.738153 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb9e57a-d152-4a38-8fe7-901e35fbd7ad admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:54.657179 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-afb9e57a-d152-4a38-8fe7-901e35fbd7ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c4f16aaf71845e29abd35c4617ecbb3'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:54.800734 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-afb9e57a-d152-4a38-8fe7-901e35fbd7ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c4f16aaf71845e29abd35c4617ecbb3'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:54.806979 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-afb9e57a-d152-4a38-8fe7-901e35fbd7ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c4f16aaf71845e29abd35c4617ecbb3'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:54.824842 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-afb9e57a-d152-4a38-8fe7-901e35fbd7ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c4f16aaf71845e29abd35c4617ecbb3'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:54.846562 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-afb9e57a-d152-4a38-8fe7-901e35fbd7ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c4f16aaf71845e29abd35c4617ecbb3'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:54.863576 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 823/1648] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:41:53 2022] DELETE /identity/v3/users/8c4f16aaf71845e29abd35c4617ecbb3 => generated 0 bytes in 1287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:54.868005 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f511c56b-e562-4999-9ed9-d43af7dce288 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:54.868590 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f511c56b-e562-4999-9ed9-d43af7dce288 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:54.868947 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f511c56b-e562-4999-9ed9-d43af7dce288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:54.890847 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-f511c56b-e562-4999-9ed9-d43af7dce288 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:54.892976 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-f511c56b-e562-4999-9ed9-d43af7dce288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:54.937912 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:54.996337 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 826/1649] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:41:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:55.109172 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb9e57a-d152-4a38-8fe7-901e35fbd7ad admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:55.111187 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-afb9e57a-d152-4a38-8fe7-901e35fbd7ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:55.258320 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb9e57a-d152-4a38-8fe7-901e35fbd7ad admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:55.271181 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e10afa-61cc-46a8-ad96-6f9c073611ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:55.271874 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e10afa-61cc-46a8-ad96-6f9c073611ad service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:55.272162 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e10afa-61cc-46a8-ad96-6f9c073611ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:55.272443 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e10afa-61cc-46a8-ad96-6f9c073611ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:55.302357 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e10afa-61cc-46a8-ad96-6f9c073611ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:55.305003 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e10afa-61cc-46a8-ad96-6f9c073611ad service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:55.309467 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:55.327543 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 824/1650] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:41:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:41:55.365515 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f511c56b-e562-4999-9ed9-d43af7dce288 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:55.367203 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-f511c56b-e562-4999-9ed9-d43af7dce288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:55.401537 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f511c56b-e562-4999-9ed9-d43af7dce288 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:55.414822 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d9fc94-2bbd-4198-95b3-77b5f95c8318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:55.415720 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d9fc94-2bbd-4198-95b3-77b5f95c8318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:55.416029 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d9fc94-2bbd-4198-95b3-77b5f95c8318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:55.416267 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d9fc94-2bbd-4198-95b3-77b5f95c8318 admin admin] PATH_INFO: `/v3/users/3bd0fc0e7c4a459291c872e6289f7afc` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:55.418392 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d9fc94-2bbd-4198-95b3-77b5f95c8318 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bd0fc0e7c4a459291c872e6289f7afc)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:55.419699 dv-cinder-837546-3-smb devstack@keystone.service[80392]: WARNING py.warnings [None req-b6d9fc94-2bbd-4198-95b3-77b5f95c8318 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 10:41:55.419699 dv-cinder-837546-3-smb devstack@keystone.service[80392]: warnings.warn(msg) Jul 18 10:41:55.419699 dv-cinder-837546-3-smb devstack@keystone.service[80392]: Jul 18 10:41:55.420921 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d9fc94-2bbd-4198-95b3-77b5f95c8318 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:55.725623 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-b6d9fc94-2bbd-4198-95b3-77b5f95c8318 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bd0fc0e7c4a459291c872e6289f7afc'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:55.809510 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e10afa-61cc-46a8-ad96-6f9c073611ad service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:55.811380 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-51e10afa-61cc-46a8-ad96-6f9c073611ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:55.858392 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-b6d9fc94-2bbd-4198-95b3-77b5f95c8318 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bd0fc0e7c4a459291c872e6289f7afc'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:55.865345 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-b6d9fc94-2bbd-4198-95b3-77b5f95c8318 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bd0fc0e7c4a459291c872e6289f7afc'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:55.914864 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-b6d9fc94-2bbd-4198-95b3-77b5f95c8318 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bd0fc0e7c4a459291c872e6289f7afc'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:55.978296 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-b6d9fc94-2bbd-4198-95b3-77b5f95c8318 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bd0fc0e7c4a459291c872e6289f7afc'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:55.996666 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e10afa-61cc-46a8-ad96-6f9c073611ad service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:56.011291 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 827/1651] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:41:55 2022] DELETE /identity/v3/users/3bd0fc0e7c4a459291c872e6289f7afc => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:56.019773 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb11bc25-2d06-4388-855d-0e3e912003dc None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:56.021523 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb11bc25-2d06-4388-855d-0e3e912003dc None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:56.021802 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336900a4-97ed-41e6-b330-916124811e48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:56.022482 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336900a4-97ed-41e6-b330-916124811e48 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:56.022769 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336900a4-97ed-41e6-b330-916124811e48 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:56.023048 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336900a4-97ed-41e6-b330-916124811e48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:56.023406 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb11bc25-2d06-4388-855d-0e3e912003dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:56.026741 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-336900a4-97ed-41e6-b330-916124811e48 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:56.061430 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-bb11bc25-2d06-4388-855d-0e3e912003dc None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:56.066725 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-bb11bc25-2d06-4388-855d-0e3e912003dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:56.241122 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 828/1652] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:41:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:41:56.254460 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb11bc25-2d06-4388-855d-0e3e912003dc None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:56.260491 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-bb11bc25-2d06-4388-855d-0e3e912003dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:56.274546 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336900a4-97ed-41e6-b330-916124811e48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:56.276053 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336900a4-97ed-41e6-b330-916124811e48 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:56.320154 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 825/1653] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:41:55 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:41:56.430722 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb11bc25-2d06-4388-855d-0e3e912003dc None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:56.450012 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62328eda-5ab9-4a23-bc49-0cbd0b5dd73e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:56.450723 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62328eda-5ab9-4a23-bc49-0cbd0b5dd73e service neutron] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:56.451020 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62328eda-5ab9-4a23-bc49-0cbd0b5dd73e service neutron] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:56.451325 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62328eda-5ab9-4a23-bc49-0cbd0b5dd73e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:56.465534 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:56.475534 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62328eda-5ab9-4a23-bc49-0cbd0b5dd73e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:56.478312 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62328eda-5ab9-4a23-bc49-0cbd0b5dd73e service neutron] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:56.516809 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 829/1654] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:41:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:41:57.997994 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336900a4-97ed-41e6-b330-916124811e48 service cinder] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:58.000207 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-336900a4-97ed-41e6-b330-916124811e48 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:58.039258 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336900a4-97ed-41e6-b330-916124811e48 service cinder] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:58.068041 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee77c94-dfbf-4d6e-92f3-0300bb066fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:58.069204 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee77c94-dfbf-4d6e-92f3-0300bb066fde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:58.080123 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee77c94-dfbf-4d6e-92f3-0300bb066fde admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:58.080123 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee77c94-dfbf-4d6e-92f3-0300bb066fde admin admin] PATH_INFO: `/v3/projects/143ff9c6530745acaf489af3df7c6603` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:58.080123 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee77c94-dfbf-4d6e-92f3-0300bb066fde admin admin] RBAC: Authorizing `identity:delete_project(project_id=143ff9c6530745acaf489af3df7c6603)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:58.080123 dv-cinder-837546-3-smb devstack@keystone.service[80393]: WARNING py.warnings [None req-0ee77c94-dfbf-4d6e-92f3-0300bb066fde admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 10:41:58.080123 dv-cinder-837546-3-smb devstack@keystone.service[80393]: warnings.warn(msg) Jul 18 10:41:58.080123 dv-cinder-837546-3-smb devstack@keystone.service[80393]: Jul 18 10:41:58.080123 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee77c94-dfbf-4d6e-92f3-0300bb066fde admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:58.266084 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62328eda-5ab9-4a23-bc49-0cbd0b5dd73e service neutron] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:58.268651 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-62328eda-5ab9-4a23-bc49-0cbd0b5dd73e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:58.295108 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62328eda-5ab9-4a23-bc49-0cbd0b5dd73e service neutron] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:58.355824 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-0ee77c94-dfbf-4d6e-92f3-0300bb066fde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '143ff9c6530745acaf489af3df7c6603', 'request_id': 'req-0ee77c94-dfbf-4d6e-92f3-0300bb066fde'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:58.386550 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-0ee77c94-dfbf-4d6e-92f3-0300bb066fde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '143ff9c6530745acaf489af3df7c6603', 'request_id': 'req-0ee77c94-dfbf-4d6e-92f3-0300bb066fde'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:58.400953 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-0ee77c94-dfbf-4d6e-92f3-0300bb066fde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '143ff9c6530745acaf489af3df7c6603', 'request_id': 'req-0ee77c94-dfbf-4d6e-92f3-0300bb066fde'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:58.487660 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-0ee77c94-dfbf-4d6e-92f3-0300bb066fde admin admin] The token cache is being invalidate because project 143ff9c6530745acaf489af3df7c6603 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:41:58.488917 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-0ee77c94-dfbf-4d6e-92f3-0300bb066fde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:58.490954 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-0ee77c94-dfbf-4d6e-92f3-0300bb066fde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:58.496963 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 826/1655] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:41:57 2022] DELETE /identity/v3/projects/143ff9c6530745acaf489af3df7c6603 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:41:58.502112 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee77c94-dfbf-4d6e-92f3-0300bb066fde admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:58.503877 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-0ee77c94-dfbf-4d6e-92f3-0300bb066fde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:58.517093 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c304d8-0f33-44d4-a1f0-5b09f7bc6e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:58.517093 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c304d8-0f33-44d4-a1f0-5b09f7bc6e01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:58.519358 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c304d8-0f33-44d4-a1f0-5b09f7bc6e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:58.519734 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c304d8-0f33-44d4-a1f0-5b09f7bc6e01 admin admin] PATH_INFO: `/v3/projects/b4558334c4144c7c858576712326d541` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:58.522423 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c304d8-0f33-44d4-a1f0-5b09f7bc6e01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4558334c4144c7c858576712326d541)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:58.527806 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c304d8-0f33-44d4-a1f0-5b09f7bc6e01 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:58.550420 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee77c94-dfbf-4d6e-92f3-0300bb066fde admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:58.581941 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931fe729-1b29-4f56-8b07-a7f45ba72550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:58.586505 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931fe729-1b29-4f56-8b07-a7f45ba72550 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:58.586920 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931fe729-1b29-4f56-8b07-a7f45ba72550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:58.590650 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931fe729-1b29-4f56-8b07-a7f45ba72550 admin admin] PATH_INFO: `/v3/users/8ee688368a2840bbb8c77c9664f69888` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:58.606106 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931fe729-1b29-4f56-8b07-a7f45ba72550 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ee688368a2840bbb8c77c9664f69888)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:58.609625 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931fe729-1b29-4f56-8b07-a7f45ba72550 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:58.725416 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:58.736678 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-46c304d8-0f33-44d4-a1f0-5b09f7bc6e01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4558334c4144c7c858576712326d541', 'request_id': 'req-46c304d8-0f33-44d4-a1f0-5b09f7bc6e01'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:58.749909 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-46c304d8-0f33-44d4-a1f0-5b09f7bc6e01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4558334c4144c7c858576712326d541', 'request_id': 'req-46c304d8-0f33-44d4-a1f0-5b09f7bc6e01'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:58.759795 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-46c304d8-0f33-44d4-a1f0-5b09f7bc6e01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4558334c4144c7c858576712326d541', 'request_id': 'req-46c304d8-0f33-44d4-a1f0-5b09f7bc6e01'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:58.830711 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-931fe729-1b29-4f56-8b07-a7f45ba72550 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ee688368a2840bbb8c77c9664f69888'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:58.855110 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-46c304d8-0f33-44d4-a1f0-5b09f7bc6e01 admin admin] The token cache is being invalidate because project b4558334c4144c7c858576712326d541 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80392) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:41:58.856643 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-46c304d8-0f33-44d4-a1f0-5b09f7bc6e01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:58.859162 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-46c304d8-0f33-44d4-a1f0-5b09f7bc6e01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:58.861385 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 830/1656] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:41:58 2022] DELETE /identity/v3/projects/b4558334c4144c7c858576712326d541 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:58.862169 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c304d8-0f33-44d4-a1f0-5b09f7bc6e01 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:58.872768 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-46c304d8-0f33-44d4-a1f0-5b09f7bc6e01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:58.975227 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-931fe729-1b29-4f56-8b07-a7f45ba72550 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ee688368a2840bbb8c77c9664f69888'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:58.976709 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-931fe729-1b29-4f56-8b07-a7f45ba72550 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ee688368a2840bbb8c77c9664f69888'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:59.000347 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-931fe729-1b29-4f56-8b07-a7f45ba72550 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ee688368a2840bbb8c77c9664f69888'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:59.018335 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-931fe729-1b29-4f56-8b07-a7f45ba72550 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ee688368a2840bbb8c77c9664f69888'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:59.042675 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 827/1657] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:41:58 2022] DELETE /identity/v3/users/8ee688368a2840bbb8c77c9664f69888 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:41:59.042675 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931fe729-1b29-4f56-8b07-a7f45ba72550 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:41:59.044067 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-931fe729-1b29-4f56-8b07-a7f45ba72550 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:59.073076 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c304d8-0f33-44d4-a1f0-5b09f7bc6e01 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:59.148646 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:59.214152 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18baf42-36ee-4127-acc6-65ffad73fc5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:59.216541 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18baf42-36ee-4127-acc6-65ffad73fc5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:59.219463 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18baf42-36ee-4127-acc6-65ffad73fc5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:59.219942 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18baf42-36ee-4127-acc6-65ffad73fc5a admin admin] PATH_INFO: `/v3/users/e662dd4427ad4372a0183992e93cf8db` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:59.223654 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18baf42-36ee-4127-acc6-65ffad73fc5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e662dd4427ad4372a0183992e93cf8db)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:59.225531 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931fe729-1b29-4f56-8b07-a7f45ba72550 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:41:59.227937 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18baf42-36ee-4127-acc6-65ffad73fc5a admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:59.236772 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e09bec9-f13e-4ffa-ad7f-8d320a0c6ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:41:59.238069 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09bec9-f13e-4ffa-ad7f-8d320a0c6ff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:59.238581 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09bec9-f13e-4ffa-ad7f-8d320a0c6ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:59.239570 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09bec9-f13e-4ffa-ad7f-8d320a0c6ff6 admin admin] PATH_INFO: `/v3/users/b0a9bfbb1be240d9904e06891f405614` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:59.241374 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e09bec9-f13e-4ffa-ad7f-8d320a0c6ff6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0a9bfbb1be240d9904e06891f405614)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:41:59.244067 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e09bec9-f13e-4ffa-ad7f-8d320a0c6ff6 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:41:59.495479 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1e09bec9-f13e-4ffa-ad7f-8d320a0c6ff6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0a9bfbb1be240d9904e06891f405614'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:59.518099 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-a18baf42-36ee-4127-acc6-65ffad73fc5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e662dd4427ad4372a0183992e93cf8db'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:59.575585 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1e09bec9-f13e-4ffa-ad7f-8d320a0c6ff6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0a9bfbb1be240d9904e06891f405614'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:59.576632 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1e09bec9-f13e-4ffa-ad7f-8d320a0c6ff6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0a9bfbb1be240d9904e06891f405614'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:59.597974 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1e09bec9-f13e-4ffa-ad7f-8d320a0c6ff6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0a9bfbb1be240d9904e06891f405614'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:59.609279 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1e09bec9-f13e-4ffa-ad7f-8d320a0c6ff6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0a9bfbb1be240d9904e06891f405614'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:59.622612 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 828/1658] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:41:59 2022] DELETE /identity/v3/users/b0a9bfbb1be240d9904e06891f405614 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:59.669109 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-a18baf42-36ee-4127-acc6-65ffad73fc5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e662dd4427ad4372a0183992e93cf8db'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:59.672245 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-a18baf42-36ee-4127-acc6-65ffad73fc5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e662dd4427ad4372a0183992e93cf8db'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:59.722379 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-a18baf42-36ee-4127-acc6-65ffad73fc5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e662dd4427ad4372a0183992e93cf8db'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:59.732664 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-a18baf42-36ee-4127-acc6-65ffad73fc5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e662dd4427ad4372a0183992e93cf8db'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:41:59.749087 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1324eb-f905-476c-8639-b60ee1dda18e None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:41:59.749639 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1324eb-f905-476c-8639-b60ee1dda18e None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:41:59.750330 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1324eb-f905-476c-8639-b60ee1dda18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:41:59.754114 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 831/1659] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:41:58 2022] DELETE /identity/v3/users/e662dd4427ad4372a0183992e93cf8db => generated 0 bytes in 882 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:41:59.795284 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-0d1324eb-f905-476c-8639-b60ee1dda18e None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:41:59.805397 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-0d1324eb-f905-476c-8639-b60ee1dda18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:41:59.922453 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 829/1660] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:41:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:00.007900 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18baf42-36ee-4127-acc6-65ffad73fc5a admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:00.009279 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-a18baf42-36ee-4127-acc6-65ffad73fc5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:00.154439 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18baf42-36ee-4127-acc6-65ffad73fc5a admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:00.166664 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fcc690-0e26-41bc-81e8-6a15f596962b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:00.167690 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fcc690-0e26-41bc-81e8-6a15f596962b service neutron] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:00.168190 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fcc690-0e26-41bc-81e8-6a15f596962b service neutron] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:00.168583 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fcc690-0e26-41bc-81e8-6a15f596962b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:00.193085 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fcc690-0e26-41bc-81e8-6a15f596962b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:00.194708 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fcc690-0e26-41bc-81e8-6a15f596962b service neutron] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:00.218373 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 832/1661] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:42:00.492858 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5b672-d227-4070-be80-57034bfceb68 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:00.494627 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5b672-d227-4070-be80-57034bfceb68 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:00.494933 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f5b672-d227-4070-be80-57034bfceb68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:00.533826 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-94f5b672-d227-4070-be80-57034bfceb68 None None] MFA Rules not processed for user `de532a6dce8247e79bd8285220297a50`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:00.535319 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-94f5b672-d227-4070-be80-57034bfceb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:00.608585 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fcc690-0e26-41bc-81e8-6a15f596962b service neutron] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:00.611021 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-69fcc690-0e26-41bc-81e8-6a15f596962b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:00.633237 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 830/1662] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:42:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:00.639650 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fcc690-0e26-41bc-81e8-6a15f596962b service neutron] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:00.646812 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44450b4-db10-40fc-989f-6653e4974a15 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:00.647206 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44450b4-db10-40fc-989f-6653e4974a15 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:00.647550 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44450b4-db10-40fc-989f-6653e4974a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:00.660167 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea2b19-04e1-48f8-9f44-40233f25f928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:00.661299 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea2b19-04e1-48f8-9f44-40233f25f928 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:00.662777 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea2b19-04e1-48f8-9f44-40233f25f928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:00.664559 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea2b19-04e1-48f8-9f44-40233f25f928 admin admin] PATH_INFO: `/v3/projects/9960212230e142acbdae2eabe0d6e502` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:00.671194 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ea2b19-04e1-48f8-9f44-40233f25f928 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9960212230e142acbdae2eabe0d6e502)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:00.676889 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ea2b19-04e1-48f8-9f44-40233f25f928 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:00.678330 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-b44450b4-db10-40fc-989f-6653e4974a15 None None] MFA Rules not processed for user `de532a6dce8247e79bd8285220297a50`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:00.680009 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-b44450b4-db10-40fc-989f-6653e4974a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:00.695803 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 831/1663] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:42:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:00.761964 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d710e767-589f-40ac-a55a-3962dcfd4d50 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:00.762904 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d710e767-589f-40ac-a55a-3962dcfd4d50 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:00.764430 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d710e767-589f-40ac-a55a-3962dcfd4d50 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:00.768101 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 832/1664] 10.222.0.39 () {54 vars in 962 bytes} [Mon Jul 18 10:42:00 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:42:00.795695 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942879c1-44e3-4acf-bc0e-483746c48b20 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:00.800186 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942879c1-44e3-4acf-bc0e-483746c48b20 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:00.800186 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942879c1-44e3-4acf-bc0e-483746c48b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:00.889228 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-942879c1-44e3-4acf-bc0e-483746c48b20 None None] MFA Rules not processed for user `8bbebf16219943879df84bdc9a900516`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:00.893890 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-942879c1-44e3-4acf-bc0e-483746c48b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:00.974805 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-e3ea2b19-04e1-48f8-9f44-40233f25f928 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9960212230e142acbdae2eabe0d6e502', 'request_id': 'req-e3ea2b19-04e1-48f8-9f44-40233f25f928'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:01.023249 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-e3ea2b19-04e1-48f8-9f44-40233f25f928 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9960212230e142acbdae2eabe0d6e502', 'request_id': 'req-e3ea2b19-04e1-48f8-9f44-40233f25f928'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:01.049776 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-e3ea2b19-04e1-48f8-9f44-40233f25f928 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9960212230e142acbdae2eabe0d6e502', 'request_id': 'req-e3ea2b19-04e1-48f8-9f44-40233f25f928'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:01.066118 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 833/1665] 10.222.0.39 () {58 vars in 1059 bytes} [Mon Jul 18 10:42:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:01.075251 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942879c1-44e3-4acf-bc0e-483746c48b20 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:01.096720 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942879c1-44e3-4acf-bc0e-483746c48b20 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:01.190110 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-e3ea2b19-04e1-48f8-9f44-40233f25f928 admin admin] The token cache is being invalidate because project 9960212230e142acbdae2eabe0d6e502 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80392) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:42:01.190417 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-e3ea2b19-04e1-48f8-9f44-40233f25f928 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:01.192548 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-e3ea2b19-04e1-48f8-9f44-40233f25f928 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:01.195351 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 833/1666] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:42:00 2022] DELETE /identity/v3/projects/9960212230e142acbdae2eabe0d6e502 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:42:01.201194 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9286c-bc57-4dbb-a093-2043e62d5257 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:01.201507 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9286c-bc57-4dbb-a093-2043e62d5257 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:01.202415 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9286c-bc57-4dbb-a093-2043e62d5257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:01.205583 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8279b6-0df7-438c-bad1-693ba90d980e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bbebf16219943879df84bdc9a900516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:01.206221 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8279b6-0df7-438c-bad1-693ba90d980e service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:01.206507 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8279b6-0df7-438c-bad1-693ba90d980e service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:01.208142 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8279b6-0df7-438c-bad1-693ba90d980e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:01.211905 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-be8279b6-0df7-438c-bad1-693ba90d980e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:01.239675 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-83d9286c-bc57-4dbb-a093-2043e62d5257 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:01.241259 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-83d9286c-bc57-4dbb-a093-2043e62d5257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:01.339914 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8279b6-0df7-438c-bad1-693ba90d980e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:01.341805 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8279b6-0df7-438c-bad1-693ba90d980e service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:01.355478 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 834/1667] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:42:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:01.355478 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d9286c-bc57-4dbb-a093-2043e62d5257 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:01.355478 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-83d9286c-bc57-4dbb-a093-2043e62d5257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:01.362427 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 834/1668] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:42:01.384823 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d9286c-bc57-4dbb-a093-2043e62d5257 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:01.385561 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62b43f-6ef5-45a2-b0a4-37e9a245cd75 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:01.385855 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62b43f-6ef5-45a2-b0a4-37e9a245cd75 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:01.386169 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62b43f-6ef5-45a2-b0a4-37e9a245cd75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:01.399823 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:01.402092 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e346d91f-67ff-4bab-886f-5aea483e7075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:01.407625 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346d91f-67ff-4bab-886f-5aea483e7075 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:01.408033 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346d91f-67ff-4bab-886f-5aea483e7075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:01.408471 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346d91f-67ff-4bab-886f-5aea483e7075 admin admin] PATH_INFO: `/v3/projects/1f9ee2463c224ea5b25ceacbf124bea3` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:01.409982 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e346d91f-67ff-4bab-886f-5aea483e7075 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f9ee2463c224ea5b25ceacbf124bea3)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:01.411936 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e346d91f-67ff-4bab-886f-5aea483e7075 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:01.463385 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-fe62b43f-6ef5-45a2-b0a4-37e9a245cd75 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:01.464827 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-fe62b43f-6ef5-45a2-b0a4-37e9a245cd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:01.487634 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 835/1669] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:42:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:01.492761 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe62b43f-6ef5-45a2-b0a4-37e9a245cd75 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:01.514549 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe62b43f-6ef5-45a2-b0a4-37e9a245cd75 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:01.528356 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651deb0e-039c-41ec-847a-3c2a71d36311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:01.529076 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651deb0e-039c-41ec-847a-3c2a71d36311 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:01.529355 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651deb0e-039c-41ec-847a-3c2a71d36311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:01.531132 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651deb0e-039c-41ec-847a-3c2a71d36311 admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:01.533773 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651deb0e-039c-41ec-847a-3c2a71d36311 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:42:01.534100 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651deb0e-039c-41ec-847a-3c2a71d36311 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:01.539129 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651deb0e-039c-41ec-847a-3c2a71d36311 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:01.561557 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-e346d91f-67ff-4bab-886f-5aea483e7075 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f9ee2463c224ea5b25ceacbf124bea3', 'request_id': 'req-e346d91f-67ff-4bab-886f-5aea483e7075'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:01.576711 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 836/1670] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 10:42:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:42:01.581627 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651deb0e-039c-41ec-847a-3c2a71d36311 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:01.582517 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-e346d91f-67ff-4bab-886f-5aea483e7075 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f9ee2463c224ea5b25ceacbf124bea3', 'request_id': 'req-e346d91f-67ff-4bab-886f-5aea483e7075'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:01.597219 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-e346d91f-67ff-4bab-886f-5aea483e7075 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f9ee2463c224ea5b25ceacbf124bea3', 'request_id': 'req-e346d91f-67ff-4bab-886f-5aea483e7075'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:01.603795 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651deb0e-039c-41ec-847a-3c2a71d36311 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:01.720697 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-e346d91f-67ff-4bab-886f-5aea483e7075 admin admin] The token cache is being invalidate because project 1f9ee2463c224ea5b25ceacbf124bea3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80392) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:42:01.725653 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:01.729162 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-e346d91f-67ff-4bab-886f-5aea483e7075 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:01.730735 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-e346d91f-67ff-4bab-886f-5aea483e7075 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:01.740089 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 835/1671] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:42:01 2022] DELETE /identity/v3/projects/1f9ee2463c224ea5b25ceacbf124bea3 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:01.745435 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e23979-3f75-4c7c-9485-287ec583f9f4 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:01.745724 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e23979-3f75-4c7c-9485-287ec583f9f4 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:01.746004 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e23979-3f75-4c7c-9485-287ec583f9f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:01.769486 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-e1e23979-3f75-4c7c-9485-287ec583f9f4 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:01.770544 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95364d6c-4630-4233-9eec-e95a4aaedfd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:01.770864 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-e1e23979-3f75-4c7c-9485-287ec583f9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:01.771430 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95364d6c-4630-4233-9eec-e95a4aaedfd7 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:01.771928 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95364d6c-4630-4233-9eec-e95a4aaedfd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:01.772322 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95364d6c-4630-4233-9eec-e95a4aaedfd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:01.775241 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95364d6c-4630-4233-9eec-e95a4aaedfd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:01.777296 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95364d6c-4630-4233-9eec-e95a4aaedfd7 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:01.779403 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 836/1672] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:42:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:01.787881 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76a3e6-8777-4d69-bd39-8b8b63ac7ae1 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:01.788241 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76a3e6-8777-4d69-bd39-8b8b63ac7ae1 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:01.788589 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76a3e6-8777-4d69-bd39-8b8b63ac7ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:01.835109 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-6e76a3e6-8777-4d69-bd39-8b8b63ac7ae1 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:01.837385 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-6e76a3e6-8777-4d69-bd39-8b8b63ac7ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:01.851760 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 837/1673] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:42:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:42:01.853595 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e76a3e6-8777-4d69-bd39-8b8b63ac7ae1 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:01.855168 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-6e76a3e6-8777-4d69-bd39-8b8b63ac7ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:01.889318 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e76a3e6-8777-4d69-bd39-8b8b63ac7ae1 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:01.899886 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925dc7ae-0970-4f60-ae1b-65600eb57bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:01.900876 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925dc7ae-0970-4f60-ae1b-65600eb57bfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:01.901449 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925dc7ae-0970-4f60-ae1b-65600eb57bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:01.901927 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925dc7ae-0970-4f60-ae1b-65600eb57bfb admin admin] PATH_INFO: `/v3/projects/bb4a9e334dc040beb3623fecdcb3a506` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:01.910485 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925dc7ae-0970-4f60-ae1b-65600eb57bfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb4a9e334dc040beb3623fecdcb3a506)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:01.913270 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925dc7ae-0970-4f60-ae1b-65600eb57bfb admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:01.915846 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 837/1674] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:42:01 2022] POST /identity/v3/projects => generated 403 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:42:01.916752 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95364d6c-4630-4233-9eec-e95a4aaedfd7 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:02.036321 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95364d6c-4630-4233-9eec-e95a4aaedfd7 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:02.051474 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-925dc7ae-0970-4f60-ae1b-65600eb57bfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb4a9e334dc040beb3623fecdcb3a506', 'request_id': 'req-925dc7ae-0970-4f60-ae1b-65600eb57bfb'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:02.069296 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-925dc7ae-0970-4f60-ae1b-65600eb57bfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb4a9e334dc040beb3623fecdcb3a506', 'request_id': 'req-925dc7ae-0970-4f60-ae1b-65600eb57bfb'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:02.078464 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-925dc7ae-0970-4f60-ae1b-65600eb57bfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb4a9e334dc040beb3623fecdcb3a506', 'request_id': 'req-925dc7ae-0970-4f60-ae1b-65600eb57bfb'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:02.178987 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8befa6-2142-44c7-a697-8528df6a2d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:02.179931 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8befa6-2142-44c7-a697-8528df6a2d62 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:02.180380 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8befa6-2142-44c7-a697-8528df6a2d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:02.181416 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8befa6-2142-44c7-a697-8528df6a2d62 admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:02.182087 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8befa6-2142-44c7-a697-8528df6a2d62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:42:02.182400 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8befa6-2142-44c7-a697-8528df6a2d62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:02.184579 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8befa6-2142-44c7-a697-8528df6a2d62 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:02.187056 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-925dc7ae-0970-4f60-ae1b-65600eb57bfb admin admin] The token cache is being invalidate because project bb4a9e334dc040beb3623fecdcb3a506 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80392) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:42:02.187430 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-925dc7ae-0970-4f60-ae1b-65600eb57bfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:02.191287 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-925dc7ae-0970-4f60-ae1b-65600eb57bfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:02.194315 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 838/1675] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:42:01 2022] DELETE /identity/v3/projects/bb4a9e334dc040beb3623fecdcb3a506 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:02.196431 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e863c60-9ebd-4244-96cf-530faa389998 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:02.199322 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 838/1676] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 10:42:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:42:02.200394 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8befa6-2142-44c7-a697-8528df6a2d62 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:02.202915 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e863c60-9ebd-4244-96cf-530faa389998 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:02.203547 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e863c60-9ebd-4244-96cf-530faa389998 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:02.204946 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-da8befa6-2142-44c7-a697-8528df6a2d62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:02.205688 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 839/1677] 10.222.0.39 () {54 vars in 912 bytes} [Mon Jul 18 10:42:02 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:42:02.218535 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e863c60-9ebd-4244-96cf-530faa389998 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:02.220925 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-0e863c60-9ebd-4244-96cf-530faa389998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:02.227645 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8befa6-2142-44c7-a697-8528df6a2d62 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:02.234858 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c8b5cf-7bde-4d4a-9370-92f39a6ead1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:02.236670 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c8b5cf-7bde-4d4a-9370-92f39a6ead1a admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:02.236670 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c8b5cf-7bde-4d4a-9370-92f39a6ead1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:02.237087 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c8b5cf-7bde-4d4a-9370-92f39a6ead1a admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:02.238019 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c8b5cf-7bde-4d4a-9370-92f39a6ead1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:02.241014 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c8b5cf-7bde-4d4a-9370-92f39a6ead1a admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:02.251860 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e863c60-9ebd-4244-96cf-530faa389998 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:02.264789 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531233c6-6f49-475e-97e9-bd7789db65a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:02.265867 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531233c6-6f49-475e-97e9-bd7789db65a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:02.266762 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531233c6-6f49-475e-97e9-bd7789db65a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:02.267118 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531233c6-6f49-475e-97e9-bd7789db65a9 admin admin] PATH_INFO: `/v3/users/9c9e231d65334b6994e511c08cb74fe2` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:02.269109 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531233c6-6f49-475e-97e9-bd7789db65a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c9e231d65334b6994e511c08cb74fe2)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:02.271248 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531233c6-6f49-475e-97e9-bd7789db65a9 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:02.405422 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 839/1678] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:42:02 2022] POST /identity/v3/users => generated 302 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:42:02.406469 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c8b5cf-7bde-4d4a-9370-92f39a6ead1a admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:02.414105 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-d3c8b5cf-7bde-4d4a-9370-92f39a6ead1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:02.436824 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c8b5cf-7bde-4d4a-9370-92f39a6ead1a admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:02.446439 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817872ed-6ea8-460a-9c6f-0a3f9be86306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:02.447478 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817872ed-6ea8-460a-9c6f-0a3f9be86306 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:02.447731 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817872ed-6ea8-460a-9c6f-0a3f9be86306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:02.448008 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817872ed-6ea8-460a-9c6f-0a3f9be86306 admin admin] PATH_INFO: `/v3/users/0d1e159da0934b3880ba29271975e9fb` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:02.451128 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817872ed-6ea8-460a-9c6f-0a3f9be86306 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d1e159da0934b3880ba29271975e9fb)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:02.456401 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817872ed-6ea8-460a-9c6f-0a3f9be86306 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:02.548064 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-531233c6-6f49-475e-97e9-bd7789db65a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c9e231d65334b6994e511c08cb74fe2'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:02.665282 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-531233c6-6f49-475e-97e9-bd7789db65a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c9e231d65334b6994e511c08cb74fe2'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:02.665978 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-531233c6-6f49-475e-97e9-bd7789db65a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c9e231d65334b6994e511c08cb74fe2'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:02.696101 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-531233c6-6f49-475e-97e9-bd7789db65a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c9e231d65334b6994e511c08cb74fe2'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:02.716341 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-531233c6-6f49-475e-97e9-bd7789db65a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c9e231d65334b6994e511c08cb74fe2'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:02.740520 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-817872ed-6ea8-460a-9c6f-0a3f9be86306 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d1e159da0934b3880ba29271975e9fb'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:02.751513 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 840/1679] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:42:02 2022] DELETE /identity/v3/users/9c9e231d65334b6994e511c08cb74fe2 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:02.753468 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531233c6-6f49-475e-97e9-bd7789db65a9 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:02.757856 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-531233c6-6f49-475e-97e9-bd7789db65a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:02.884660 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-817872ed-6ea8-460a-9c6f-0a3f9be86306 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d1e159da0934b3880ba29271975e9fb'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:02.885839 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-817872ed-6ea8-460a-9c6f-0a3f9be86306 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d1e159da0934b3880ba29271975e9fb'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:02.916733 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531233c6-6f49-475e-97e9-bd7789db65a9 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:02.925663 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f3d6e6-4c6f-480f-9670-41847ca33615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:02.926481 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3d6e6-4c6f-480f-9670-41847ca33615 admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:02.926773 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3d6e6-4c6f-480f-9670-41847ca33615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:02.927056 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f3d6e6-4c6f-480f-9670-41847ca33615 admin admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:02.928127 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-817872ed-6ea8-460a-9c6f-0a3f9be86306 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d1e159da0934b3880ba29271975e9fb'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:02.930079 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f3d6e6-4c6f-480f-9670-41847ca33615 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:02.935630 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f3d6e6-4c6f-480f-9670-41847ca33615 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:02.942752 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-817872ed-6ea8-460a-9c6f-0a3f9be86306 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d1e159da0934b3880ba29271975e9fb'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:03.179393 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 840/1680] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:42:02 2022] DELETE /identity/v3/users/0d1e159da0934b3880ba29271975e9fb => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:03.179393 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3562ee-ac22-4947-863d-aa8d69c66563 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:03.179393 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3562ee-ac22-4947-863d-aa8d69c66563 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:03.179393 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3562ee-ac22-4947-863d-aa8d69c66563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:03.179393 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-cb3562ee-ac22-4947-863d-aa8d69c66563 None None] MFA Rules not processed for user `8bbebf16219943879df84bdc9a900516`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:03.179393 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-cb3562ee-ac22-4947-863d-aa8d69c66563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:03.180321 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 841/1681] 10.222.0.39 () {58 vars in 1009 bytes} [Mon Jul 18 10:42:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:03.180321 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3562ee-ac22-4947-863d-aa8d69c66563 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:03.180321 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-cb3562ee-ac22-4947-863d-aa8d69c66563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:03.198865 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 841/1682] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:42:02 2022] POST /identity/v3/projects => generated 365 bytes in 444 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:42:03.199449 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d171b-c1ae-4d1e-a371-73519c53a2ed None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:03.199790 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d171b-c1ae-4d1e-a371-73519c53a2ed None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:03.200128 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d171b-c1ae-4d1e-a371-73519c53a2ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:03.233278 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-d04d171b-c1ae-4d1e-a371-73519c53a2ed None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:03.235208 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-d04d171b-c1ae-4d1e-a371-73519c53a2ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:03.281005 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3562ee-ac22-4947-863d-aa8d69c66563 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:03.368014 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 842/1683] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:42:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:03.368993 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d171b-c1ae-4d1e-a371-73519c53a2ed None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:03.370895 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-d04d171b-c1ae-4d1e-a371-73519c53a2ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:03.440493 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21993f9-72a5-444a-a7eb-7a1eafc8e1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:03.441525 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21993f9-72a5-444a-a7eb-7a1eafc8e1a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:03.442592 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21993f9-72a5-444a-a7eb-7a1eafc8e1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:03.445283 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21993f9-72a5-444a-a7eb-7a1eafc8e1a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:03.449311 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21993f9-72a5-444a-a7eb-7a1eafc8e1a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:03.451708 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21993f9-72a5-444a-a7eb-7a1eafc8e1a0 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:03.484301 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 842/1684] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:03 2022] GET /identity/v3/roles => generated 1420 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:42:03.484301 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21993f9-72a5-444a-a7eb-7a1eafc8e1a0 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:03.487291 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-b21993f9-72a5-444a-a7eb-7a1eafc8e1a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:03.506004 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21993f9-72a5-444a-a7eb-7a1eafc8e1a0 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:03.512848 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae08a1d-4dcc-4d41-aa54-a6b8d0c93996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:03.517153 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae08a1d-4dcc-4d41-aa54-a6b8d0c93996 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:03.518275 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae08a1d-4dcc-4d41-aa54-a6b8d0c93996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:03.518275 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae08a1d-4dcc-4d41-aa54-a6b8d0c93996 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:03.518964 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae08a1d-4dcc-4d41-aa54-a6b8d0c93996 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:03.525274 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae08a1d-4dcc-4d41-aa54-a6b8d0c93996 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:03.542219 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d171b-c1ae-4d1e-a371-73519c53a2ed None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:03.546371 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6755cd6e-21e9-41df-942f-6bf150b3ca82 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d1f7d0286745a396905aee50c9410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:03.548512 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6755cd6e-21e9-41df-942f-6bf150b3ca82 service glance] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:03.548974 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6755cd6e-21e9-41df-942f-6bf150b3ca82 service glance] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:03.549628 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6755cd6e-21e9-41df-942f-6bf150b3ca82 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:03.643788 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:03.655799 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6755cd6e-21e9-41df-942f-6bf150b3ca82 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:03.657411 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6755cd6e-21e9-41df-942f-6bf150b3ca82 service glance] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:03.680903 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 843/1685] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:42:03.680903 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6755cd6e-21e9-41df-942f-6bf150b3ca82 service glance] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:03.683417 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-6755cd6e-21e9-41df-942f-6bf150b3ca82 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:03.686073 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 843/1686] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:42:03 2022] POST /identity/v3/users => generated 283 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:42:03.687366 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae08a1d-4dcc-4d41-aa54-a6b8d0c93996 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:03.714143 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae08a1d-4dcc-4d41-aa54-a6b8d0c93996 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:03.728699 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040c4d7b-b5bd-4559-a9fc-38898912eee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:03.729523 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c4d7b-b5bd-4559-a9fc-38898912eee8 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:03.729881 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c4d7b-b5bd-4559-a9fc-38898912eee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:03.731239 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c4d7b-b5bd-4559-a9fc-38898912eee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:03.732915 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040c4d7b-b5bd-4559-a9fc-38898912eee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:03.737699 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040c4d7b-b5bd-4559-a9fc-38898912eee8 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:03.766810 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 844/1687] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:03 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:42:03.767381 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040c4d7b-b5bd-4559-a9fc-38898912eee8 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:03.788298 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040c4d7b-b5bd-4559-a9fc-38898912eee8 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:03.793264 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6755cd6e-21e9-41df-942f-6bf150b3ca82 service glance] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:03.797962 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ab4a4-456f-4cfc-9519-51010db69947 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:03.798878 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ab4a4-456f-4cfc-9519-51010db69947 service neutron] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:03.799235 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ab4a4-456f-4cfc-9519-51010db69947 service neutron] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:03.799619 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ab4a4-456f-4cfc-9519-51010db69947 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:03.809753 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2d7746-9416-4d61-8f12-bc4933214e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:03.810459 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d7746-9416-4d61-8f12-bc4933214e2c admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:03.810752 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d7746-9416-4d61-8f12-bc4933214e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:03.811037 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d7746-9416-4d61-8f12-bc4933214e2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:03.811723 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53ab4a4-456f-4cfc-9519-51010db69947 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:03.811833 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2d7746-9416-4d61-8f12-bc4933214e2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:03.813553 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53ab4a4-456f-4cfc-9519-51010db69947 service neutron] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:03.814703 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2d7746-9416-4d61-8f12-bc4933214e2c admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:03.830552 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 845/1688] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:03 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:42:03.832021 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2d7746-9416-4d61-8f12-bc4933214e2c admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:03.834923 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 844/1689] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:42:03.836089 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ab4a4-456f-4cfc-9519-51010db69947 service neutron] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:03.848892 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ab4a4-456f-4cfc-9519-51010db69947 service neutron] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:03.851340 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:03.853685 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2d7746-9416-4d61-8f12-bc4933214e2c admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:03.862003 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fc6d0a-8870-47c6-8bbb-c8ea4fcbefce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:03.862003 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc6d0a-8870-47c6-8bbb-c8ea4fcbefce admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:03.862003 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc6d0a-8870-47c6-8bbb-c8ea4fcbefce admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:03.862003 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fc6d0a-8870-47c6-8bbb-c8ea4fcbefce admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:03.862610 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fc6d0a-8870-47c6-8bbb-c8ea4fcbefce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:03.863974 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae753b7-5db8-46c1-8e16-22103b73326a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:03.864970 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae753b7-5db8-46c1-8e16-22103b73326a admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:03.865765 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae753b7-5db8-46c1-8e16-22103b73326a admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:03.867037 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fc6d0a-8870-47c6-8bbb-c8ea4fcbefce admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:03.867443 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae753b7-5db8-46c1-8e16-22103b73326a admin admin] PATH_INFO: `/v3/projects/185ba59cfdc44b4db66f2885f125e317/users/c3f7301abf3f4cd398b30ec9eae170dc/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:03.893823 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 845/1690] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:03 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:42:03.894383 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae753b7-5db8-46c1-8e16-22103b73326a admin admin] RBAC: Authorizing `identity:create_grant(project_id=185ba59cfdc44b4db66f2885f125e317, user_id=c3f7301abf3f4cd398b30ec9eae170dc, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:03.894990 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fc6d0a-8870-47c6-8bbb-c8ea4fcbefce admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:03.899149 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae753b7-5db8-46c1-8e16-22103b73326a admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:03.908162 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fc6d0a-8870-47c6-8bbb-c8ea4fcbefce admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:03.915455 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce0d50f-b125-4065-90e1-163fb9dfd8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:03.916615 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0d50f-b125-4065-90e1-163fb9dfd8ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:03.916999 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0d50f-b125-4065-90e1-163fb9dfd8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:03.917406 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0d50f-b125-4065-90e1-163fb9dfd8ce admin admin] PATH_INFO: `/v3/projects/2c8270c318a24bfd8df76c9ba81c4067/users/8c77c3c181a24851a5ca18cffbde3891/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:03.966266 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce0d50f-b125-4065-90e1-163fb9dfd8ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c8270c318a24bfd8df76c9ba81c4067, user_id=8c77c3c181a24851a5ca18cffbde3891, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:03.970171 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce0d50f-b125-4065-90e1-163fb9dfd8ce admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:03.983073 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 846/1691] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:42:03 2022] PUT /identity/v3/projects/185ba59cfdc44b4db66f2885f125e317/users/c3f7301abf3f4cd398b30ec9eae170dc/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:03.989176 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396f0ae-452b-4ff6-82d5-744ff449dc87 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:03.989382 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396f0ae-452b-4ff6-82d5-744ff449dc87 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:03.989598 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c396f0ae-452b-4ff6-82d5-744ff449dc87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:04.027311 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-c396f0ae-452b-4ff6-82d5-744ff449dc87 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:04.028656 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c396f0ae-452b-4ff6-82d5-744ff449dc87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:04.110795 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 846/1692] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:42:03 2022] PUT /identity/v3/projects/2c8270c318a24bfd8df76c9ba81c4067/users/8c77c3c181a24851a5ca18cffbde3891/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:04.110969 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:04.111038 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc20862-db3a-448c-be06-84f15e75d498 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:04.111038 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc20862-db3a-448c-be06-84f15e75d498 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:04.111038 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc20862-db3a-448c-be06-84f15e75d498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:04.169541 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-0fc20862-db3a-448c-be06-84f15e75d498 None None] MFA Rules not processed for user `8c77c3c181a24851a5ca18cffbde3891`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:04.171789 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-0fc20862-db3a-448c-be06-84f15e75d498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:04.206016 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 847/1693] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:42:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:42:04.207571 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c396f0ae-452b-4ff6-82d5-744ff449dc87 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:04.209970 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c396f0ae-452b-4ff6-82d5-744ff449dc87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:04.227263 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c396f0ae-452b-4ff6-82d5-744ff449dc87 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:04.337723 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2163dc-2346-4353-b35d-9fee8214b4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:04.338861 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 847/1694] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:42:04 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:42:04.342596 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc20862-db3a-448c-be06-84f15e75d498 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:04.342672 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2163dc-2346-4353-b35d-9fee8214b4b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:04.342672 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2163dc-2346-4353-b35d-9fee8214b4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:04.342672 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2163dc-2346-4353-b35d-9fee8214b4b8 admin admin] PATH_INFO: `/v3/projects/5c90afe8a3ba4c7c9258e470984271a4` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:04.343297 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-0fc20862-db3a-448c-be06-84f15e75d498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:04.344478 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2163dc-2346-4353-b35d-9fee8214b4b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c90afe8a3ba4c7c9258e470984271a4)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:04.349732 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2163dc-2346-4353-b35d-9fee8214b4b8 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:04.515800 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc20862-db3a-448c-be06-84f15e75d498 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:04.553384 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-ac2163dc-2346-4353-b35d-9fee8214b4b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c90afe8a3ba4c7c9258e470984271a4', 'request_id': 'req-ac2163dc-2346-4353-b35d-9fee8214b4b8'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:04.568818 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-ac2163dc-2346-4353-b35d-9fee8214b4b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c90afe8a3ba4c7c9258e470984271a4', 'request_id': 'req-ac2163dc-2346-4353-b35d-9fee8214b4b8'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:04.585160 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-ac2163dc-2346-4353-b35d-9fee8214b4b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c90afe8a3ba4c7c9258e470984271a4', 'request_id': 'req-ac2163dc-2346-4353-b35d-9fee8214b4b8'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:04.626680 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce45285c-c5d8-4aeb-a002-10ac5f7e7396 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:04.627363 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce45285c-c5d8-4aeb-a002-10ac5f7e7396 service neutron] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:04.627653 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce45285c-c5d8-4aeb-a002-10ac5f7e7396 service neutron] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:04.627941 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce45285c-c5d8-4aeb-a002-10ac5f7e7396 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:04.714140 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-ac2163dc-2346-4353-b35d-9fee8214b4b8 admin admin] The token cache is being invalidate because project 5c90afe8a3ba4c7c9258e470984271a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:42:04.714437 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-ac2163dc-2346-4353-b35d-9fee8214b4b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:04.715891 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce45285c-c5d8-4aeb-a002-10ac5f7e7396 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:04.716092 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-ac2163dc-2346-4353-b35d-9fee8214b4b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:04.718762 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 848/1695] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:42:04 2022] DELETE /identity/v3/projects/5c90afe8a3ba4c7c9258e470984271a4 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:04.720392 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2163dc-2346-4353-b35d-9fee8214b4b8 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:04.721088 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce45285c-c5d8-4aeb-a002-10ac5f7e7396 service neutron] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:04.723706 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-ac2163dc-2346-4353-b35d-9fee8214b4b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:04.733924 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 848/1696] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:42:04.735676 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0790562-f779-40ff-8214-b4ce4ed0dfcc None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:04.735676 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0790562-f779-40ff-8214-b4ce4ed0dfcc None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:04.735906 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0790562-f779-40ff-8214-b4ce4ed0dfcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:04.756217 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2163dc-2346-4353-b35d-9fee8214b4b8 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:04.763701 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4807511-5fbf-4371-b950-43a5dd55f14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:04.769899 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4807511-5fbf-4371-b950-43a5dd55f14f admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:04.769899 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4807511-5fbf-4371-b950-43a5dd55f14f admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:04.769899 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4807511-5fbf-4371-b950-43a5dd55f14f admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:04.769899 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4807511-5fbf-4371-b950-43a5dd55f14f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:04.769899 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4807511-5fbf-4371-b950-43a5dd55f14f admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:04.772191 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-c0790562-f779-40ff-8214-b4ce4ed0dfcc None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:04.773637 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-c0790562-f779-40ff-8214-b4ce4ed0dfcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:04.795613 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 849/1697] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:42:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:04.805591 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cac8da-0adb-4b01-88cb-eb3a9b86b2e9 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:04.805767 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cac8da-0adb-4b01-88cb-eb3a9b86b2e9 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:04.806165 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cac8da-0adb-4b01-88cb-eb3a9b86b2e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:04.831563 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-80cac8da-0adb-4b01-88cb-eb3a9b86b2e9 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:04.832992 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-80cac8da-0adb-4b01-88cb-eb3a9b86b2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:04.858148 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 850/1698] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:42:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:04.860677 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cac8da-0adb-4b01-88cb-eb3a9b86b2e9 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:04.884011 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cac8da-0adb-4b01-88cb-eb3a9b86b2e9 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:04.889869 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd9a02b-bf1a-4787-90d9-f0848dfc224f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:04.890632 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9a02b-bf1a-4787-90d9-f0848dfc224f admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:04.891026 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9a02b-bf1a-4787-90d9-f0848dfc224f admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:04.892109 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9a02b-bf1a-4787-90d9-f0848dfc224f admin admin] PATH_INFO: `/v3/domains` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:04.892923 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd9a02b-bf1a-4787-90d9-f0848dfc224f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:42:04.899203 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd9a02b-bf1a-4787-90d9-f0848dfc224f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:04.899203 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd9a02b-bf1a-4787-90d9-f0848dfc224f admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:04.917504 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 849/1699] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:42:04 2022] POST /identity/v3/projects => generated 361 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:42:04.921456 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2faa3e-a0d4-4e51-a7ae-83a732e591c9 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:04.922446 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2faa3e-a0d4-4e51-a7ae-83a732e591c9 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:04.924698 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2faa3e-a0d4-4e51-a7ae-83a732e591c9 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:04.940573 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 850/1700] 10.222.0.39 () {54 vars in 912 bytes} [Mon Jul 18 10:42:04 2022] GET /identity => generated 270 bytes in 20 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:42:04.940573 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2faa3e-a0d4-4e51-a7ae-83a732e591c9 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:04.944474 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 851/1701] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 10:42:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:42:04.950806 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93899d5-f197-461b-b1bf-b53a82ee7285 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:04.951893 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93899d5-f197-461b-b1bf-b53a82ee7285 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:04.952242 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93899d5-f197-461b-b1bf-b53a82ee7285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:05.021728 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-a93899d5-f197-461b-b1bf-b53a82ee7285 None None] MFA Rules not processed for user `2f88e3a2b95e477bae1cc98e9e18dc24`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:05.023208 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-a93899d5-f197-461b-b1bf-b53a82ee7285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:05.113126 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 852/1702] 10.222.0.39 () {58 vars in 1009 bytes} [Mon Jul 18 10:42:04 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:42:05.113634 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93899d5-f197-461b-b1bf-b53a82ee7285 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:05.129968 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2faa3e-a0d4-4e51-a7ae-83a732e591c9 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:05.130507 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93899d5-f197-461b-b1bf-b53a82ee7285 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:05.142168 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f3ba0-84be-4c71-81ec-d842d6e4b0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:05.143051 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f3ba0-84be-4c71-81ec-d842d6e4b0e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:05.143398 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f3ba0-84be-4c71-81ec-d842d6e4b0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:05.143688 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f3ba0-84be-4c71-81ec-d842d6e4b0e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:05.146045 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed1517e-94df-48d3-8d5d-219e1753c7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:05.147087 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed1517e-94df-48d3-8d5d-219e1753c7ff admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:05.151165 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed1517e-94df-48d3-8d5d-219e1753c7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:05.151964 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed1517e-94df-48d3-8d5d-219e1753c7ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:05.153641 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed1517e-94df-48d3-8d5d-219e1753c7ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:05.153805 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927f3ba0-84be-4c71-81ec-d842d6e4b0e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:05.155970 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927f3ba0-84be-4c71-81ec-d842d6e4b0e0 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:05.162191 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed1517e-94df-48d3-8d5d-219e1753c7ff admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:05.264847 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 851/1703] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:42:04 2022] POST /identity/v3/users => generated 287 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:42:05.265887 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f3ba0-84be-4c71-81ec-d842d6e4b0e0 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:05.273032 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-927f3ba0-84be-4c71-81ec-d842d6e4b0e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:05.288940 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:05.311132 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 853/1704] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:42:05 2022] POST /identity/v3/projects => generated 375 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:42:05.315274 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f3ba0-84be-4c71-81ec-d842d6e4b0e0 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:05.316054 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed1517e-94df-48d3-8d5d-219e1753c7ff admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:05.457202 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b060a746-1f67-4230-ba3d-448c513c0bb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:05.459060 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060a746-1f67-4230-ba3d-448c513c0bb7 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:05.459508 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060a746-1f67-4230-ba3d-448c513c0bb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:05.459922 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060a746-1f67-4230-ba3d-448c513c0bb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:05.469581 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b060a746-1f67-4230-ba3d-448c513c0bb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:05.471519 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b060a746-1f67-4230-ba3d-448c513c0bb7 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:05.488198 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed1517e-94df-48d3-8d5d-219e1753c7ff admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:05.503332 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2633946-8e49-471a-8d93-61939f2fe959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:05.504293 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2633946-8e49-471a-8d93-61939f2fe959 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:05.509776 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2633946-8e49-471a-8d93-61939f2fe959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:05.509913 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 852/1705] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:42:05.510015 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2633946-8e49-471a-8d93-61939f2fe959 admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:05.510015 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2633946-8e49-471a-8d93-61939f2fe959 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:05.510172 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b060a746-1f67-4230-ba3d-448c513c0bb7 service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:05.525478 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2633946-8e49-471a-8d93-61939f2fe959 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:05.549440 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:05.580674 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b060a746-1f67-4230-ba3d-448c513c0bb7 service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:05.584689 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 854/1706] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:05 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:42:05.586173 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2633946-8e49-471a-8d93-61939f2fe959 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:05.611923 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eef5094-cec7-47f9-831b-2b3daec7fec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:05.611923 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef5094-cec7-47f9-831b-2b3daec7fec7 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:05.611923 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef5094-cec7-47f9-831b-2b3daec7fec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:05.611923 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef5094-cec7-47f9-831b-2b3daec7fec7 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:05.612403 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eef5094-cec7-47f9-831b-2b3daec7fec7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:05.621551 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2633946-8e49-471a-8d93-61939f2fe959 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:05.622804 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eef5094-cec7-47f9-831b-2b3daec7fec7 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:05.639731 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f58aaa-6e21-4f92-9067-e451ca34de85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:05.640671 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f58aaa-6e21-4f92-9067-e451ca34de85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:05.645581 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f58aaa-6e21-4f92-9067-e451ca34de85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:05.645936 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f58aaa-6e21-4f92-9067-e451ca34de85 admin admin] PATH_INFO: `/v3/projects/5957586dc2a64c6198b9de6e0b1b4263/users/76fa659583f64bd8b1819130398ed961/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:05.709502 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f58aaa-6e21-4f92-9067-e451ca34de85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5957586dc2a64c6198b9de6e0b1b4263, user_id=76fa659583f64bd8b1819130398ed961, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:05.717726 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f58aaa-6e21-4f92-9067-e451ca34de85 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:05.781888 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 853/1707] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:42:05 2022] POST /identity/v3/users => generated 288 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:42:05.786430 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eef5094-cec7-47f9-831b-2b3daec7fec7 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:05.813392 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eef5094-cec7-47f9-831b-2b3daec7fec7 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:05.834101 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 855/1708] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:42:05 2022] PUT /identity/v3/projects/5957586dc2a64c6198b9de6e0b1b4263/users/76fa659583f64bd8b1819130398ed961/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:05.839532 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f58aaa-6e21-4f92-9067-e451ca34de85 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:06.042047 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c9e233-952e-4211-a95f-2d759ef8d0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:06.042776 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9e233-952e-4211-a95f-2d759ef8d0c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:06.043067 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9e233-952e-4211-a95f-2d759ef8d0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:06.043346 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9e233-952e-4211-a95f-2d759ef8d0c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:06.044105 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c9e233-952e-4211-a95f-2d759ef8d0c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:06.048722 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c9e233-952e-4211-a95f-2d759ef8d0c1 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:06.049430 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f58aaa-6e21-4f92-9067-e451ca34de85 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:06.067591 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3527ca1f-228c-4ab3-9cf4-b467bca8b7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:06.068914 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527ca1f-228c-4ab3-9cf4-b467bca8b7eb admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:06.069424 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527ca1f-228c-4ab3-9cf4-b467bca8b7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:06.069892 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527ca1f-228c-4ab3-9cf4-b467bca8b7eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:06.078210 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3527ca1f-228c-4ab3-9cf4-b467bca8b7eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:06.082395 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3527ca1f-228c-4ab3-9cf4-b467bca8b7eb admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:06.082880 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 854/1709] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:05 2022] GET /identity/v3/roles => generated 1420 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:42:06.091650 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c9e233-952e-4211-a95f-2d759ef8d0c1 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:06.105305 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c9e233-952e-4211-a95f-2d759ef8d0c1 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:06.120574 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8a5f3f-6c50-476a-ac9c-0f5c98c179d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:06.121384 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a5f3f-6c50-476a-ac9c-0f5c98c179d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:06.122188 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a5f3f-6c50-476a-ac9c-0f5c98c179d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:06.122188 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a5f3f-6c50-476a-ac9c-0f5c98c179d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:06.122743 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8a5f3f-6c50-476a-ac9c-0f5c98c179d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:06.124599 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8a5f3f-6c50-476a-ac9c-0f5c98c179d2 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:06.134453 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 856/1710] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:05 2022] GET /identity/v3/roles => generated 1420 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:42:06.142245 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3527ca1f-228c-4ab3-9cf4-b467bca8b7eb admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:06.171624 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 855/1711] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:06 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:42:06.172709 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8a5f3f-6c50-476a-ac9c-0f5c98c179d2 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:06.180561 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3527ca1f-228c-4ab3-9cf4-b467bca8b7eb admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:06.198393 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5cef7d-f668-439b-b612-c9e4da217a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:06.199624 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5cef7d-f668-439b-b612-c9e4da217a60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:06.201034 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8a5f3f-6c50-476a-ac9c-0f5c98c179d2 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:06.201196 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5cef7d-f668-439b-b612-c9e4da217a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:06.201560 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5cef7d-f668-439b-b612-c9e4da217a60 admin admin] PATH_INFO: `/v3/projects/5957586dc2a64c6198b9de6e0b1b4263/users/76fa659583f64bd8b1819130398ed961/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:06.205328 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5cef7d-f668-439b-b612-c9e4da217a60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5957586dc2a64c6198b9de6e0b1b4263, user_id=76fa659583f64bd8b1819130398ed961, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:06.208156 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5cef7d-f668-439b-b612-c9e4da217a60 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:06.214422 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0949f3b-0330-43e6-a6f9-cf6ab59c94af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:06.215451 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0949f3b-0330-43e6-a6f9-cf6ab59c94af admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:06.215633 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0949f3b-0330-43e6-a6f9-cf6ab59c94af admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:06.216422 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0949f3b-0330-43e6-a6f9-cf6ab59c94af admin admin] PATH_INFO: `/v3/projects/e0b03242dfed4080a0cde44bc4ebbd95/users/b0d277cd5b864c22acc3258624594832/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:06.241804 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 857/1712] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:42:06 2022] PUT /identity/v3/projects/5957586dc2a64c6198b9de6e0b1b4263/users/76fa659583f64bd8b1819130398ed961/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:06.257220 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ee4b5-5382-4687-9bd8-95b57e5ec3e3 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:06.257738 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ee4b5-5382-4687-9bd8-95b57e5ec3e3 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:06.258211 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ee4b5-5382-4687-9bd8-95b57e5ec3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:06.262885 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0949f3b-0330-43e6-a6f9-cf6ab59c94af admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0b03242dfed4080a0cde44bc4ebbd95, user_id=b0d277cd5b864c22acc3258624594832, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:06.265724 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0949f3b-0330-43e6-a6f9-cf6ab59c94af admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:06.325950 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-276ee4b5-5382-4687-9bd8-95b57e5ec3e3 None None] MFA Rules not processed for user `76fa659583f64bd8b1819130398ed961`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:06.341003 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-276ee4b5-5382-4687-9bd8-95b57e5ec3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:06.392904 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 856/1713] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:42:06 2022] PUT /identity/v3/projects/e0b03242dfed4080a0cde44bc4ebbd95/users/b0d277cd5b864c22acc3258624594832/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:06.397703 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d6ab3b-38b7-4288-b9b4-b9eecac78dcf None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:06.397992 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d6ab3b-38b7-4288-b9b4-b9eecac78dcf None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:06.398270 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d6ab3b-38b7-4288-b9b4-b9eecac78dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:06.512803 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-76d6ab3b-38b7-4288-b9b4-b9eecac78dcf None None] MFA Rules not processed for user `b0d277cd5b864c22acc3258624594832`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:06.514180 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-76d6ab3b-38b7-4288-b9b4-b9eecac78dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:06.553894 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:06.632290 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:06.696464 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 858/1714] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:42:06 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 441 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:42:06.711328 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276ee4b5-5382-4687-9bd8-95b57e5ec3e3 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:06.713548 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-276ee4b5-5382-4687-9bd8-95b57e5ec3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:06.716485 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 857/1715] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:42:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:06.720745 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d6ab3b-38b7-4288-b9b4-b9eecac78dcf None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:06.860649 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276ee4b5-5382-4687-9bd8-95b57e5ec3e3 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:06.862799 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d6ab3b-38b7-4288-b9b4-b9eecac78dcf None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:06.872881 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10244d78-0975-4af7-ae6e-55f788f43d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:06.873634 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10244d78-0975-4af7-ae6e-55f788f43d34 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:06.873912 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10244d78-0975-4af7-ae6e-55f788f43d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:06.875477 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10244d78-0975-4af7-ae6e-55f788f43d34 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:06.878413 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10244d78-0975-4af7-ae6e-55f788f43d34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:06.883789 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10244d78-0975-4af7-ae6e-55f788f43d34 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:06.998493 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd19ffc6-a33a-4e23-aef2-83cdae4d7272 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:07.008773 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd19ffc6-a33a-4e23-aef2-83cdae4d7272 service cinder] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:07.008773 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd19ffc6-a33a-4e23-aef2-83cdae4d7272 service cinder] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:07.008773 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd19ffc6-a33a-4e23-aef2-83cdae4d7272 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:07.032998 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:07.043930 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 858/1716] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:42:06 2022] POST /identity/v3/projects => generated 375 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:42:07.045251 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10244d78-0975-4af7-ae6e-55f788f43d34 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:07.049028 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-10244d78-0975-4af7-ae6e-55f788f43d34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:07.161464 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:07.211054 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd19ffc6-a33a-4e23-aef2-83cdae4d7272 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:07.215000 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd19ffc6-a33a-4e23-aef2-83cdae4d7272 service cinder] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:07.245003 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10244d78-0975-4af7-ae6e-55f788f43d34 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:07.263257 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 859/1717] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:06 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:42:07.271455 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd19ffc6-a33a-4e23-aef2-83cdae4d7272 service cinder] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:07.294650 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f2d5c-ffa1-4fb2-8820-09f3f4c6cc7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:07.294650 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f2d5c-ffa1-4fb2-8820-09f3f4c6cc7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:07.294650 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f2d5c-ffa1-4fb2-8820-09f3f4c6cc7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:07.294650 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f2d5c-ffa1-4fb2-8820-09f3f4c6cc7f admin admin] PATH_INFO: `/v3/projects/3a2cf0e205094e49be2285b4e29c979f` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:07.305098 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd19ffc6-a33a-4e23-aef2-83cdae4d7272 service cinder] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:07.305328 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5f2d5c-ffa1-4fb2-8820-09f3f4c6cc7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a2cf0e205094e49be2285b4e29c979f)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:07.310910 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66dd2ad-731d-41fc-8236-68cc8cf84745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:07.313596 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66dd2ad-731d-41fc-8236-68cc8cf84745 admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:07.313894 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66dd2ad-731d-41fc-8236-68cc8cf84745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:07.314250 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66dd2ad-731d-41fc-8236-68cc8cf84745 admin admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:07.315141 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66dd2ad-731d-41fc-8236-68cc8cf84745 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:07.321947 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66dd2ad-731d-41fc-8236-68cc8cf84745 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:07.327061 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5f2d5c-ffa1-4fb2-8820-09f3f4c6cc7f admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:07.476733 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 860/1718] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:42:07 2022] POST /identity/v3/users => generated 294 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:42:07.480583 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59799a5a-356e-4f92-867e-30d561657d99 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:07.481094 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59799a5a-356e-4f92-867e-30d561657d99 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:07.481513 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59799a5a-356e-4f92-867e-30d561657d99 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:07.487982 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 861/1719] 10.222.0.39 () {54 vars in 961 bytes} [Mon Jul 18 10:42:07 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:42:07.489147 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59799a5a-356e-4f92-867e-30d561657d99 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:07.502052 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:07.539209 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59799a5a-356e-4f92-867e-30d561657d99 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:07.560066 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf19a31-e4ca-49f2-a1ce-ecec39cbd9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:07.561431 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf19a31-e4ca-49f2-a1ce-ecec39cbd9e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:07.574731 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf19a31-e4ca-49f2-a1ce-ecec39cbd9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:07.575373 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf19a31-e4ca-49f2-a1ce-ecec39cbd9e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:07.576388 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf19a31-e4ca-49f2-a1ce-ecec39cbd9e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:07.580845 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf19a31-e4ca-49f2-a1ce-ecec39cbd9e3 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:07.595161 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-9f5f2d5c-ffa1-4fb2-8820-09f3f4c6cc7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a2cf0e205094e49be2285b4e29c979f', 'request_id': 'req-9f5f2d5c-ffa1-4fb2-8820-09f3f4c6cc7f'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:07.597723 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 862/1720] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:07 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:42:07.599548 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2743c2-ae68-4575-8711-53b795313b84 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:07.599947 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2743c2-ae68-4575-8711-53b795313b84 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:07.600508 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2743c2-ae68-4575-8711-53b795313b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:07.640473 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-9f5f2d5c-ffa1-4fb2-8820-09f3f4c6cc7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a2cf0e205094e49be2285b4e29c979f', 'request_id': 'req-9f5f2d5c-ffa1-4fb2-8820-09f3f4c6cc7f'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:07.652860 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-db2743c2-ae68-4575-8711-53b795313b84 None None] MFA Rules not processed for user `2330638e80a941cd9aeeb2fd615900d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:07.654146 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-9f5f2d5c-ffa1-4fb2-8820-09f3f4c6cc7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a2cf0e205094e49be2285b4e29c979f', 'request_id': 'req-9f5f2d5c-ffa1-4fb2-8820-09f3f4c6cc7f'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:07.654873 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-db2743c2-ae68-4575-8711-53b795313b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:07.660089 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:07.732198 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:07.768565 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-9f5f2d5c-ffa1-4fb2-8820-09f3f4c6cc7f admin admin] The token cache is being invalidate because project 3a2cf0e205094e49be2285b4e29c979f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:42:07.768865 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-9f5f2d5c-ffa1-4fb2-8820-09f3f4c6cc7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:07.777576 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-9f5f2d5c-ffa1-4fb2-8820-09f3f4c6cc7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:07.783017 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 859/1721] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:42:07 2022] DELETE /identity/v3/projects/3a2cf0e205094e49be2285b4e29c979f => generated 0 bytes in 738 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:07.787894 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f2d5c-ffa1-4fb2-8820-09f3f4c6cc7f admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:07.792759 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-9f5f2d5c-ffa1-4fb2-8820-09f3f4c6cc7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:07.845574 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 863/1722] 10.222.0.39 () {58 vars in 1058 bytes} [Mon Jul 18 10:42:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:07.845974 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2743c2-ae68-4575-8711-53b795313b84 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:07.847430 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-db2743c2-ae68-4575-8711-53b795313b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:07.924209 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f2d5c-ffa1-4fb2-8820-09f3f4c6cc7f admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:07.931615 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:07.939002 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb76f4dc-2370-4597-83b3-2e5558d86539 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:07.940437 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76f4dc-2370-4597-83b3-2e5558d86539 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:07.941492 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76f4dc-2370-4597-83b3-2e5558d86539 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:07.942277 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb76f4dc-2370-4597-83b3-2e5558d86539 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:07.958150 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-cb76f4dc-2370-4597-83b3-2e5558d86539 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:07.991420 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2743c2-ae68-4575-8711-53b795313b84 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:08.021642 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0a5997-7822-4d91-8331-52ef410a83c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:08.024653 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a5997-7822-4d91-8331-52ef410a83c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:08.024936 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a5997-7822-4d91-8331-52ef410a83c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:08.025260 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a5997-7822-4d91-8331-52ef410a83c2 admin admin] PATH_INFO: `/v3/projects/0baf522b73a54909950a304a024ceddf/users/86f517e68b184c77b040dabbe1e9f663/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:08.087803 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb76f4dc-2370-4597-83b3-2e5558d86539 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:08.089716 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb76f4dc-2370-4597-83b3-2e5558d86539 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:08.122043 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 860/1723] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:07 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:42:08.124350 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb76f4dc-2370-4597-83b3-2e5558d86539 service cinder] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:08.126425 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0a5997-7822-4d91-8331-52ef410a83c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0baf522b73a54909950a304a024ceddf, user_id=86f517e68b184c77b040dabbe1e9f663, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:08.130289 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-cb76f4dc-2370-4597-83b3-2e5558d86539 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:08.132146 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0a5997-7822-4d91-8331-52ef410a83c2 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:08.177125 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb76f4dc-2370-4597-83b3-2e5558d86539 service cinder] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:08.181736 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:08.198071 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2929624-51d3-47ce-a1ec-13f14a9e9b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:08.200328 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2929624-51d3-47ce-a1ec-13f14a9e9b23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:08.202474 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2929624-51d3-47ce-a1ec-13f14a9e9b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:08.207833 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2929624-51d3-47ce-a1ec-13f14a9e9b23 admin admin] PATH_INFO: `/v3/users/429c4fbd783d4fc080efa808234d7075` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:08.210580 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2929624-51d3-47ce-a1ec-13f14a9e9b23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=429c4fbd783d4fc080efa808234d7075)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:08.214293 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2929624-51d3-47ce-a1ec-13f14a9e9b23 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:08.278504 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 864/1724] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:42:07 2022] PUT /identity/v3/projects/0baf522b73a54909950a304a024ceddf/users/86f517e68b184c77b040dabbe1e9f663/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:08.286995 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afd5aa-5a88-445b-ad95-df2253b40bd8 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:08.286995 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afd5aa-5a88-445b-ad95-df2253b40bd8 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:08.286995 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68afd5aa-5a88-445b-ad95-df2253b40bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:08.370190 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-68afd5aa-5a88-445b-ad95-df2253b40bd8 None None] MFA Rules not processed for user `f94ab499b0c8447c9e9e4165b342757b`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:08.371454 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-68afd5aa-5a88-445b-ad95-df2253b40bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:08.477988 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-f2929624-51d3-47ce-a1ec-13f14a9e9b23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '429c4fbd783d4fc080efa808234d7075'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:08.581518 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-f2929624-51d3-47ce-a1ec-13f14a9e9b23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '429c4fbd783d4fc080efa808234d7075'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:08.585789 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-f2929624-51d3-47ce-a1ec-13f14a9e9b23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '429c4fbd783d4fc080efa808234d7075'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:08.590979 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 865/1725] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:42:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:08.592091 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68afd5aa-5a88-445b-ad95-df2253b40bd8 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:08.668705 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-f2929624-51d3-47ce-a1ec-13f14a9e9b23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '429c4fbd783d4fc080efa808234d7075'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:08.690415 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-f2929624-51d3-47ce-a1ec-13f14a9e9b23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '429c4fbd783d4fc080efa808234d7075'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:08.708204 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 861/1726] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:42:08 2022] DELETE /identity/v3/users/429c4fbd783d4fc080efa808234d7075 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:08.710428 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb6deb4-eae3-421b-8376-c13bea858933 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:08.710896 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb6deb4-eae3-421b-8376-c13bea858933 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:08.711622 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb6deb4-eae3-421b-8376-c13bea858933 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:08.717913 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 862/1727] 10.222.0.39 () {54 vars in 962 bytes} [Mon Jul 18 10:42:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:42:08.720289 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68afd5aa-5a88-445b-ad95-df2253b40bd8 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:08.724119 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb6deb4-eae3-421b-8376-c13bea858933 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:08.735820 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-3bb6deb4-eae3-421b-8376-c13bea858933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:08.786009 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:08.930373 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c00eab-c3fc-46e1-87bc-4da287939d46 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2330638e80a941cd9aeeb2fd615900d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:08.930373 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c00eab-c3fc-46e1-87bc-4da287939d46 service placement] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:08.930373 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c00eab-c3fc-46e1-87bc-4da287939d46 service placement] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:08.935088 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c00eab-c3fc-46e1-87bc-4da287939d46 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:08.938609 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-47c00eab-c3fc-46e1-87bc-4da287939d46 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:08.999112 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c00eab-c3fc-46e1-87bc-4da287939d46 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:09.003369 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb6deb4-eae3-421b-8376-c13bea858933 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:09.009622 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c00eab-c3fc-46e1-87bc-4da287939d46 service placement] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:09.033570 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa77863-e2d1-4cb3-87e0-aa8797a91248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:09.034506 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa77863-e2d1-4cb3-87e0-aa8797a91248 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:09.034896 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa77863-e2d1-4cb3-87e0-aa8797a91248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:09.035559 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa77863-e2d1-4cb3-87e0-aa8797a91248 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:09.036450 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa77863-e2d1-4cb3-87e0-aa8797a91248 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:09.050195 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa77863-e2d1-4cb3-87e0-aa8797a91248 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:09.078754 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 863/1728] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:08 2022] GET /identity/v3/roles => generated 1420 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:42:09.080049 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa77863-e2d1-4cb3-87e0-aa8797a91248 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:09.093003 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-3aa77863-e2d1-4cb3-87e0-aa8797a91248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:09.096922 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 866/1729] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:42:09.118062 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b839a1c-1839-4b4e-b0aa-662134b3f40d None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:09.118377 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b839a1c-1839-4b4e-b0aa-662134b3f40d None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:09.118676 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b839a1c-1839-4b4e-b0aa-662134b3f40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:09.185408 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-1b839a1c-1839-4b4e-b0aa-662134b3f40d None None] MFA Rules not processed for user `8bbebf16219943879df84bdc9a900516`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:09.198234 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-1b839a1c-1839-4b4e-b0aa-662134b3f40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:09.237687 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:09.333530 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa77863-e2d1-4cb3-87e0-aa8797a91248 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:09.366160 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb52bf8-b361-43d0-91b5-61dfa0ffdf49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bbebf16219943879df84bdc9a900516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:09.366851 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb52bf8-b361-43d0-91b5-61dfa0ffdf49 service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:09.368511 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb52bf8-b361-43d0-91b5-61dfa0ffdf49 service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:09.369526 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb52bf8-b361-43d0-91b5-61dfa0ffdf49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:09.382108 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-0fb52bf8-b361-43d0-91b5-61dfa0ffdf49 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:09.486788 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 867/1730] 10.222.0.39 () {58 vars in 1059 bytes} [Mon Jul 18 10:42:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:09.492274 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b839a1c-1839-4b4e-b0aa-662134b3f40d None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:09.560815 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b839a1c-1839-4b4e-b0aa-662134b3f40d None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:09.575374 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e658550-4f95-4013-901d-cb122cd6d092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:09.576375 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e658550-4f95-4013-901d-cb122cd6d092 admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:09.576661 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e658550-4f95-4013-901d-cb122cd6d092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:09.576938 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e658550-4f95-4013-901d-cb122cd6d092 admin admin] PATH_INFO: `/v3/projects/0baf522b73a54909950a304a024ceddf/users/86f517e68b184c77b040dabbe1e9f663/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:09.579667 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e658550-4f95-4013-901d-cb122cd6d092 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0baf522b73a54909950a304a024ceddf, user_id=86f517e68b184c77b040dabbe1e9f663, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:09.587553 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e658550-4f95-4013-901d-cb122cd6d092 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:09.594675 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb52bf8-b361-43d0-91b5-61dfa0ffdf49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:09.606643 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb52bf8-b361-43d0-91b5-61dfa0ffdf49 service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:09.614117 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 868/1731] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:42:09 2022] PUT /identity/v3/projects/0baf522b73a54909950a304a024ceddf/users/86f517e68b184c77b040dabbe1e9f663/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:09.628468 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e45f50-d30c-4274-96f4-87d42e1f8d9a None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:09.628997 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e45f50-d30c-4274-96f4-87d42e1f8d9a None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:09.629443 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e45f50-d30c-4274-96f4-87d42e1f8d9a None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:09.635982 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 869/1732] 10.222.0.39 () {54 vars in 912 bytes} [Mon Jul 18 10:42:09 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:42:09.638771 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de2666-51aa-4e7d-a978-67202e3f4ab7 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:09.639229 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de2666-51aa-4e7d-a978-67202e3f4ab7 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:09.639674 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de2666-51aa-4e7d-a978-67202e3f4ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:09.649140 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 864/1733] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:42:09.655138 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b41d3-7030-49a1-92c7-e0e575c005a1 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:09.655138 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b41d3-7030-49a1-92c7-e0e575c005a1 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:09.655526 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b41d3-7030-49a1-92c7-e0e575c005a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:09.688733 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-90de2666-51aa-4e7d-a978-67202e3f4ab7 None None] MFA Rules not processed for user `c3f7301abf3f4cd398b30ec9eae170dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:09.691139 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-90de2666-51aa-4e7d-a978-67202e3f4ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:09.753473 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-3a7b41d3-7030-49a1-92c7-e0e575c005a1 None None] MFA Rules not processed for user `86f517e68b184c77b040dabbe1e9f663`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:09.756192 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-3a7b41d3-7030-49a1-92c7-e0e575c005a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:09.860293 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 870/1734] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:42:09 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:09.863713 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e7007-70fd-4006-92e6-1a3776374af8 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:09.864064 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e7007-70fd-4006-92e6-1a3776374af8 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:09.868863 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e7007-70fd-4006-92e6-1a3776374af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:09.911206 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-b02e7007-70fd-4006-92e6-1a3776374af8 None None] MFA Rules not processed for user `8bbebf16219943879df84bdc9a900516`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:09.914632 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-b02e7007-70fd-4006-92e6-1a3776374af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:09.969216 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 865/1735] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:42:09 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:09.970997 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb529a99-c4f1-4693-8093-79d9ac9e166e None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:09.971288 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb529a99-c4f1-4693-8093-79d9ac9e166e None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:09.982331 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb529a99-c4f1-4693-8093-79d9ac9e166e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:10.053943 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-bb529a99-c4f1-4693-8093-79d9ac9e166e None None] MFA Rules not processed for user `8f6a43da18834f22b4422623ce0799ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:10.056520 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-bb529a99-c4f1-4693-8093-79d9ac9e166e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:10.103180 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 871/1736] 10.222.0.39 () {58 vars in 1009 bytes} [Mon Jul 18 10:42:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:10.118103 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e7007-70fd-4006-92e6-1a3776374af8 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:10.134538 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-b02e7007-70fd-4006-92e6-1a3776374af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:10.273953 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 866/1737] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:42:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:10.276681 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb529a99-c4f1-4693-8093-79d9ac9e166e None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:10.298031 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-bb529a99-c4f1-4693-8093-79d9ac9e166e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:10.343156 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:10.372971 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e7007-70fd-4006-92e6-1a3776374af8 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:10.393909 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d07c0e-d385-483c-b61a-f2f9b5f312d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:10.394826 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d07c0e-d385-483c-b61a-f2f9b5f312d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:10.396255 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d07c0e-d385-483c-b61a-f2f9b5f312d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:10.396646 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d07c0e-d385-483c-b61a-f2f9b5f312d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:10.397791 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d07c0e-d385-483c-b61a-f2f9b5f312d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:10.404219 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d07c0e-d385-483c-b61a-f2f9b5f312d7 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:10.412166 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:10.524676 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 872/1738] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:42:10 2022] POST /identity/v3/projects => generated 405 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:42:10.529805 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d07c0e-d385-483c-b61a-f2f9b5f312d7 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:10.551551 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-17d07c0e-d385-483c-b61a-f2f9b5f312d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:10.603746 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb529a99-c4f1-4693-8093-79d9ac9e166e None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:10.747564 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f6c9dd-05e1-49f5-a381-c68d738bd6c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:10.748635 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f6c9dd-05e1-49f5-a381-c68d738bd6c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:10.748738 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f6c9dd-05e1-49f5-a381-c68d738bd6c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:10.748986 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f6c9dd-05e1-49f5-a381-c68d738bd6c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:10.764368 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-87f6c9dd-05e1-49f5-a381-c68d738bd6c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:10.831952 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d07c0e-d385-483c-b61a-f2f9b5f312d7 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:10.849351 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f8ae80-d7b9-418f-9eee-245895168603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:10.850260 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8ae80-d7b9-418f-9eee-245895168603 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:10.850548 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8ae80-d7b9-418f-9eee-245895168603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:10.850827 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8ae80-d7b9-418f-9eee-245895168603 admin admin] PATH_INFO: `/v3/projects/446f4029b1744d5294a70016c6f9b445` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:10.863140 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f8ae80-d7b9-418f-9eee-245895168603 admin admin] RBAC: Authorizing `identity:delete_project(project_id=446f4029b1744d5294a70016c6f9b445)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:10.865163 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f8ae80-d7b9-418f-9eee-245895168603 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:10.988797 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f6c9dd-05e1-49f5-a381-c68d738bd6c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:10.990355 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f6c9dd-05e1-49f5-a381-c68d738bd6c9 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:11.013018 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 867/1739] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 738 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:42:11.014345 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f6c9dd-05e1-49f5-a381-c68d738bd6c9 service cinder] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:11.015994 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-87f6c9dd-05e1-49f5-a381-c68d738bd6c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:11.139485 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f6c9dd-05e1-49f5-a381-c68d738bd6c9 service cinder] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:11.146517 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-b3f8ae80-d7b9-418f-9eee-245895168603 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '446f4029b1744d5294a70016c6f9b445', 'request_id': 'req-b3f8ae80-d7b9-418f-9eee-245895168603'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:11.162141 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-b3f8ae80-d7b9-418f-9eee-245895168603 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '446f4029b1744d5294a70016c6f9b445', 'request_id': 'req-b3f8ae80-d7b9-418f-9eee-245895168603'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:11.179677 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-b3f8ae80-d7b9-418f-9eee-245895168603 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '446f4029b1744d5294a70016c6f9b445', 'request_id': 'req-b3f8ae80-d7b9-418f-9eee-245895168603'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:11.263332 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5851eb3-0aee-4514-b6eb-837ecd1ec17c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:11.264018 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5851eb3-0aee-4514-b6eb-837ecd1ec17c service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:11.264309 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5851eb3-0aee-4514-b6eb-837ecd1ec17c service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:11.267070 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-b3f8ae80-d7b9-418f-9eee-245895168603 admin admin] The token cache is being invalidate because project 446f4029b1744d5294a70016c6f9b445 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80392) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:42:11.267070 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-b3f8ae80-d7b9-418f-9eee-245895168603 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:11.267070 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-b3f8ae80-d7b9-418f-9eee-245895168603 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:11.267694 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5851eb3-0aee-4514-b6eb-837ecd1ec17c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:11.268069 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 873/1740] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:42:10 2022] DELETE /identity/v3/projects/446f4029b1744d5294a70016c6f9b445 => generated 0 bytes in 739 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:11.269533 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d6146-1081-4a84-aa8f-887b3c7d184d None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:11.269824 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d6146-1081-4a84-aa8f-887b3c7d184d None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:11.270100 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d6146-1081-4a84-aa8f-887b3c7d184d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:11.276450 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-a5851eb3-0aee-4514-b6eb-837ecd1ec17c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:11.335248 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:11.352072 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-9c5d6146-1081-4a84-aa8f-887b3c7d184d None None] MFA Rules not processed for user `8f6a43da18834f22b4422623ce0799ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:11.355614 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-9c5d6146-1081-4a84-aa8f-887b3c7d184d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:11.490400 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 874/1741] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:42:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:11.490400 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d6146-1081-4a84-aa8f-887b3c7d184d None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:11.492898 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-9c5d6146-1081-4a84-aa8f-887b3c7d184d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:11.499628 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5851eb3-0aee-4514-b6eb-837ecd1ec17c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:11.505266 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5851eb3-0aee-4514-b6eb-837ecd1ec17c service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:11.543259 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 868/1742] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:42:11.546517 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c47246-d35b-430b-955b-26e321eedacb None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:11.549140 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c47246-d35b-430b-955b-26e321eedacb None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:11.551260 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c47246-d35b-430b-955b-26e321eedacb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:11.622291 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-c3c47246-d35b-430b-955b-26e321eedacb None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:11.624301 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c3c47246-d35b-430b-955b-26e321eedacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:11.691074 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d6146-1081-4a84-aa8f-887b3c7d184d None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:11.706645 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0772c171-efd5-4242-a0a2-04f0a50b324e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:11.707854 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0772c171-efd5-4242-a0a2-04f0a50b324e admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:11.708142 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0772c171-efd5-4242-a0a2-04f0a50b324e admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:11.708423 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0772c171-efd5-4242-a0a2-04f0a50b324e admin admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:11.710735 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0772c171-efd5-4242-a0a2-04f0a50b324e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:11.716882 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0772c171-efd5-4242-a0a2-04f0a50b324e admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:11.731647 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 869/1743] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:42:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:11.732926 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c47246-d35b-430b-955b-26e321eedacb None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:11.735132 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c3c47246-d35b-430b-955b-26e321eedacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:11.759280 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c47246-d35b-430b-955b-26e321eedacb None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:11.766706 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d961fd0-732b-431b-b501-ffa523ea78ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bbebf16219943879df84bdc9a900516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:11.767664 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d961fd0-732b-431b-b501-ffa523ea78ab service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:11.770894 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d961fd0-732b-431b-b501-ffa523ea78ab service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:11.770894 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d961fd0-732b-431b-b501-ffa523ea78ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:11.770894 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-6d961fd0-732b-431b-b501-ffa523ea78ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:11.783392 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d961fd0-732b-431b-b501-ffa523ea78ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:11.785084 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d961fd0-732b-431b-b501-ffa523ea78ab service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:11.795460 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 870/1744] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:11 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:42:11.796721 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e89bd-53e0-4575-9c89-7e122af7ae61 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:11.799784 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e89bd-53e0-4575-9c89-7e122af7ae61 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:11.799784 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e89bd-53e0-4575-9c89-7e122af7ae61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:11.835624 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-c14e89bd-53e0-4575-9c89-7e122af7ae61 None None] MFA Rules not processed for user `b336af28da0742f5a66df010b8f5176a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:11.837086 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c14e89bd-53e0-4575-9c89-7e122af7ae61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:11.888827 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 875/1745] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:42:11 2022] POST /identity/v3/users => generated 309 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:42:11.889752 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61271046-d950-48b3-87c2-e74eb696b375 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:11.890049 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61271046-d950-48b3-87c2-e74eb696b375 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:11.890330 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61271046-d950-48b3-87c2-e74eb696b375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:11.937097 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-61271046-d950-48b3-87c2-e74eb696b375 None None] MFA Rules not processed for user `de532a6dce8247e79bd8285220297a50`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:11.945568 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-61271046-d950-48b3-87c2-e74eb696b375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:11.957722 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 871/1746] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:42:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:11.959538 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a39959-9f84-4263-ac9e-3589e0f48041 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:11.959920 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a39959-9f84-4263-ac9e-3589e0f48041 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:11.960780 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a39959-9f84-4263-ac9e-3589e0f48041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:11.997090 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-61a39959-9f84-4263-ac9e-3589e0f48041 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:11.999305 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-61a39959-9f84-4263-ac9e-3589e0f48041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:12.067006 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 872/1747] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:42:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:12.067879 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a39959-9f84-4263-ac9e-3589e0f48041 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:12.068032 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 876/1748] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:42:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:12.071171 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61271046-d950-48b3-87c2-e74eb696b375 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:12.076552 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-61271046-d950-48b3-87c2-e74eb696b375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:12.121027 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61271046-d950-48b3-87c2-e74eb696b375 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:12.132122 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02644716-5c33-4ef3-8b08-456f3d3634e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bbebf16219943879df84bdc9a900516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:12.133186 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02644716-5c33-4ef3-8b08-456f3d3634e6 service nova] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:12.133656 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02644716-5c33-4ef3-8b08-456f3d3634e6 service nova] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:12.133927 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:12.134299 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02644716-5c33-4ef3-8b08-456f3d3634e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:12.138643 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a39959-9f84-4263-ac9e-3589e0f48041 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:12.147443 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02644716-5c33-4ef3-8b08-456f3d3634e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:12.149922 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02644716-5c33-4ef3-8b08-456f3d3634e6 service nova] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:12.160440 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8c999-1643-4e57-bdba-1e65f316c023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:12.160440 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8c999-1643-4e57-bdba-1e65f316c023 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:12.161141 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8c999-1643-4e57-bdba-1e65f316c023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:12.161141 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d8c999-1643-4e57-bdba-1e65f316c023 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:12.162033 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d8c999-1643-4e57-bdba-1e65f316c023 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:12.165115 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d8c999-1643-4e57-bdba-1e65f316c023 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:12.168823 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 877/1749] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:12 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:42:12.170087 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02644716-5c33-4ef3-8b08-456f3d3634e6 service nova] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:12.182449 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 873/1750] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:12 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:42:12.188930 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8c999-1643-4e57-bdba-1e65f316c023 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:12.241932 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02644716-5c33-4ef3-8b08-456f3d3634e6 service nova] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:12.246071 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d8c999-1643-4e57-bdba-1e65f316c023 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:12.264402 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efc314e-78a1-4e47-89cd-51610c31258b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:12.264402 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc314e-78a1-4e47-89cd-51610c31258b admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:12.264402 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc314e-78a1-4e47-89cd-51610c31258b admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:12.264402 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc314e-78a1-4e47-89cd-51610c31258b admin admin] PATH_INFO: `/v3/domains` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:12.266734 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efc314e-78a1-4e47-89cd-51610c31258b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:42:12.267204 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efc314e-78a1-4e47-89cd-51610c31258b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:12.271109 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efc314e-78a1-4e47-89cd-51610c31258b admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:12.273531 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d213c-85a1-4dc8-8095-ed3909028f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:12.280797 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d213c-85a1-4dc8-8095-ed3909028f12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:12.284550 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d213c-85a1-4dc8-8095-ed3909028f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:12.287354 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d213c-85a1-4dc8-8095-ed3909028f12 admin admin] PATH_INFO: `/v3/projects/8920dd72183c4c15a864828906640222/users/42dfa7e9f3854ba4b0233520b75129cb/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:12.295117 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 878/1751] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 10:42:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:42:12.300886 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efc314e-78a1-4e47-89cd-51610c31258b admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:12.320039 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efc314e-78a1-4e47-89cd-51610c31258b admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:12.325651 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22da5f1-94de-4354-8c81-75350197e1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:12.326791 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22da5f1-94de-4354-8c81-75350197e1e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:12.327527 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22da5f1-94de-4354-8c81-75350197e1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:12.329113 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22da5f1-94de-4354-8c81-75350197e1e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:12.330688 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22da5f1-94de-4354-8c81-75350197e1e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:12.334951 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22da5f1-94de-4354-8c81-75350197e1e5 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:12.374780 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d213c-85a1-4dc8-8095-ed3909028f12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8920dd72183c4c15a864828906640222, user_id=42dfa7e9f3854ba4b0233520b75129cb, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:12.384130 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d213c-85a1-4dc8-8095-ed3909028f12 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:12.526979 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 879/1752] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:42:12 2022] POST /identity/v3/projects => generated 387 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:42:12.528693 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22da5f1-94de-4354-8c81-75350197e1e5 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:12.543487 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 874/1753] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:42:12 2022] PUT /identity/v3/projects/8920dd72183c4c15a864828906640222/users/42dfa7e9f3854ba4b0233520b75129cb/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:42:12.553847 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d213c-85a1-4dc8-8095-ed3909028f12 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:12.701737 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22da5f1-94de-4354-8c81-75350197e1e5 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:12.739308 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d213c-85a1-4dc8-8095-ed3909028f12 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:12.753919 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cef02e-4971-4df1-b138-ab0ab6d2f8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:12.754934 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cef02e-4971-4df1-b138-ab0ab6d2f8b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:12.759893 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cef02e-4971-4df1-b138-ab0ab6d2f8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:12.759893 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cef02e-4971-4df1-b138-ab0ab6d2f8b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:12.759893 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cef02e-4971-4df1-b138-ab0ab6d2f8b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:12.759893 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cef02e-4971-4df1-b138-ab0ab6d2f8b5 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:12.810510 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 875/1754] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:12 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:42:12.818487 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cef02e-4971-4df1-b138-ab0ab6d2f8b5 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:12.840823 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cef02e-4971-4df1-b138-ab0ab6d2f8b5 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:12.861369 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fedf76d-6ccd-4a5a-94ef-cdfb534fd2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:12.862851 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fedf76d-6ccd-4a5a-94ef-cdfb534fd2c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:12.863132 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fedf76d-6ccd-4a5a-94ef-cdfb534fd2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:12.863410 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fedf76d-6ccd-4a5a-94ef-cdfb534fd2c8 admin admin] PATH_INFO: `/v3/projects/8920dd72183c4c15a864828906640222/users/42dfa7e9f3854ba4b0233520b75129cb/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:12.873737 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fedf76d-6ccd-4a5a-94ef-cdfb534fd2c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8920dd72183c4c15a864828906640222, user_id=42dfa7e9f3854ba4b0233520b75129cb, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:12.879477 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5eac78-42d9-44f3-9c1b-ef990b739870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:12.880186 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5eac78-42d9-44f3-9c1b-ef990b739870 admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:12.880468 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5eac78-42d9-44f3-9c1b-ef990b739870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:12.887406 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5eac78-42d9-44f3-9c1b-ef990b739870 admin admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:12.888175 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5eac78-42d9-44f3-9c1b-ef990b739870 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:12.889361 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fedf76d-6ccd-4a5a-94ef-cdfb534fd2c8 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:12.892355 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5eac78-42d9-44f3-9c1b-ef990b739870 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:12.927928 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 876/1755] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:42:12 2022] PUT /identity/v3/projects/8920dd72183c4c15a864828906640222/users/42dfa7e9f3854ba4b0233520b75129cb/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:13.065235 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 880/1756] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:42:12 2022] POST /identity/v3/users => generated 294 bytes in 537 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:42:13.069632 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fedf76d-6ccd-4a5a-94ef-cdfb534fd2c8 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:13.201937 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:13.223882 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5eac78-42d9-44f3-9c1b-ef990b739870 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:13.225901 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-bb5eac78-42d9-44f3-9c1b-ef990b739870 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:13.243855 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fedf76d-6ccd-4a5a-94ef-cdfb534fd2c8 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:13.243985 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5eac78-42d9-44f3-9c1b-ef990b739870 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:13.249464 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd023a4-23f8-46a1-98c4-2030b036858c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:13.251833 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd023a4-23f8-46a1-98c4-2030b036858c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:13.252631 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a0824a-f2cc-4174-890d-50f33d6f8aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:13.252758 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd023a4-23f8-46a1-98c4-2030b036858c admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:13.253153 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd023a4-23f8-46a1-98c4-2030b036858c admin admin] PATH_INFO: `/v3/users/8c77c3c181a24851a5ca18cffbde3891` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:13.253561 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0824a-f2cc-4174-890d-50f33d6f8aba admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:13.253853 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0824a-f2cc-4174-890d-50f33d6f8aba admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:13.254254 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a0824a-f2cc-4174-890d-50f33d6f8aba admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:13.254760 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd023a4-23f8-46a1-98c4-2030b036858c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c77c3c181a24851a5ca18cffbde3891)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:13.255140 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a0824a-f2cc-4174-890d-50f33d6f8aba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:13.256807 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a0824a-f2cc-4174-890d-50f33d6f8aba admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:13.257824 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd023a4-23f8-46a1-98c4-2030b036858c admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:13.276087 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 877/1757] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 10:42:13.277268 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a0824a-f2cc-4174-890d-50f33d6f8aba admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:13.293096 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a0824a-f2cc-4174-890d-50f33d6f8aba admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:13.303315 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b399744-6063-4461-9220-e2958bc7a2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:13.303689 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b399744-6063-4461-9220-e2958bc7a2f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:13.304103 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b399744-6063-4461-9220-e2958bc7a2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:13.304299 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b399744-6063-4461-9220-e2958bc7a2f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:13.305676 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b399744-6063-4461-9220-e2958bc7a2f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:13.308203 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b399744-6063-4461-9220-e2958bc7a2f8 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:13.329545 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 878/1758] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:42:13.334238 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b399744-6063-4461-9220-e2958bc7a2f8 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:13.349634 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b399744-6063-4461-9220-e2958bc7a2f8 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:13.367886 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0adab3b-bddf-4ce0-b371-9d5589d3998c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:13.369030 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0adab3b-bddf-4ce0-b371-9d5589d3998c admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:13.369847 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0adab3b-bddf-4ce0-b371-9d5589d3998c admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:13.370374 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0adab3b-bddf-4ce0-b371-9d5589d3998c admin admin] PATH_INFO: `/v3/projects/9739e3d6689240a097a130e0458fb7a6/users/d7a8d9db575b48feb9c43bc661617a5d/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:13.396189 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0adab3b-bddf-4ce0-b371-9d5589d3998c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9739e3d6689240a097a130e0458fb7a6, user_id=d7a8d9db575b48feb9c43bc661617a5d, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:13.406827 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0adab3b-bddf-4ce0-b371-9d5589d3998c admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:13.513303 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 879/1759] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:42:13 2022] PUT /identity/v3/projects/9739e3d6689240a097a130e0458fb7a6/users/d7a8d9db575b48feb9c43bc661617a5d/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:13.514865 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126a87e-9c26-4119-beb3-f548659fe640 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:13.515158 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126a87e-9c26-4119-beb3-f548659fe640 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:13.516847 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126a87e-9c26-4119-beb3-f548659fe640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:13.551884 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-cfd023a4-23f8-46a1-98c4-2030b036858c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c77c3c181a24851a5ca18cffbde3891'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:13.577070 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-e126a87e-9c26-4119-beb3-f548659fe640 None None] MFA Rules not processed for user `d7a8d9db575b48feb9c43bc661617a5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:13.580566 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:13.581595 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-e126a87e-9c26-4119-beb3-f548659fe640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:13.642632 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-cfd023a4-23f8-46a1-98c4-2030b036858c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c77c3c181a24851a5ca18cffbde3891'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:13.643283 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-cfd023a4-23f8-46a1-98c4-2030b036858c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c77c3c181a24851a5ca18cffbde3891'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:13.670314 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-cfd023a4-23f8-46a1-98c4-2030b036858c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c77c3c181a24851a5ca18cffbde3891'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:13.693514 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-cfd023a4-23f8-46a1-98c4-2030b036858c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c77c3c181a24851a5ca18cffbde3891'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:13.710294 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 881/1760] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:42:13 2022] DELETE /identity/v3/users/8c77c3c181a24851a5ca18cffbde3891 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:13.714895 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f479b-d835-4a20-a13f-0bf698d73fe0 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:13.715192 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f479b-d835-4a20-a13f-0bf698d73fe0 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:13.715473 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3f479b-d835-4a20-a13f-0bf698d73fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:13.759747 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-8c3f479b-d835-4a20-a13f-0bf698d73fe0 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:13.765074 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-8c3f479b-d835-4a20-a13f-0bf698d73fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:13.838868 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 880/1761] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:42:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:13.845655 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe956b2-a22b-4363-9d53-d148e5a606b6 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:13.846059 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe956b2-a22b-4363-9d53-d148e5a606b6 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:13.846510 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe956b2-a22b-4363-9d53-d148e5a606b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:13.896877 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-abe956b2-a22b-4363-9d53-d148e5a606b6 None None] MFA Rules not processed for user `2f88e3a2b95e477bae1cc98e9e18dc24`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:13.898084 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-abe956b2-a22b-4363-9d53-d148e5a606b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:14.059043 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 881/1762] 10.222.0.39 () {58 vars in 1009 bytes} [Mon Jul 18 10:42:13 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:14.060198 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe956b2-a22b-4363-9d53-d148e5a606b6 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:14.067057 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-abe956b2-a22b-4363-9d53-d148e5a606b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:14.089816 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:14.091681 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 882/1763] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:42:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:42:14.120330 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f479b-d835-4a20-a13f-0bf698d73fe0 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:14.124358 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-8c3f479b-d835-4a20-a13f-0bf698d73fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:14.154702 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe956b2-a22b-4363-9d53-d148e5a606b6 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:14.154879 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3f479b-d835-4a20-a13f-0bf698d73fe0 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:14.158949 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1abe60-df33-4cda-9f52-fd5314e48384 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:14.164205 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1abe60-df33-4cda-9f52-fd5314e48384 service neutron] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:14.164544 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1abe60-df33-4cda-9f52-fd5314e48384 service neutron] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:14.164838 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1abe60-df33-4cda-9f52-fd5314e48384 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:14.166226 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d949ba5-7456-4bf6-8262-d18188db9eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:14.167602 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d949ba5-7456-4bf6-8262-d18188db9eaf admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:14.169812 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d949ba5-7456-4bf6-8262-d18188db9eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:14.170207 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d949ba5-7456-4bf6-8262-d18188db9eaf admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:14.173948 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d949ba5-7456-4bf6-8262-d18188db9eaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:14.179911 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d949ba5-7456-4bf6-8262-d18188db9eaf admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:14.191085 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1abe60-df33-4cda-9f52-fd5314e48384 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:14.192569 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1abe60-df33-4cda-9f52-fd5314e48384 service neutron] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:14.226550 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 883/1764] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:42:14.227471 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1abe60-df33-4cda-9f52-fd5314e48384 service neutron] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:14.263140 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1abe60-df33-4cda-9f52-fd5314e48384 service neutron] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:14.286505 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c5df3-06a2-4f36-a7c7-ffdee50c066c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:14.288523 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c5df3-06a2-4f36-a7c7-ffdee50c066c service neutron] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:14.288858 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c5df3-06a2-4f36-a7c7-ffdee50c066c service neutron] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:14.289329 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c5df3-06a2-4f36-a7c7-ffdee50c066c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:14.311663 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c5df3-06a2-4f36-a7c7-ffdee50c066c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:14.316037 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c5df3-06a2-4f36-a7c7-ffdee50c066c service neutron] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:14.344842 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 884/1765] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:42:14.412593 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 882/1766] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:42:14 2022] POST /identity/v3/projects => generated 387 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:42:14.419372 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c5df3-06a2-4f36-a7c7-ffdee50c066c service neutron] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:14.442172 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c5df3-06a2-4f36-a7c7-ffdee50c066c service neutron] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:14.546015 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b1526e-ec8c-48e2-9d7e-a67ce6bd1e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:14.547373 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b1526e-ec8c-48e2-9d7e-a67ce6bd1e9c admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:14.547672 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b1526e-ec8c-48e2-9d7e-a67ce6bd1e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:14.548061 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b1526e-ec8c-48e2-9d7e-a67ce6bd1e9c admin admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:14.549192 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b1526e-ec8c-48e2-9d7e-a67ce6bd1e9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:14.551515 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b1526e-ec8c-48e2-9d7e-a67ce6bd1e9c admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:14.818936 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 885/1767] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:42:14 2022] POST /identity/v3/users => generated 294 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:42:14.827699 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d949ba5-7456-4bf6-8262-d18188db9eaf admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:14.890015 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d949ba5-7456-4bf6-8262-d18188db9eaf admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:14.910237 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d933d8-2278-433d-aa66-a75e02df145a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:14.914032 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d933d8-2278-433d-aa66-a75e02df145a admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:14.914357 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d933d8-2278-433d-aa66-a75e02df145a admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:14.914644 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d933d8-2278-433d-aa66-a75e02df145a admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:14.916016 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d933d8-2278-433d-aa66-a75e02df145a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:14.925779 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d933d8-2278-433d-aa66-a75e02df145a admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:14.952021 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 883/1768] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:42:14.956577 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b1526e-ec8c-48e2-9d7e-a67ce6bd1e9c admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:14.974310 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b1526e-ec8c-48e2-9d7e-a67ce6bd1e9c admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:14.985993 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49239bea-1fe8-42e3-8492-d3be9fd82d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:14.986701 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49239bea-1fe8-42e3-8492-d3be9fd82d00 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:14.986988 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49239bea-1fe8-42e3-8492-d3be9fd82d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:14.987963 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49239bea-1fe8-42e3-8492-d3be9fd82d00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:14.988867 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49239bea-1fe8-42e3-8492-d3be9fd82d00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:14.992065 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e797c2-2966-4110-a976-8df00c799648 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:14.992358 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e797c2-2966-4110-a976-8df00c799648 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:14.992638 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e797c2-2966-4110-a976-8df00c799648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:15.011533 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49239bea-1fe8-42e3-8492-d3be9fd82d00 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:15.059338 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 886/1769] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:42:15.060270 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49239bea-1fe8-42e3-8492-d3be9fd82d00 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:15.097419 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49239bea-1fe8-42e3-8492-d3be9fd82d00 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:15.107787 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e44d531-e3a4-4657-9643-acd1dbd07dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:15.108691 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44d531-e3a4-4657-9643-acd1dbd07dce admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:15.108980 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44d531-e3a4-4657-9643-acd1dbd07dce admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:15.113211 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44d531-e3a4-4657-9643-acd1dbd07dce admin admin] PATH_INFO: `/v3/projects/832c4d8926d94e2492f21c4117d2f413/users/98bd9c5463c646f3a9ae86cad0645649/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:15.185033 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-14e797c2-2966-4110-a976-8df00c799648 None None] MFA Rules not processed for user `88ad60446c5447a8bbd0096fa2133efb`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:15.191065 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-14e797c2-2966-4110-a976-8df00c799648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:15.203636 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e44d531-e3a4-4657-9643-acd1dbd07dce admin admin] RBAC: Authorizing `identity:create_grant(project_id=832c4d8926d94e2492f21c4117d2f413, user_id=98bd9c5463c646f3a9ae86cad0645649, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:15.209470 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e44d531-e3a4-4657-9643-acd1dbd07dce admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:15.356180 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 887/1770] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:42:15 2022] PUT /identity/v3/projects/832c4d8926d94e2492f21c4117d2f413/users/98bd9c5463c646f3a9ae86cad0645649/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:15.366761 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93d31d-f75c-400f-9f55-5cbdf3fdcb06 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:15.367349 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93d31d-f75c-400f-9f55-5cbdf3fdcb06 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:15.367981 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93d31d-f75c-400f-9f55-5cbdf3fdcb06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:15.393583 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 884/1771] 10.222.0.39 () {58 vars in 1009 bytes} [Mon Jul 18 10:42:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:15.407441 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-cf93d31d-f75c-400f-9f55-5cbdf3fdcb06 None None] MFA Rules not processed for user `98bd9c5463c646f3a9ae86cad0645649`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:15.408976 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-cf93d31d-f75c-400f-9f55-5cbdf3fdcb06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:15.558140 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 888/1772] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:42:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:15.566210 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e797c2-2966-4110-a976-8df00c799648 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:15.626306 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e797c2-2966-4110-a976-8df00c799648 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:15.868419 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76b5a32-2e86-44d3-99a4-859d90d717aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:15.874296 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b5a32-2e86-44d3-99a4-859d90d717aa admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:15.874296 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b5a32-2e86-44d3-99a4-859d90d717aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:15.874296 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b5a32-2e86-44d3-99a4-859d90d717aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:15.874296 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76b5a32-2e86-44d3-99a4-859d90d717aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:15.878822 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76b5a32-2e86-44d3-99a4-859d90d717aa admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:16.061967 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93d31d-f75c-400f-9f55-5cbdf3fdcb06 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:16.061967 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-cf93d31d-f75c-400f-9f55-5cbdf3fdcb06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:16.121592 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 885/1773] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:42:15 2022] POST /identity/v3/projects => generated 385 bytes in 557 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:42:16.122555 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76b5a32-2e86-44d3-99a4-859d90d717aa admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:16.129819 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-f76b5a32-2e86-44d3-99a4-859d90d717aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:16.198106 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:16.290568 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76b5a32-2e86-44d3-99a4-859d90d717aa admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:16.304524 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f09976-283a-42a2-a4fc-25c48859e59a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:16.305505 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f09976-283a-42a2-a4fc-25c48859e59a service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:16.305801 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f09976-283a-42a2-a4fc-25c48859e59a service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:16.306068 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f09976-283a-42a2-a4fc-25c48859e59a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:16.308393 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-89f09976-283a-42a2-a4fc-25c48859e59a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:16.344716 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93d31d-f75c-400f-9f55-5cbdf3fdcb06 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:16.477033 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f09976-283a-42a2-a4fc-25c48859e59a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:16.478622 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f09976-283a-42a2-a4fc-25c48859e59a service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:16.488482 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6603fdc-a089-4cd0-84b3-ac2875f91384 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c548474a8d94591ba58dd40e40a28d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:16.490185 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6603fdc-a089-4cd0-84b3-ac2875f91384 service swift] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:16.494013 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6603fdc-a089-4cd0-84b3-ac2875f91384 service swift] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:16.494013 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6603fdc-a089-4cd0-84b3-ac2875f91384 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:16.503528 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 886/1774] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:16 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:42:16.504778 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f09976-283a-42a2-a4fc-25c48859e59a service cinder] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:16.626440 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=87,keystone:INSERT=5,keystone:DELETE=8 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:16.651724 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f09976-283a-42a2-a4fc-25c48859e59a service cinder] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:16.665351 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6603fdc-a089-4cd0-84b3-ac2875f91384 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:16.667932 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5003b7e4-64f8-4804-89b2-5eb3197d9a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:16.668645 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003b7e4-64f8-4804-89b2-5eb3197d9a07 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:16.668934 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003b7e4-64f8-4804-89b2-5eb3197d9a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:16.669236 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003b7e4-64f8-4804-89b2-5eb3197d9a07 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:16.670237 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5003b7e4-64f8-4804-89b2-5eb3197d9a07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:16.671182 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6603fdc-a089-4cd0-84b3-ac2875f91384 service swift] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:16.674363 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5003b7e4-64f8-4804-89b2-5eb3197d9a07 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:16.711983 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 889/1775] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Jul 18 10:42:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 656 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 18 10:42:16.833681 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 887/1776] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:42:16 2022] POST /identity/v3/users => generated 299 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:42:16.838276 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6603fdc-a089-4cd0-84b3-ac2875f91384 service swift] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:16.893474 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6603fdc-a089-4cd0-84b3-ac2875f91384 service swift] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:16.932718 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3188f123-f035-4915-aff8-b3fe6a64d96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:16.934048 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3188f123-f035-4915-aff8-b3fe6a64d96d admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:16.938407 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3188f123-f035-4915-aff8-b3fe6a64d96d admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:16.939092 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3188f123-f035-4915-aff8-b3fe6a64d96d admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:16.941863 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3188f123-f035-4915-aff8-b3fe6a64d96d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:16.946758 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3188f123-f035-4915-aff8-b3fe6a64d96d admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:17.069590 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5003b7e4-64f8-4804-89b2-5eb3197d9a07 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:17.072580 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 890/1777] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:42:17.098799 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5003b7e4-64f8-4804-89b2-5eb3197d9a07 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:17.124831 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f281a-2687-4197-a77a-7962c14649b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:17.132047 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f281a-2687-4197-a77a-7962c14649b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:17.148068 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f281a-2687-4197-a77a-7962c14649b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:17.149547 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f281a-2687-4197-a77a-7962c14649b0 admin admin] PATH_INFO: `/v3/projects/9cc5a36866d44f579c8903936cadca70/users/dd5edf5fd3864e03a4402e9c31fa67c7/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:17.237846 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3188f123-f035-4915-aff8-b3fe6a64d96d admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:17.243073 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-3188f123-f035-4915-aff8-b3fe6a64d96d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:17.249570 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f281a-2687-4197-a77a-7962c14649b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cc5a36866d44f579c8903936cadca70, user_id=dd5edf5fd3864e03a4402e9c31fa67c7, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:17.263694 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f281a-2687-4197-a77a-7962c14649b0 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:17.276331 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3188f123-f035-4915-aff8-b3fe6a64d96d admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:17.300605 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b11eec-6c0f-4bfd-a071-b49a550653e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:17.304411 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b11eec-6c0f-4bfd-a071-b49a550653e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:17.306768 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b11eec-6c0f-4bfd-a071-b49a550653e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:17.309874 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b11eec-6c0f-4bfd-a071-b49a550653e8 admin admin] PATH_INFO: `/v3/projects/2c8270c318a24bfd8df76c9ba81c4067` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:17.313298 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b11eec-6c0f-4bfd-a071-b49a550653e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c8270c318a24bfd8df76c9ba81c4067)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:17.321450 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b11eec-6c0f-4bfd-a071-b49a550653e8 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:17.381602 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 888/1778] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:42:17 2022] PUT /identity/v3/projects/9cc5a36866d44f579c8903936cadca70/users/dd5edf5fd3864e03a4402e9c31fa67c7/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:17.384910 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f281a-2687-4197-a77a-7962c14649b0 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:17.796093 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f281a-2687-4197-a77a-7962c14649b0 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:17.832144 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-a8b11eec-6c0f-4bfd-a071-b49a550653e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c8270c318a24bfd8df76c9ba81c4067', 'request_id': 'req-a8b11eec-6c0f-4bfd-a071-b49a550653e8'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:17.855909 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-a8b11eec-6c0f-4bfd-a071-b49a550653e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c8270c318a24bfd8df76c9ba81c4067', 'request_id': 'req-a8b11eec-6c0f-4bfd-a071-b49a550653e8'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:17.885754 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-a8b11eec-6c0f-4bfd-a071-b49a550653e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c8270c318a24bfd8df76c9ba81c4067', 'request_id': 'req-a8b11eec-6c0f-4bfd-a071-b49a550653e8'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:18.008398 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-a8b11eec-6c0f-4bfd-a071-b49a550653e8 admin admin] The token cache is being invalidate because project 2c8270c318a24bfd8df76c9ba81c4067 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80392) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:42:18.008398 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-a8b11eec-6c0f-4bfd-a071-b49a550653e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:18.010414 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-a8b11eec-6c0f-4bfd-a071-b49a550653e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:18.026467 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 891/1779] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:42:17 2022] DELETE /identity/v3/projects/2c8270c318a24bfd8df76c9ba81c4067 => generated 0 bytes in 776 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:18.028511 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc533f-8f0c-4f32-8ee4-bcb641a5bc24 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:18.037275 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc533f-8f0c-4f32-8ee4-bcb641a5bc24 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:18.042999 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc533f-8f0c-4f32-8ee4-bcb641a5bc24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:18.141837 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d744d1c-60a4-4211-a92a-f288ee64e776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:18.145261 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d744d1c-60a4-4211-a92a-f288ee64e776 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:18.151218 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d744d1c-60a4-4211-a92a-f288ee64e776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:18.151624 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d744d1c-60a4-4211-a92a-f288ee64e776 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:18.156618 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d744d1c-60a4-4211-a92a-f288ee64e776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:18.169705 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-bacc533f-8f0c-4f32-8ee4-bcb641a5bc24 None None] MFA Rules not processed for user `42dfa7e9f3854ba4b0233520b75129cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:18.169705 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-bacc533f-8f0c-4f32-8ee4-bcb641a5bc24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:18.169961 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d744d1c-60a4-4211-a92a-f288ee64e776 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:18.233595 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:18.237152 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 889/1780] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:17 2022] GET /identity/v3/roles => generated 1420 bytes in 855 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:42:18.240634 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d744d1c-60a4-4211-a92a-f288ee64e776 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:18.243245 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-5d744d1c-60a4-4211-a92a-f288ee64e776 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:18.310858 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d744d1c-60a4-4211-a92a-f288ee64e776 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:18.332575 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1fdd2f-8b8d-438f-b302-ad0eb3938603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:18.333758 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1fdd2f-8b8d-438f-b302-ad0eb3938603 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:18.334233 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1fdd2f-8b8d-438f-b302-ad0eb3938603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:18.334653 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1fdd2f-8b8d-438f-b302-ad0eb3938603 admin admin] PATH_INFO: `/v3/users/76fa659583f64bd8b1819130398ed961` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:18.339835 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1fdd2f-8b8d-438f-b302-ad0eb3938603 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76fa659583f64bd8b1819130398ed961)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:18.342055 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1fdd2f-8b8d-438f-b302-ad0eb3938603 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:18.469693 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 892/1781] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:42:18 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 438 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:18.469693 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7ca6c-fa2c-4a83-8735-0e6c87ef22ab None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:18.469693 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7ca6c-fa2c-4a83-8735-0e6c87ef22ab None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:18.469693 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7ca6c-fa2c-4a83-8735-0e6c87ef22ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:18.698955 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-98b7ca6c-fa2c-4a83-8735-0e6c87ef22ab None None] MFA Rules not processed for user `f94ab499b0c8447c9e9e4165b342757b`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:18.698955 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-98b7ca6c-fa2c-4a83-8735-0e6c87ef22ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:18.698955 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 893/1782] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:42:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:18.698955 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b7ca6c-fa2c-4a83-8735-0e6c87ef22ab None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:18.698955 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-98b7ca6c-fa2c-4a83-8735-0e6c87ef22ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:18.703845 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b7ca6c-fa2c-4a83-8735-0e6c87ef22ab None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:18.712124 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a479aee9-abe5-4405-88e7-65ea47eca1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:18.713926 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479aee9-abe5-4405-88e7-65ea47eca1d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:18.714494 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479aee9-abe5-4405-88e7-65ea47eca1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:18.715024 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479aee9-abe5-4405-88e7-65ea47eca1d1 admin admin] PATH_INFO: `/v3/projects/9cc5a36866d44f579c8903936cadca70/users/dd5edf5fd3864e03a4402e9c31fa67c7/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:18.718186 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a479aee9-abe5-4405-88e7-65ea47eca1d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cc5a36866d44f579c8903936cadca70, user_id=dd5edf5fd3864e03a4402e9c31fa67c7, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:18.722445 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a479aee9-abe5-4405-88e7-65ea47eca1d1 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:18.747897 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 894/1783] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:42:18 2022] PUT /identity/v3/projects/9cc5a36866d44f579c8903936cadca70/users/dd5edf5fd3864e03a4402e9c31fa67c7/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:18.785932 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e0a91a-d2f2-475b-915a-6b1c9c13ddb4 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:18.795110 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e0a91a-d2f2-475b-915a-6b1c9c13ddb4 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:18.795110 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e0a91a-d2f2-475b-915a-6b1c9c13ddb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:18.904924 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-e5e0a91a-d2f2-475b-915a-6b1c9c13ddb4 None None] MFA Rules not processed for user `dd5edf5fd3864e03a4402e9c31fa67c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:18.910589 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-e5e0a91a-d2f2-475b-915a-6b1c9c13ddb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:19.098266 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 895/1784] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:42:18 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:19.115203 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e0a91a-d2f2-475b-915a-6b1c9c13ddb4 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:19.118251 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-e5e0a91a-d2f2-475b-915a-6b1c9c13ddb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:19.234929 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e0a91a-d2f2-475b-915a-6b1c9c13ddb4 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:19.246173 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-2d1fdd2f-8b8d-438f-b302-ad0eb3938603 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76fa659583f64bd8b1819130398ed961'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:19.254421 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575198e-6aed-43bf-a3ee-67a3b3a30620 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:19.259280 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575198e-6aed-43bf-a3ee-67a3b3a30620 service cinder] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:19.271075 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575198e-6aed-43bf-a3ee-67a3b3a30620 service cinder] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:19.271075 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575198e-6aed-43bf-a3ee-67a3b3a30620 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:19.281950 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a575198e-6aed-43bf-a3ee-67a3b3a30620 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:19.284219 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a575198e-6aed-43bf-a3ee-67a3b3a30620 service cinder] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:19.320303 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 896/1785] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:19 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:42:19.322609 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd7150f-97b6-4907-ab2c-7a26ef5a1504 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:19.323202 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd7150f-97b6-4907-ab2c-7a26ef5a1504 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:19.323701 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd7150f-97b6-4907-ab2c-7a26ef5a1504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:19.359705 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-3cd7150f-97b6-4907-ab2c-7a26ef5a1504 None None] MFA Rules not processed for user `2f88e3a2b95e477bae1cc98e9e18dc24`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:19.368645 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-3cd7150f-97b6-4907-ab2c-7a26ef5a1504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:19.399247 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-2d1fdd2f-8b8d-438f-b302-ad0eb3938603 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76fa659583f64bd8b1819130398ed961'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:19.402035 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-2d1fdd2f-8b8d-438f-b302-ad0eb3938603 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76fa659583f64bd8b1819130398ed961'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:19.452311 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-2d1fdd2f-8b8d-438f-b302-ad0eb3938603 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76fa659583f64bd8b1819130398ed961'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:19.484782 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-2d1fdd2f-8b8d-438f-b302-ad0eb3938603 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76fa659583f64bd8b1819130398ed961'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:19.501971 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 890/1786] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:42:18 2022] DELETE /identity/v3/users/76fa659583f64bd8b1819130398ed961 => generated 0 bytes in 1264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:19.539182 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 897/1787] 10.222.0.61 () {58 vars in 1015 bytes} [Mon Jul 18 10:42:19 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:19.635263 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1fdd2f-8b8d-438f-b302-ad0eb3938603 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:19.638151 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-2d1fdd2f-8b8d-438f-b302-ad0eb3938603 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:19.884384 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1fdd2f-8b8d-438f-b302-ad0eb3938603 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:19.886275 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2a682-77bb-4374-88e7-74efab461ad3 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:19.886694 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2a682-77bb-4374-88e7-74efab461ad3 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:19.887046 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2a682-77bb-4374-88e7-74efab461ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:19.895864 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941430b0-92e1-4e8d-8f44-813177289a20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:19.896546 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941430b0-92e1-4e8d-8f44-813177289a20 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:19.898068 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941430b0-92e1-4e8d-8f44-813177289a20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:19.899083 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941430b0-92e1-4e8d-8f44-813177289a20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:19.926458 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941430b0-92e1-4e8d-8f44-813177289a20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:19.928073 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941430b0-92e1-4e8d-8f44-813177289a20 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:19.949617 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-dab2a682-77bb-4374-88e7-74efab461ad3 None None] MFA Rules not processed for user `b336af28da0742f5a66df010b8f5176a`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:19.951394 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-dab2a682-77bb-4374-88e7-74efab461ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:19.969212 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 891/1788] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:42:20.058734 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:20.201717 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 898/1789] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:42:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:20.277418 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:21.469214 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941430b0-92e1-4e8d-8f44-813177289a20 service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:21.470849 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-941430b0-92e1-4e8d-8f44-813177289a20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:21.642015 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941430b0-92e1-4e8d-8f44-813177289a20 service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:21.662350 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f11a73-cde9-4e48-b01a-48dd7fc031a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:21.663318 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f11a73-cde9-4e48-b01a-48dd7fc031a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:21.663753 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f11a73-cde9-4e48-b01a-48dd7fc031a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:21.664184 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f11a73-cde9-4e48-b01a-48dd7fc031a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:21.666589 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-d4f11a73-cde9-4e48-b01a-48dd7fc031a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:21.698285 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=86,keystone:INSERT=5,keystone:DELETE=9 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:21.854946 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f11a73-cde9-4e48-b01a-48dd7fc031a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:21.856644 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f11a73-cde9-4e48-b01a-48dd7fc031a6 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:21.871084 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:21.875886 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 892/1790] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:42:22.214398 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d685550-b175-42cb-a13a-fa6042c22cb9 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:22.214851 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d685550-b175-42cb-a13a-fa6042c22cb9 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:22.215239 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d685550-b175-42cb-a13a-fa6042c22cb9 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:22.217372 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 899/1791] 10.222.0.39 () {54 vars in 921 bytes} [Mon Jul 18 10:42:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:42:22.247750 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:22.350968 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106dffc0-7c1f-48e9-bd85-b8aeab585779 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:22.350968 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106dffc0-7c1f-48e9-bd85-b8aeab585779 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:22.350968 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106dffc0-7c1f-48e9-bd85-b8aeab585779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:22.396556 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-106dffc0-7c1f-48e9-bd85-b8aeab585779 None None] MFA Rules not processed for user `2330638e80a941cd9aeeb2fd615900d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:22.399136 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-106dffc0-7c1f-48e9-bd85-b8aeab585779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:22.664837 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 893/1792] 10.222.0.39 () {58 vars in 1018 bytes} [Mon Jul 18 10:42:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:22.763273 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d685550-b175-42cb-a13a-fa6042c22cb9 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:22.765631 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-1d685550-b175-42cb-a13a-fa6042c22cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:22.793499 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d685550-b175-42cb-a13a-fa6042c22cb9 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:22.811042 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ba900-33fc-4ea8-adc5-f4383332e267 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2330638e80a941cd9aeeb2fd615900d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:22.812717 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ba900-33fc-4ea8-adc5-f4383332e267 service placement] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:22.812925 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ba900-33fc-4ea8-adc5-f4383332e267 service placement] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:22.813227 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ba900-33fc-4ea8-adc5-f4383332e267 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:22.842707 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3ba900-33fc-4ea8-adc5-f4383332e267 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:22.844674 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3ba900-33fc-4ea8-adc5-f4383332e267 service placement] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:22.912357 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 900/1793] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:42:23.044567 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106dffc0-7c1f-48e9-bd85-b8aeab585779 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:23.047040 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-106dffc0-7c1f-48e9-bd85-b8aeab585779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:23.262276 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106dffc0-7c1f-48e9-bd85-b8aeab585779 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:23.278260 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aeb5af-66ae-4676-8da5-f369cd92eb02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:23.279519 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aeb5af-66ae-4676-8da5-f369cd92eb02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:23.280015 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aeb5af-66ae-4676-8da5-f369cd92eb02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:23.281105 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aeb5af-66ae-4676-8da5-f369cd92eb02 admin admin] PATH_INFO: `/v3/projects/5957586dc2a64c6198b9de6e0b1b4263` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:23.283097 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aeb5af-66ae-4676-8da5-f369cd92eb02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5957586dc2a64c6198b9de6e0b1b4263)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:23.285503 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:23.289270 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aeb5af-66ae-4676-8da5-f369cd92eb02 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:23.463212 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-55aeb5af-66ae-4676-8da5-f369cd92eb02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5957586dc2a64c6198b9de6e0b1b4263', 'request_id': 'req-55aeb5af-66ae-4676-8da5-f369cd92eb02'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:23.470987 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-55aeb5af-66ae-4676-8da5-f369cd92eb02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5957586dc2a64c6198b9de6e0b1b4263', 'request_id': 'req-55aeb5af-66ae-4676-8da5-f369cd92eb02'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:23.480017 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-55aeb5af-66ae-4676-8da5-f369cd92eb02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5957586dc2a64c6198b9de6e0b1b4263', 'request_id': 'req-55aeb5af-66ae-4676-8da5-f369cd92eb02'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:23.574700 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-55aeb5af-66ae-4676-8da5-f369cd92eb02 admin admin] The token cache is being invalidate because project 5957586dc2a64c6198b9de6e0b1b4263 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:42:23.574700 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-55aeb5af-66ae-4676-8da5-f369cd92eb02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:23.574700 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-55aeb5af-66ae-4676-8da5-f369cd92eb02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:23.574700 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 894/1794] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:42:23 2022] DELETE /identity/v3/projects/5957586dc2a64c6198b9de6e0b1b4263 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:23.576732 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02c46c-6054-4026-80f2-3ec10f6db8e0 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:23.577080 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02c46c-6054-4026-80f2-3ec10f6db8e0 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:23.578474 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02c46c-6054-4026-80f2-3ec10f6db8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:23.621505 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-4e02c46c-6054-4026-80f2-3ec10f6db8e0 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:23.622932 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-4e02c46c-6054-4026-80f2-3ec10f6db8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:23.809944 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 901/1795] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:42:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:23.819265 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b91da-0c3c-471f-90a7-ade5abddd40a None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:23.819761 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b91da-0c3c-471f-90a7-ade5abddd40a None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:23.819842 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b91da-0c3c-471f-90a7-ade5abddd40a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:23.859178 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-785b91da-0c3c-471f-90a7-ade5abddd40a None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:23.869494 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-785b91da-0c3c-471f-90a7-ade5abddd40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:23.901425 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 895/1796] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:42:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:23.902532 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e02c46c-6054-4026-80f2-3ec10f6db8e0 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:23.922119 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e02c46c-6054-4026-80f2-3ec10f6db8e0 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:23.941822 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b93142-6cf1-437b-b69e-3334d0baec7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:23.941822 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b93142-6cf1-437b-b69e-3334d0baec7a admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:23.941822 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b93142-6cf1-437b-b69e-3334d0baec7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:23.941822 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b93142-6cf1-437b-b69e-3334d0baec7a admin admin] PATH_INFO: `/v3/domains` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:23.942850 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b93142-6cf1-437b-b69e-3334d0baec7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:42:23.942850 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b93142-6cf1-437b-b69e-3334d0baec7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:23.944328 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b93142-6cf1-437b-b69e-3334d0baec7a admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:24.005918 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 902/1797] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 10:42:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:42:24.010401 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b91da-0c3c-471f-90a7-ade5abddd40a None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:24.027694 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b91da-0c3c-471f-90a7-ade5abddd40a None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:24.046136 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971cfeb1-51c1-4386-9e83-2e24a5b755c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:24.047555 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971cfeb1-51c1-4386-9e83-2e24a5b755c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:24.049089 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971cfeb1-51c1-4386-9e83-2e24a5b755c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:24.050180 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971cfeb1-51c1-4386-9e83-2e24a5b755c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:24.052074 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971cfeb1-51c1-4386-9e83-2e24a5b755c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:24.056419 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971cfeb1-51c1-4386-9e83-2e24a5b755c2 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:24.410490 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b93142-6cf1-437b-b69e-3334d0baec7a admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:24.412359 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 896/1798] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:42:24 2022] POST /identity/v3/projects => generated 381 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:42:24.426196 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b93142-6cf1-437b-b69e-3334d0baec7a admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:24.649775 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d7c29-a0bb-4e4c-b6f6-8d8de5e4d1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:24.650732 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d7c29-a0bb-4e4c-b6f6-8d8de5e4d1ce admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:24.651223 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d7c29-a0bb-4e4c-b6f6-8d8de5e4d1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:24.651761 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d7c29-a0bb-4e4c-b6f6-8d8de5e4d1ce admin admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:24.665359 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046d7c29-a0bb-4e4c-b6f6-8d8de5e4d1ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:24.669770 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046d7c29-a0bb-4e4c-b6f6-8d8de5e4d1ce admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:24.758582 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:24.828055 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971cfeb1-51c1-4386-9e83-2e24a5b755c2 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:24.841451 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 903/1799] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:42:24 2022] POST /identity/v3/users => generated 291 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:42:24.852739 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971cfeb1-51c1-4386-9e83-2e24a5b755c2 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:24.872450 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61866675-6105-4206-9ac6-f0e859511a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:24.873189 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61866675-6105-4206-9ac6-f0e859511a24 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:24.880122 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61866675-6105-4206-9ac6-f0e859511a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:24.880486 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61866675-6105-4206-9ac6-f0e859511a24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:24.883119 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61866675-6105-4206-9ac6-f0e859511a24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:24.891674 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61866675-6105-4206-9ac6-f0e859511a24 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:24.935455 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 897/1800] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:24 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:42:24.940160 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d7c29-a0bb-4e4c-b6f6-8d8de5e4d1ce admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:24.953067 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d7c29-a0bb-4e4c-b6f6-8d8de5e4d1ce admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:24.966821 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32b677d-13ad-43f8-9056-9d0bea1e1416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:24.973591 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b677d-13ad-43f8-9056-9d0bea1e1416 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:24.974060 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b677d-13ad-43f8-9056-9d0bea1e1416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:24.975107 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b677d-13ad-43f8-9056-9d0bea1e1416 admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:24.975967 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32b677d-13ad-43f8-9056-9d0bea1e1416 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:24.981704 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32b677d-13ad-43f8-9056-9d0bea1e1416 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:25.035968 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 904/1801] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:24 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:42:25.043631 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61866675-6105-4206-9ac6-f0e859511a24 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:25.062506 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61866675-6105-4206-9ac6-f0e859511a24 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:25.117081 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7447456-15a2-4d98-9046-f72e745828c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:25.119268 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7447456-15a2-4d98-9046-f72e745828c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:25.122013 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7447456-15a2-4d98-9046-f72e745828c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:25.125328 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7447456-15a2-4d98-9046-f72e745828c1 admin admin] PATH_INFO: `/v3/projects/026256c00168420f9f7303d9643b2c77/users/8bbb6dbfcecb45bf90d83d82ebe84dba/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:25.158824 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7447456-15a2-4d98-9046-f72e745828c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=026256c00168420f9f7303d9643b2c77, user_id=8bbb6dbfcecb45bf90d83d82ebe84dba, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:25.161870 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7447456-15a2-4d98-9046-f72e745828c1 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:25.331075 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:25.338820 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 898/1802] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:42:25 2022] PUT /identity/v3/projects/026256c00168420f9f7303d9643b2c77/users/8bbb6dbfcecb45bf90d83d82ebe84dba/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:25.350612 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ba296-3e70-4ce2-b726-d780df89d4fa None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:25.350855 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ba296-3e70-4ce2-b726-d780df89d4fa None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:25.350955 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ba296-3e70-4ce2-b726-d780df89d4fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:25.447564 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-ec0ba296-3e70-4ce2-b726-d780df89d4fa None None] MFA Rules not processed for user `8bbb6dbfcecb45bf90d83d82ebe84dba`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:25.451326 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-ec0ba296-3e70-4ce2-b726-d780df89d4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:25.697206 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 905/1803] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:42:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:25.702077 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7447456-15a2-4d98-9046-f72e745828c1 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:25.905064 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7447456-15a2-4d98-9046-f72e745828c1 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:25.914728 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e4f78-d641-4f8d-b4f0-20a4f8660036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:25.915516 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e4f78-d641-4f8d-b4f0-20a4f8660036 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:25.915841 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e4f78-d641-4f8d-b4f0-20a4f8660036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:25.916117 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e4f78-d641-4f8d-b4f0-20a4f8660036 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:25.916902 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814e4f78-d641-4f8d-b4f0-20a4f8660036 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:25.919085 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814e4f78-d641-4f8d-b4f0-20a4f8660036 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:26.078269 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f85b114-7c8f-4756-bf97-ea0ec5b37491 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:26.084389 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f85b114-7c8f-4756-bf97-ea0ec5b37491 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:26.099072 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f85b114-7c8f-4756-bf97-ea0ec5b37491 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:26.099072 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 906/1804] 10.222.0.39 () {54 vars in 921 bytes} [Mon Jul 18 10:42:26 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:42:26.099471 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 899/1805] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:42:25 2022] POST /identity/v3/projects => generated 383 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:42:26.099557 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f85b114-7c8f-4756-bf97-ea0ec5b37491 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:26.101724 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080c419-831f-485a-bd4a-8e4b48440958 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:26.104985 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080c419-831f-485a-bd4a-8e4b48440958 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:26.106630 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080c419-831f-485a-bd4a-8e4b48440958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:26.185191 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-8080c419-831f-485a-bd4a-8e4b48440958 None None] MFA Rules not processed for user `8bbebf16219943879df84bdc9a900516`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:26.185191 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-8080c419-831f-485a-bd4a-8e4b48440958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:26.261285 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f85b114-7c8f-4756-bf97-ea0ec5b37491 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:26.268706 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5f64e-c37d-47ac-96be-668469a06b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:26.270354 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5f64e-c37d-47ac-96be-668469a06b53 admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:26.283515 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5f64e-c37d-47ac-96be-668469a06b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:26.285101 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5f64e-c37d-47ac-96be-668469a06b53 admin admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:26.289310 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad5f64e-c37d-47ac-96be-668469a06b53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:26.297148 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad5f64e-c37d-47ac-96be-668469a06b53 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:26.336444 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:26.429132 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 900/1806] 10.222.0.39 () {58 vars in 1018 bytes} [Mon Jul 18 10:42:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:26.444366 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 907/1807] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:42:26 2022] POST /identity/v3/users => generated 298 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:42:26.445328 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8080c419-831f-485a-bd4a-8e4b48440958 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:26.507057 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8080c419-831f-485a-bd4a-8e4b48440958 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:26.548239 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db9987-b242-4584-a420-425e5f4312e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:26.552038 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db9987-b242-4584-a420-425e5f4312e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:26.552625 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db9987-b242-4584-a420-425e5f4312e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:26.554002 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db9987-b242-4584-a420-425e5f4312e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:26.558524 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7db9987-b242-4584-a420-425e5f4312e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:26.561104 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7db9987-b242-4584-a420-425e5f4312e4 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:26.619462 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 901/1808] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:26 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:42:26.624810 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5f64e-c37d-47ac-96be-668469a06b53 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:26.641411 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5f64e-c37d-47ac-96be-668469a06b53 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:26.652430 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ed45e-b888-4efc-b6d9-225ec416695f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:26.653547 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ed45e-b888-4efc-b6d9-225ec416695f admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:26.653916 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ed45e-b888-4efc-b6d9-225ec416695f admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:26.654860 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ed45e-b888-4efc-b6d9-225ec416695f admin admin] PATH_INFO: `/v3/projects/e58245f7f64d478a881b06f4a02953a9/users/0fe80fc6e84143529501867df179e132/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:26.683978 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620ed45e-b888-4efc-b6d9-225ec416695f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e58245f7f64d478a881b06f4a02953a9, user_id=0fe80fc6e84143529501867df179e132, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:26.689433 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620ed45e-b888-4efc-b6d9-225ec416695f admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:26.771930 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 908/1809] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:42:26 2022] PUT /identity/v3/projects/e58245f7f64d478a881b06f4a02953a9/users/0fe80fc6e84143529501867df179e132/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:26.778896 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db9987-b242-4584-a420-425e5f4312e4 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:26.797598 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db9987-b242-4584-a420-425e5f4312e4 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:26.845511 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ed45e-b888-4efc-b6d9-225ec416695f admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:26.848384 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-620ed45e-b888-4efc-b6d9-225ec416695f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:26.954083 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:26.971527 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c14288-0ded-46af-ac9f-8b8504eb8104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:26.971527 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c14288-0ded-46af-ac9f-8b8504eb8104 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:26.971527 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c14288-0ded-46af-ac9f-8b8504eb8104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:26.971527 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c14288-0ded-46af-ac9f-8b8504eb8104 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:26.977030 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c14288-0ded-46af-ac9f-8b8504eb8104 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:26.981566 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c14288-0ded-46af-ac9f-8b8504eb8104 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:26.999684 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:27.015088 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 902/1810] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:26 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:42:27.020525 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c14288-0ded-46af-ac9f-8b8504eb8104 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:27.036635 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c14288-0ded-46af-ac9f-8b8504eb8104 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:27.047086 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6531ec27-db74-4039-aa4b-64902cbf9ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:27.050496 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531ec27-db74-4039-aa4b-64902cbf9ec0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:27.050904 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531ec27-db74-4039-aa4b-64902cbf9ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:27.053292 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531ec27-db74-4039-aa4b-64902cbf9ec0 admin admin] PATH_INFO: `/v3/projects/e58245f7f64d478a881b06f4a02953a9/users/0fe80fc6e84143529501867df179e132/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:27.058005 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6531ec27-db74-4039-aa4b-64902cbf9ec0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e58245f7f64d478a881b06f4a02953a9, user_id=0fe80fc6e84143529501867df179e132, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:27.060974 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6531ec27-db74-4039-aa4b-64902cbf9ec0 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:27.076307 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ed45e-b888-4efc-b6d9-225ec416695f admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:27.078476 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 903/1811] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:42:27 2022] PUT /identity/v3/projects/e58245f7f64d478a881b06f4a02953a9/users/0fe80fc6e84143529501867df179e132/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:42:27.108838 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab58dae4-067b-4e3d-a3b0-87e976136323 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:27.110912 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab58dae4-067b-4e3d-a3b0-87e976136323 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:27.113195 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab58dae4-067b-4e3d-a3b0-87e976136323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:27.191961 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-ab58dae4-067b-4e3d-a3b0-87e976136323 None None] MFA Rules not processed for user `0fe80fc6e84143529501867df179e132`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:27.196300 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-ab58dae4-067b-4e3d-a3b0-87e976136323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:27.253493 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a89c6d4-f72b-4c58-b0e8-343b78469bf7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bbebf16219943879df84bdc9a900516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:27.254176 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89c6d4-f72b-4c58-b0e8-343b78469bf7 service nova] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:27.254461 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89c6d4-f72b-4c58-b0e8-343b78469bf7 service nova] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:27.254734 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89c6d4-f72b-4c58-b0e8-343b78469bf7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:27.286911 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a89c6d4-f72b-4c58-b0e8-343b78469bf7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:27.292661 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a89c6d4-f72b-4c58-b0e8-343b78469bf7 service nova] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:27.324609 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 909/1812] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:42:27.326332 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6531c-6165-423d-b676-e52c89e90168 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:27.327408 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6531c-6165-423d-b676-e52c89e90168 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:27.333312 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6531c-6165-423d-b676-e52c89e90168 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:27.338410 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 910/1813] 10.222.0.39 () {54 vars in 921 bytes} [Mon Jul 18 10:42:27 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:42:27.403712 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 904/1814] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:42:27 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:27.420524 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a6531c-6165-423d-b676-e52c89e90168 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:27.427070 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-21a6531c-6165-423d-b676-e52c89e90168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:27.494332 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d691f-47b8-4c80-9ef1-001f2fa85a2f None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:27.494679 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d691f-47b8-4c80-9ef1-001f2fa85a2f None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:27.497812 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d691f-47b8-4c80-9ef1-001f2fa85a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:27.543482 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-7e5d691f-47b8-4c80-9ef1-001f2fa85a2f None None] MFA Rules not processed for user `2330638e80a941cd9aeeb2fd615900d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:27.545484 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-7e5d691f-47b8-4c80-9ef1-001f2fa85a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:27.633418 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a6531c-6165-423d-b676-e52c89e90168 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:27.654494 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d33137c-0c6b-4fbd-909c-c6303acf3ba3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:27.656397 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d33137c-0c6b-4fbd-909c-c6303acf3ba3 service cinder] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:27.656704 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d33137c-0c6b-4fbd-909c-c6303acf3ba3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:27.656988 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d33137c-0c6b-4fbd-909c-c6303acf3ba3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:27.699181 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d33137c-0c6b-4fbd-909c-c6303acf3ba3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:27.709721 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d33137c-0c6b-4fbd-909c-c6303acf3ba3 service cinder] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:27.725236 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 911/1815] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:27 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:42:27.739744 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 905/1816] 10.222.0.39 () {58 vars in 1018 bytes} [Mon Jul 18 10:42:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:42:27.897861 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d33137c-0c6b-4fbd-909c-c6303acf3ba3 service cinder] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:27.900103 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-6d33137c-0c6b-4fbd-909c-c6303acf3ba3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:27.948760 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d33137c-0c6b-4fbd-909c-c6303acf3ba3 service cinder] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:27.959095 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5d691f-47b8-4c80-9ef1-001f2fa85a2f None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:27.986886 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5d691f-47b8-4c80-9ef1-001f2fa85a2f None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:28.001619 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc18acf5-9570-44a7-b4de-a75e78c7199b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:28.001619 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc18acf5-9570-44a7-b4de-a75e78c7199b service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:28.005738 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7056d6e3-c3b3-46b4-9122-36498f91aafc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2330638e80a941cd9aeeb2fd615900d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:28.006448 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056d6e3-c3b3-46b4-9122-36498f91aafc service placement] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:28.006738 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056d6e3-c3b3-46b4-9122-36498f91aafc service placement] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:28.007027 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056d6e3-c3b3-46b4-9122-36498f91aafc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:28.008414 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc18acf5-9570-44a7-b4de-a75e78c7199b service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:28.008712 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc18acf5-9570-44a7-b4de-a75e78c7199b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:28.044291 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7056d6e3-c3b3-46b4-9122-36498f91aafc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:28.047434 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7056d6e3-c3b3-46b4-9122-36498f91aafc service placement] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:28.106959 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 912/1817] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:42:28.142366 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7056d6e3-c3b3-46b4-9122-36498f91aafc service placement] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:28.163409 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-7056d6e3-c3b3-46b4-9122-36498f91aafc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:28.270914 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc18acf5-9570-44a7-b4de-a75e78c7199b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:28.290181 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc18acf5-9570-44a7-b4de-a75e78c7199b service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:28.331169 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 906/1818] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:27 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:42:28.357919 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:28.435645 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7056d6e3-c3b3-46b4-9122-36498f91aafc service placement] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:28.462805 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a7d378-bc9d-4625-856f-b72dd6f04554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:28.463780 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7d378-bc9d-4625-856f-b72dd6f04554 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:28.464185 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7d378-bc9d-4625-856f-b72dd6f04554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:28.464358 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7d378-bc9d-4625-856f-b72dd6f04554 admin admin] PATH_INFO: `/v3/users/c3f7301abf3f4cd398b30ec9eae170dc` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:28.472014 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a7d378-bc9d-4625-856f-b72dd6f04554 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3f7301abf3f4cd398b30ec9eae170dc)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:28.475575 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a7d378-bc9d-4625-856f-b72dd6f04554 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:28.794463 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-88a7d378-bc9d-4625-856f-b72dd6f04554 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3f7301abf3f4cd398b30ec9eae170dc'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:28.893499 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-88a7d378-bc9d-4625-856f-b72dd6f04554 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3f7301abf3f4cd398b30ec9eae170dc'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:28.894274 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-88a7d378-bc9d-4625-856f-b72dd6f04554 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3f7301abf3f4cd398b30ec9eae170dc'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:28.916162 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-88a7d378-bc9d-4625-856f-b72dd6f04554 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3f7301abf3f4cd398b30ec9eae170dc'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:28.933680 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-88a7d378-bc9d-4625-856f-b72dd6f04554 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3f7301abf3f4cd398b30ec9eae170dc'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:28.961312 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 913/1819] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:42:28 2022] DELETE /identity/v3/users/c3f7301abf3f4cd398b30ec9eae170dc => generated 0 bytes in 815 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:29.328284 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc18acf5-9570-44a7-b4de-a75e78c7199b service cinder] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:29.353140 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc18acf5-9570-44a7-b4de-a75e78c7199b service cinder] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:29.370214 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:29.544276 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2d32bc-aca6-4983-bd59-6ac1b8047ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:29.545891 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d32bc-aca6-4983-bd59-6ac1b8047ae5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:29.546359 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d32bc-aca6-4983-bd59-6ac1b8047ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:29.546819 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d32bc-aca6-4983-bd59-6ac1b8047ae5 admin admin] PATH_INFO: `/v3/users/8bbb6dbfcecb45bf90d83d82ebe84dba` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:29.550450 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2d32bc-aca6-4983-bd59-6ac1b8047ae5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bbb6dbfcecb45bf90d83d82ebe84dba)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:29.555279 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2d32bc-aca6-4983-bd59-6ac1b8047ae5 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:29.911631 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-be2d32bc-aca6-4983-bd59-6ac1b8047ae5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bbb6dbfcecb45bf90d83d82ebe84dba'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:30.027650 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-be2d32bc-aca6-4983-bd59-6ac1b8047ae5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bbb6dbfcecb45bf90d83d82ebe84dba'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:30.029512 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-be2d32bc-aca6-4983-bd59-6ac1b8047ae5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bbb6dbfcecb45bf90d83d82ebe84dba'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:30.096421 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-be2d32bc-aca6-4983-bd59-6ac1b8047ae5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bbb6dbfcecb45bf90d83d82ebe84dba'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:30.143899 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-be2d32bc-aca6-4983-bd59-6ac1b8047ae5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bbb6dbfcecb45bf90d83d82ebe84dba'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:30.159385 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 907/1820] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:42:29 2022] DELETE /identity/v3/users/8bbb6dbfcecb45bf90d83d82ebe84dba => generated 0 bytes in 826 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:30.160720 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa866546-992d-423c-8c06-b49d66c4295c None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:30.161586 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa866546-992d-423c-8c06-b49d66c4295c None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:30.161586 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa866546-992d-423c-8c06-b49d66c4295c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:30.220300 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-aa866546-992d-423c-8c06-b49d66c4295c None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:30.222720 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-aa866546-992d-423c-8c06-b49d66c4295c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:30.346860 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 914/1821] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:42:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:42:30.377750 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2d32bc-aca6-4983-bd59-6ac1b8047ae5 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:30.380101 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-be2d32bc-aca6-4983-bd59-6ac1b8047ae5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:30.563184 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2d32bc-aca6-4983-bd59-6ac1b8047ae5 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:30.567520 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f460580b-861d-40e8-832b-23a574492f14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:30.568278 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460580b-861d-40e8-832b-23a574492f14 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:30.568640 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460580b-861d-40e8-832b-23a574492f14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:30.568925 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460580b-861d-40e8-832b-23a574492f14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:30.595314 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f460580b-861d-40e8-832b-23a574492f14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:30.597009 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f460580b-861d-40e8-832b-23a574492f14 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:30.628873 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 908/1822] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:42:30.997512 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa866546-992d-423c-8c06-b49d66c4295c None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:30.999789 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-aa866546-992d-423c-8c06-b49d66c4295c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:31.096429 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf16200-e7fa-4c08-ad7c-7fdc71f19007 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:31.097140 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf16200-e7fa-4c08-ad7c-7fdc71f19007 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:31.097621 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf16200-e7fa-4c08-ad7c-7fdc71f19007 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:31.102714 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 909/1823] 10.222.0.39 () {54 vars in 921 bytes} [Mon Jul 18 10:42:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:42:31.168876 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa866546-992d-423c-8c06-b49d66c4295c None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:31.175497 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107de6ca-06c7-4373-89bf-d5c7788c66b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:31.176484 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107de6ca-06c7-4373-89bf-d5c7788c66b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:31.179199 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107de6ca-06c7-4373-89bf-d5c7788c66b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:31.180102 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107de6ca-06c7-4373-89bf-d5c7788c66b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:31.183468 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-107de6ca-06c7-4373-89bf-d5c7788c66b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:31.194580 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf16200-e7fa-4c08-ad7c-7fdc71f19007 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:31.196688 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-baf16200-e7fa-4c08-ad7c-7fdc71f19007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:31.221621 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:31.223949 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf16200-e7fa-4c08-ad7c-7fdc71f19007 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:31.237787 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d4e7f-a00e-44a2-a34e-4c7b0b0aecd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:31.238945 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d4e7f-a00e-44a2-a34e-4c7b0b0aecd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:31.239343 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d4e7f-a00e-44a2-a34e-4c7b0b0aecd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:31.239794 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d4e7f-a00e-44a2-a34e-4c7b0b0aecd5 admin admin] PATH_INFO: `/v3/projects/185ba59cfdc44b4db66f2885f125e317` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:31.243059 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062d4e7f-a00e-44a2-a34e-4c7b0b0aecd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=185ba59cfdc44b4db66f2885f125e317)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:31.247184 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062d4e7f-a00e-44a2-a34e-4c7b0b0aecd5 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:31.284576 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107de6ca-06c7-4373-89bf-d5c7788c66b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:31.289383 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107de6ca-06c7-4373-89bf-d5c7788c66b7 service cinder] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:31.312965 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:31.329914 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 915/1824] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:30 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:42:31.339177 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc369f-33ed-41f7-8179-b6366775a36a None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:31.344438 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc369f-33ed-41f7-8179-b6366775a36a None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:31.344438 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc369f-33ed-41f7-8179-b6366775a36a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:31.403800 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-aabc369f-33ed-41f7-8179-b6366775a36a None None] MFA Rules not processed for user `8bbebf16219943879df84bdc9a900516`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:31.409440 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-aabc369f-33ed-41f7-8179-b6366775a36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:31.445638 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-062d4e7f-a00e-44a2-a34e-4c7b0b0aecd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '185ba59cfdc44b4db66f2885f125e317', 'request_id': 'req-062d4e7f-a00e-44a2-a34e-4c7b0b0aecd5'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:31.478258 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-062d4e7f-a00e-44a2-a34e-4c7b0b0aecd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '185ba59cfdc44b4db66f2885f125e317', 'request_id': 'req-062d4e7f-a00e-44a2-a34e-4c7b0b0aecd5'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:31.498072 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-062d4e7f-a00e-44a2-a34e-4c7b0b0aecd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '185ba59cfdc44b4db66f2885f125e317', 'request_id': 'req-062d4e7f-a00e-44a2-a34e-4c7b0b0aecd5'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:31.652820 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-062d4e7f-a00e-44a2-a34e-4c7b0b0aecd5 admin admin] The token cache is being invalidate because project 185ba59cfdc44b4db66f2885f125e317 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:42:31.656645 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-062d4e7f-a00e-44a2-a34e-4c7b0b0aecd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:31.657108 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-062d4e7f-a00e-44a2-a34e-4c7b0b0aecd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:31.666823 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 910/1825] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:42:31 2022] DELETE /identity/v3/projects/185ba59cfdc44b4db66f2885f125e317 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:31.671408 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d4e7f-a00e-44a2-a34e-4c7b0b0aecd5 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:31.673167 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-062d4e7f-a00e-44a2-a34e-4c7b0b0aecd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:31.772007 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 916/1826] 10.222.0.39 () {58 vars in 1018 bytes} [Mon Jul 18 10:42:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 442 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:31.851392 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d4e7f-a00e-44a2-a34e-4c7b0b0aecd5 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:31.858124 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52165f38-2857-4941-9619-e60fb2e6333a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:31.859363 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52165f38-2857-4941-9619-e60fb2e6333a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:31.859797 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52165f38-2857-4941-9619-e60fb2e6333a admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:31.860243 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52165f38-2857-4941-9619-e60fb2e6333a admin admin] PATH_INFO: `/v3/users/42dfa7e9f3854ba4b0233520b75129cb` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:31.861825 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52165f38-2857-4941-9619-e60fb2e6333a admin admin] RBAC: Authorizing `identity:delete_user(user_id=42dfa7e9f3854ba4b0233520b75129cb)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:31.865421 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52165f38-2857-4941-9619-e60fb2e6333a admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:32.153988 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-52165f38-2857-4941-9619-e60fb2e6333a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42dfa7e9f3854ba4b0233520b75129cb'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:32.602892 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabc369f-33ed-41f7-8179-b6366775a36a None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:32.605531 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-aabc369f-33ed-41f7-8179-b6366775a36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:32.631411 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabc369f-33ed-41f7-8179-b6366775a36a None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:32.637732 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf88d520-53f0-41e8-856e-494c6c2e13b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bbebf16219943879df84bdc9a900516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:32.638459 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88d520-53f0-41e8-856e-494c6c2e13b0 service nova] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:32.638765 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88d520-53f0-41e8-856e-494c6c2e13b0 service nova] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:32.639755 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88d520-53f0-41e8-856e-494c6c2e13b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:32.666866 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf88d520-53f0-41e8-856e-494c6c2e13b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:32.668960 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf88d520-53f0-41e8-856e-494c6c2e13b0 service nova] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:32.685036 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 917/1827] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:42:32.927948 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-52165f38-2857-4941-9619-e60fb2e6333a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42dfa7e9f3854ba4b0233520b75129cb'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:32.929808 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-52165f38-2857-4941-9619-e60fb2e6333a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42dfa7e9f3854ba4b0233520b75129cb'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:32.938546 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf88d520-53f0-41e8-856e-494c6c2e13b0 service nova] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:32.938838 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-cf88d520-53f0-41e8-856e-494c6c2e13b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:32.985945 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-52165f38-2857-4941-9619-e60fb2e6333a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42dfa7e9f3854ba4b0233520b75129cb'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:32.989663 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf88d520-53f0-41e8-856e-494c6c2e13b0 service nova] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:33.027502 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-52165f38-2857-4941-9619-e60fb2e6333a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42dfa7e9f3854ba4b0233520b75129cb'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:33.028500 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0495dbb3-48a0-46ff-b124-71025cd40520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:33.029584 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0495dbb3-48a0-46ff-b124-71025cd40520 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:33.030597 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0495dbb3-48a0-46ff-b124-71025cd40520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:33.031738 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0495dbb3-48a0-46ff-b124-71025cd40520 admin admin] PATH_INFO: `/v3/projects/026256c00168420f9f7303d9643b2c77` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:33.033135 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0495dbb3-48a0-46ff-b124-71025cd40520 admin admin] RBAC: Authorizing `identity:delete_project(project_id=026256c00168420f9f7303d9643b2c77)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:33.036160 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0495dbb3-48a0-46ff-b124-71025cd40520 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:33.052453 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 911/1828] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:42:31 2022] DELETE /identity/v3/users/42dfa7e9f3854ba4b0233520b75129cb => generated 0 bytes in 1382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:42:33.256971 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-0495dbb3-48a0-46ff-b124-71025cd40520 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '026256c00168420f9f7303d9643b2c77', 'request_id': 'req-0495dbb3-48a0-46ff-b124-71025cd40520'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:33.263593 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-0495dbb3-48a0-46ff-b124-71025cd40520 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '026256c00168420f9f7303d9643b2c77', 'request_id': 'req-0495dbb3-48a0-46ff-b124-71025cd40520'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:33.272761 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-0495dbb3-48a0-46ff-b124-71025cd40520 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '026256c00168420f9f7303d9643b2c77', 'request_id': 'req-0495dbb3-48a0-46ff-b124-71025cd40520'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:33.447404 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-0495dbb3-48a0-46ff-b124-71025cd40520 admin admin] The token cache is being invalidate because project 026256c00168420f9f7303d9643b2c77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80392) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:42:33.447404 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-0495dbb3-48a0-46ff-b124-71025cd40520 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:33.447404 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-0495dbb3-48a0-46ff-b124-71025cd40520 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:33.452505 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52165f38-2857-4941-9619-e60fb2e6333a admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:33.454694 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-52165f38-2857-4941-9619-e60fb2e6333a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:33.478600 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 918/1829] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:42:32 2022] DELETE /identity/v3/projects/026256c00168420f9f7303d9643b2c77 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:42:33.559810 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52165f38-2857-4941-9619-e60fb2e6333a admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:33.660753 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7325a099-4cba-47ab-b9a4-424cd01356d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:33.660915 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0495dbb3-48a0-46ff-b124-71025cd40520 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:33.661758 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7325a099-4cba-47ab-b9a4-424cd01356d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:33.662039 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7325a099-4cba-47ab-b9a4-424cd01356d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:33.662313 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7325a099-4cba-47ab-b9a4-424cd01356d0 admin admin] PATH_INFO: `/v3/users/0fe80fc6e84143529501867df179e132` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:33.662910 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-0495dbb3-48a0-46ff-b124-71025cd40520 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:33.663603 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7325a099-4cba-47ab-b9a4-424cd01356d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fe80fc6e84143529501867df179e132)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:33.666810 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7325a099-4cba-47ab-b9a4-424cd01356d0 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:33.688327 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0495dbb3-48a0-46ff-b124-71025cd40520 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:33.702607 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7984bc8f-f5c2-4481-a3ad-1f5f18d35959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:33.705698 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984bc8f-f5c2-4481-a3ad-1f5f18d35959 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:33.705698 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984bc8f-f5c2-4481-a3ad-1f5f18d35959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:33.705698 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984bc8f-f5c2-4481-a3ad-1f5f18d35959 admin admin] PATH_INFO: `/v3/projects/8920dd72183c4c15a864828906640222` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:33.707209 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7984bc8f-f5c2-4481-a3ad-1f5f18d35959 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8920dd72183c4c15a864828906640222)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:33.709580 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7984bc8f-f5c2-4481-a3ad-1f5f18d35959 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:33.919816 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7325a099-4cba-47ab-b9a4-424cd01356d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fe80fc6e84143529501867df179e132'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:33.921133 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-7984bc8f-f5c2-4481-a3ad-1f5f18d35959 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8920dd72183c4c15a864828906640222', 'request_id': 'req-7984bc8f-f5c2-4481-a3ad-1f5f18d35959'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:33.932512 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-7984bc8f-f5c2-4481-a3ad-1f5f18d35959 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8920dd72183c4c15a864828906640222', 'request_id': 'req-7984bc8f-f5c2-4481-a3ad-1f5f18d35959'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:33.942867 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-7984bc8f-f5c2-4481-a3ad-1f5f18d35959 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8920dd72183c4c15a864828906640222', 'request_id': 'req-7984bc8f-f5c2-4481-a3ad-1f5f18d35959'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:34.018918 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7325a099-4cba-47ab-b9a4-424cd01356d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fe80fc6e84143529501867df179e132'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:34.019853 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7325a099-4cba-47ab-b9a4-424cd01356d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fe80fc6e84143529501867df179e132'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:34.020374 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:34.057526 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7325a099-4cba-47ab-b9a4-424cd01356d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fe80fc6e84143529501867df179e132'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:34.081445 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:34.083153 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7325a099-4cba-47ab-b9a4-424cd01356d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fe80fc6e84143529501867df179e132'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:34.097731 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 912/1830] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:42:33 2022] DELETE /identity/v3/users/0fe80fc6e84143529501867df179e132 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:42:34.155304 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-7984bc8f-f5c2-4481-a3ad-1f5f18d35959 admin admin] The token cache is being invalidate because project 8920dd72183c4c15a864828906640222 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80392) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:42:34.155304 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-7984bc8f-f5c2-4481-a3ad-1f5f18d35959 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:34.155304 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-7984bc8f-f5c2-4481-a3ad-1f5f18d35959 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:34.155991 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 919/1831] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:42:33 2022] DELETE /identity/v3/projects/8920dd72183c4c15a864828906640222 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:42:34.160829 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef49d5-15d5-4d09-8abf-4fabd649899a None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:34.161246 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef49d5-15d5-4d09-8abf-4fabd649899a None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:34.161526 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef49d5-15d5-4d09-8abf-4fabd649899a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:34.184671 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-a3ef49d5-15d5-4d09-8abf-4fabd649899a None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:34.186760 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-a3ef49d5-15d5-4d09-8abf-4fabd649899a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:34.284093 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 913/1832] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:42:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:34.292879 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10649cfb-91a0-472f-a9e0-5bfe4035d403 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:34.293205 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10649cfb-91a0-472f-a9e0-5bfe4035d403 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:34.293512 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10649cfb-91a0-472f-a9e0-5bfe4035d403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:34.320232 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-10649cfb-91a0-472f-a9e0-5bfe4035d403 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:34.321992 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-10649cfb-91a0-472f-a9e0-5bfe4035d403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:34.339378 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 920/1833] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:42:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:34.340754 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef49d5-15d5-4d09-8abf-4fabd649899a None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:34.351449 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef49d5-15d5-4d09-8abf-4fabd649899a None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:34.356524 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3964613-5567-466c-9af2-70949626dbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:34.357225 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3964613-5567-466c-9af2-70949626dbe4 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:34.357504 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3964613-5567-466c-9af2-70949626dbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:34.357821 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3964613-5567-466c-9af2-70949626dbe4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:34.359235 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3964613-5567-466c-9af2-70949626dbe4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:42:34.359551 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3964613-5567-466c-9af2-70949626dbe4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:34.361220 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3964613-5567-466c-9af2-70949626dbe4 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:34.377099 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 914/1834] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 10:42:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:42:34.378716 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10649cfb-91a0-472f-a9e0-5bfe4035d403 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:34.388044 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10649cfb-91a0-472f-a9e0-5bfe4035d403 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:34.394008 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee47719-8190-4ea9-9e31-6d2a161d132f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:34.397783 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee47719-8190-4ea9-9e31-6d2a161d132f admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:34.397783 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee47719-8190-4ea9-9e31-6d2a161d132f admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:34.397783 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee47719-8190-4ea9-9e31-6d2a161d132f admin admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:34.397783 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee47719-8190-4ea9-9e31-6d2a161d132f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:34.398400 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee47719-8190-4ea9-9e31-6d2a161d132f admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:34.530693 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 921/1835] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:42:34 2022] POST /identity/v3/projects => generated 371 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:42:34.536075 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3964613-5567-466c-9af2-70949626dbe4 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:34.552600 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3964613-5567-466c-9af2-70949626dbe4 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:34.666777 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec1d3c4-2d53-4723-a3c7-703fe2703e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:34.667537 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1d3c4-2d53-4723-a3c7-703fe2703e60 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:34.669904 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1d3c4-2d53-4723-a3c7-703fe2703e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:34.670733 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1d3c4-2d53-4723-a3c7-703fe2703e60 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:34.672264 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec1d3c4-2d53-4723-a3c7-703fe2703e60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:34.676800 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec1d3c4-2d53-4723-a3c7-703fe2703e60 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:34.680364 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee47719-8190-4ea9-9e31-6d2a161d132f admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:34.689574 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-7ee47719-8190-4ea9-9e31-6d2a161d132f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:34.706968 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee47719-8190-4ea9-9e31-6d2a161d132f admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:34.712318 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d076f4-9405-49b3-9b57-5e5343f01a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:34.722726 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d076f4-9405-49b3-9b57-5e5343f01a62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:34.722888 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d076f4-9405-49b3-9b57-5e5343f01a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:34.723264 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d076f4-9405-49b3-9b57-5e5343f01a62 admin admin] PATH_INFO: `/v3/projects/e58245f7f64d478a881b06f4a02953a9` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:34.725370 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d076f4-9405-49b3-9b57-5e5343f01a62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e58245f7f64d478a881b06f4a02953a9)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:34.727898 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d076f4-9405-49b3-9b57-5e5343f01a62 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:34.821075 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 915/1836] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:42:34 2022] POST /identity/v3/users => generated 286 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:42:34.824356 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec1d3c4-2d53-4723-a3c7-703fe2703e60 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:34.848961 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec1d3c4-2d53-4723-a3c7-703fe2703e60 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:34.871675 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-33d076f4-9405-49b3-9b57-5e5343f01a62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e58245f7f64d478a881b06f4a02953a9', 'request_id': 'req-33d076f4-9405-49b3-9b57-5e5343f01a62'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:34.879988 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-33d076f4-9405-49b3-9b57-5e5343f01a62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e58245f7f64d478a881b06f4a02953a9', 'request_id': 'req-33d076f4-9405-49b3-9b57-5e5343f01a62'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:34.890036 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-33d076f4-9405-49b3-9b57-5e5343f01a62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e58245f7f64d478a881b06f4a02953a9', 'request_id': 'req-33d076f4-9405-49b3-9b57-5e5343f01a62'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:34.980171 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab1095f-97c1-4ac1-9eeb-eab817f339fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:34.980171 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1095f-97c1-4ac1-9eeb-eab817f339fe admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:34.980607 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1095f-97c1-4ac1-9eeb-eab817f339fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:34.981020 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1095f-97c1-4ac1-9eeb-eab817f339fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:34.982103 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab1095f-97c1-4ac1-9eeb-eab817f339fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:34.995612 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-33d076f4-9405-49b3-9b57-5e5343f01a62 admin admin] The token cache is being invalidate because project e58245f7f64d478a881b06f4a02953a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80392) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:42:34.996050 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-33d076f4-9405-49b3-9b57-5e5343f01a62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:34.996824 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-33d076f4-9405-49b3-9b57-5e5343f01a62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:35.005788 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab1095f-97c1-4ac1-9eeb-eab817f339fe admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:35.006445 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 922/1837] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:42:34 2022] DELETE /identity/v3/projects/e58245f7f64d478a881b06f4a02953a9 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:35.008687 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a23413-95cc-4389-bd6c-600304e5fc11 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:35.008687 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a23413-95cc-4389-bd6c-600304e5fc11 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:35.008687 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a23413-95cc-4389-bd6c-600304e5fc11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:35.016819 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 916/1838] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:34 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 10:42:35.018081 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab1095f-97c1-4ac1-9eeb-eab817f339fe admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:35.019788 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-6ab1095f-97c1-4ac1-9eeb-eab817f339fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:35.038934 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-32a23413-95cc-4389-bd6c-600304e5fc11 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:35.040431 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-32a23413-95cc-4389-bd6c-600304e5fc11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:35.049221 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab1095f-97c1-4ac1-9eeb-eab817f339fe admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:35.058431 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 923/1839] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:42:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:35.060187 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298240b-1a7d-45b5-ab3c-b71cf7549c13 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:35.060519 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298240b-1a7d-45b5-ab3c-b71cf7549c13 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:35.060854 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9298240b-1a7d-45b5-ab3c-b71cf7549c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:35.064235 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d30b8-704d-4fef-9e69-33a8b1f494eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:35.066310 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d30b8-704d-4fef-9e69-33a8b1f494eb admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:35.066921 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d30b8-704d-4fef-9e69-33a8b1f494eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:35.069518 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d30b8-704d-4fef-9e69-33a8b1f494eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:35.071562 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d30b8-704d-4fef-9e69-33a8b1f494eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:35.073939 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d30b8-704d-4fef-9e69-33a8b1f494eb admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:35.081385 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-9298240b-1a7d-45b5-ab3c-b71cf7549c13 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:35.082720 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-9298240b-1a7d-45b5-ab3c-b71cf7549c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:35.094356 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 924/1840] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:42:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:35.099829 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 917/1841] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:35 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 10:42:35.105251 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d30b8-704d-4fef-9e69-33a8b1f494eb admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:35.105578 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9298240b-1a7d-45b5-ab3c-b71cf7549c13 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:35.122726 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9298240b-1a7d-45b5-ab3c-b71cf7549c13 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:35.132766 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b21b58f-66a0-4a9c-a1ee-6810e2815e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:35.133575 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21b58f-66a0-4a9c-a1ee-6810e2815e71 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:35.133966 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21b58f-66a0-4a9c-a1ee-6810e2815e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:35.134306 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21b58f-66a0-4a9c-a1ee-6810e2815e71 admin admin] PATH_INFO: `/v3/domains` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:35.135122 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b21b58f-66a0-4a9c-a1ee-6810e2815e71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:42:35.135507 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b21b58f-66a0-4a9c-a1ee-6810e2815e71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:35.140998 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d30b8-704d-4fef-9e69-33a8b1f494eb admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:35.146631 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b21b58f-66a0-4a9c-a1ee-6810e2815e71 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:35.165557 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 925/1842] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 10:42:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:42:35.165800 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6071aba9-c067-4ac6-9edd-b99e69e89e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:35.166623 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071aba9-c067-4ac6-9edd-b99e69e89e4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:35.166887 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071aba9-c067-4ac6-9edd-b99e69e89e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:35.167166 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071aba9-c067-4ac6-9edd-b99e69e89e4c admin admin] PATH_INFO: `/v3/projects/d17c53793a9f46d1a194d4889653cf36/users/ecc0420029354870a65e4bd7cef4c37c/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:35.168833 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b21b58f-66a0-4a9c-a1ee-6810e2815e71 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:35.183566 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b21b58f-66a0-4a9c-a1ee-6810e2815e71 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:35.193226 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25b9ba6-9a59-49be-b351-debc81b03384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:35.198287 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b9ba6-9a59-49be-b351-debc81b03384 admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:35.198287 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b9ba6-9a59-49be-b351-debc81b03384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:35.198678 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6071aba9-c067-4ac6-9edd-b99e69e89e4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d17c53793a9f46d1a194d4889653cf36, user_id=ecc0420029354870a65e4bd7cef4c37c, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:35.198780 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b9ba6-9a59-49be-b351-debc81b03384 admin admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:35.198780 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25b9ba6-9a59-49be-b351-debc81b03384 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:35.198937 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6071aba9-c067-4ac6-9edd-b99e69e89e4c admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:35.199026 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25b9ba6-9a59-49be-b351-debc81b03384 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:35.272035 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 918/1843] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:42:35 2022] PUT /identity/v3/projects/d17c53793a9f46d1a194d4889653cf36/users/ecc0420029354870a65e4bd7cef4c37c/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:35.284111 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f2a1d1-74d7-4890-be00-76930a630701 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:35.284401 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f2a1d1-74d7-4890-be00-76930a630701 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:35.284680 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f2a1d1-74d7-4890-be00-76930a630701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:35.301018 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 926/1844] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:42:35 2022] POST /identity/v3/projects => generated 373 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:42:35.305530 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25b9ba6-9a59-49be-b351-debc81b03384 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:35.321530 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-70f2a1d1-74d7-4890-be00-76930a630701 None None] MFA Rules not processed for user `ecc0420029354870a65e4bd7cef4c37c`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:35.322785 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-70f2a1d1-74d7-4890-be00-76930a630701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:35.390462 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25b9ba6-9a59-49be-b351-debc81b03384 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:35.397979 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e25b17-6465-4a1c-a81f-d56d76484b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:35.405395 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e25b17-6465-4a1c-a81f-d56d76484b11 admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:35.405395 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e25b17-6465-4a1c-a81f-d56d76484b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:35.405395 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e25b17-6465-4a1c-a81f-d56d76484b11 admin admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:35.405395 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e25b17-6465-4a1c-a81f-d56d76484b11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:35.405395 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e25b17-6465-4a1c-a81f-d56d76484b11 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:35.419694 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 919/1845] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:42:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:42:35.426225 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f2a1d1-74d7-4890-be00-76930a630701 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:35.438888 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f2a1d1-74d7-4890-be00-76930a630701 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:35.444072 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf379c7-11f2-40ad-aa86-2183ac83497e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:35.444743 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf379c7-11f2-40ad-aa86-2183ac83497e admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:35.445025 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf379c7-11f2-40ad-aa86-2183ac83497e admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:35.445340 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf379c7-11f2-40ad-aa86-2183ac83497e admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:35.446040 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf379c7-11f2-40ad-aa86-2183ac83497e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:35.447956 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf379c7-11f2-40ad-aa86-2183ac83497e admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:35.499986 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 927/1846] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:42:35 2022] POST /identity/v3/users => generated 287 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:42:35.503847 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e25b17-6465-4a1c-a81f-d56d76484b11 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:35.521664 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e25b17-6465-4a1c-a81f-d56d76484b11 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:35.526840 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed85ec4-3bcb-47e0-a202-657cef98627a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:35.527519 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed85ec4-3bcb-47e0-a202-657cef98627a admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:35.527813 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed85ec4-3bcb-47e0-a202-657cef98627a admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:35.528094 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed85ec4-3bcb-47e0-a202-657cef98627a admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:35.528836 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed85ec4-3bcb-47e0-a202-657cef98627a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:35.531098 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed85ec4-3bcb-47e0-a202-657cef98627a admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:35.539314 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 920/1847] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:42:35 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:42:35.541181 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf379c7-11f2-40ad-aa86-2183ac83497e admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:35.543544 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 928/1848] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:35 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 10:42:35.547878 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed85ec4-3bcb-47e0-a202-657cef98627a admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:35.560388 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed85ec4-3bcb-47e0-a202-657cef98627a admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:35.625233 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf379c7-11f2-40ad-aa86-2183ac83497e admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:35.630897 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d58136-8c26-45d7-8f6b-e98c3c408003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:35.635271 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d58136-8c26-45d7-8f6b-e98c3c408003 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:35.635271 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d58136-8c26-45d7-8f6b-e98c3c408003 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:35.635271 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d58136-8c26-45d7-8f6b-e98c3c408003 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:35.635271 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d58136-8c26-45d7-8f6b-e98c3c408003 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:35.635271 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d58136-8c26-45d7-8f6b-e98c3c408003 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:35.635762 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e1eb8-1a4c-424e-b530-32a04c16ac97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:35.636435 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e1eb8-1a4c-424e-b530-32a04c16ac97 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:35.636724 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e1eb8-1a4c-424e-b530-32a04c16ac97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:35.637001 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e1eb8-1a4c-424e-b530-32a04c16ac97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:35.637752 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e1eb8-1a4c-424e-b530-32a04c16ac97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:35.639401 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e1eb8-1a4c-424e-b530-32a04c16ac97 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:35.649526 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 929/1849] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:35 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 10:42:35.654001 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e1eb8-1a4c-424e-b530-32a04c16ac97 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:35.665776 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e1eb8-1a4c-424e-b530-32a04c16ac97 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:35.669737 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed7361-57cd-40f5-8a68-9ea7eed6eebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:35.671155 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed7361-57cd-40f5-8a68-9ea7eed6eebd admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:35.671444 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed7361-57cd-40f5-8a68-9ea7eed6eebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:35.671720 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed7361-57cd-40f5-8a68-9ea7eed6eebd admin admin] PATH_INFO: `/v3/projects/0be7e80587e44837b04cbf664a5cef93/users/8b8c227ea8e64dc19038a37f78e6faa2/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:35.694125 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ed7361-57cd-40f5-8a68-9ea7eed6eebd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0be7e80587e44837b04cbf664a5cef93, user_id=8b8c227ea8e64dc19038a37f78e6faa2, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:35.694125 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ed7361-57cd-40f5-8a68-9ea7eed6eebd admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:35.717516 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 921/1850] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:42:35 2022] POST /identity/v3/users => generated 293 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:42:35.720434 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d58136-8c26-45d7-8f6b-e98c3c408003 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:35.730880 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d58136-8c26-45d7-8f6b-e98c3c408003 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:35.737729 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f463416-7a97-44bc-a76f-a91ce15a7c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:35.738405 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f463416-7a97-44bc-a76f-a91ce15a7c10 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:35.738730 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f463416-7a97-44bc-a76f-a91ce15a7c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:35.738955 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f463416-7a97-44bc-a76f-a91ce15a7c10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:35.739725 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f463416-7a97-44bc-a76f-a91ce15a7c10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:35.741420 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f463416-7a97-44bc-a76f-a91ce15a7c10 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:35.752984 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 922/1851] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 10:42:35.756877 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f463416-7a97-44bc-a76f-a91ce15a7c10 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:35.767666 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 930/1852] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:42:35 2022] PUT /identity/v3/projects/0be7e80587e44837b04cbf664a5cef93/users/8b8c227ea8e64dc19038a37f78e6faa2/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:35.771278 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f463416-7a97-44bc-a76f-a91ce15a7c10 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:35.773253 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f540a-d5eb-487e-a2ea-3d4ac6f96c90 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:35.773723 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f540a-d5eb-487e-a2ea-3d4ac6f96c90 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:35.774007 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f540a-d5eb-487e-a2ea-3d4ac6f96c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:35.792028 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-152f540a-d5eb-487e-a2ea-3d4ac6f96c90 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:35.797579 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-152f540a-d5eb-487e-a2ea-3d4ac6f96c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:35.836254 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7740b1-15c5-4c86-a4e7-026a2dc7ef9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:35.837186 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7740b1-15c5-4c86-a4e7-026a2dc7ef9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:35.837476 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7740b1-15c5-4c86-a4e7-026a2dc7ef9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:35.837808 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7740b1-15c5-4c86-a4e7-026a2dc7ef9e admin admin] PATH_INFO: `/v3/projects/79ffb1481fc347baa241129f0c25be00/users/00ca99b10bdb45dc9a0c2d33948f5ea2/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:35.854706 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7740b1-15c5-4c86-a4e7-026a2dc7ef9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=79ffb1481fc347baa241129f0c25be00, user_id=00ca99b10bdb45dc9a0c2d33948f5ea2, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:35.855378 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 931/1853] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:42:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:35.857468 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7740b1-15c5-4c86-a4e7-026a2dc7ef9e admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:35.865704 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f540a-d5eb-487e-a2ea-3d4ac6f96c90 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:35.867097 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-152f540a-d5eb-487e-a2ea-3d4ac6f96c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:35.924361 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f540a-d5eb-487e-a2ea-3d4ac6f96c90 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:35.927926 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b134db-e4fc-4bec-8d77-c89f7224185e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:35.928575 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b134db-e4fc-4bec-8d77-c89f7224185e service neutron] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:35.928852 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b134db-e4fc-4bec-8d77-c89f7224185e service neutron] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:35.929414 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b134db-e4fc-4bec-8d77-c89f7224185e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:35.938867 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b134db-e4fc-4bec-8d77-c89f7224185e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:35.940274 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b134db-e4fc-4bec-8d77-c89f7224185e service neutron] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:35.949849 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 932/1854] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:42:35.957186 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 923/1855] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:42:35 2022] PUT /identity/v3/projects/79ffb1481fc347baa241129f0c25be00/users/00ca99b10bdb45dc9a0c2d33948f5ea2/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:42:35.960400 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b134db-e4fc-4bec-8d77-c89f7224185e service neutron] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:35.970891 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b134db-e4fc-4bec-8d77-c89f7224185e service neutron] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:36.026516 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0fdd06-2f60-4fe9-ae02-74288f774521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:36.027186 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0fdd06-2f60-4fe9-ae02-74288f774521 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:36.027465 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0fdd06-2f60-4fe9-ae02-74288f774521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:36.027762 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0fdd06-2f60-4fe9-ae02-74288f774521 admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:36.028525 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0fdd06-2f60-4fe9-ae02-74288f774521 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:36.031034 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0fdd06-2f60-4fe9-ae02-74288f774521 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:36.041230 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 933/1856] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:35 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 10:42:36.045968 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7740b1-15c5-4c86-a4e7-026a2dc7ef9e admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:36.058714 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7740b1-15c5-4c86-a4e7-026a2dc7ef9e admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:36.063959 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd3ceee-fe02-41dd-b405-423ef8313afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:36.064868 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3ceee-fe02-41dd-b405-423ef8313afc admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:36.065173 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3ceee-fe02-41dd-b405-423ef8313afc admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:36.065444 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3ceee-fe02-41dd-b405-423ef8313afc admin admin] PATH_INFO: `/v3/projects/79ffb1481fc347baa241129f0c25be00/users/00ca99b10bdb45dc9a0c2d33948f5ea2/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:36.067574 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd3ceee-fe02-41dd-b405-423ef8313afc admin admin] RBAC: Authorizing `identity:create_grant(project_id=79ffb1481fc347baa241129f0c25be00, user_id=00ca99b10bdb45dc9a0c2d33948f5ea2, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:36.070247 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd3ceee-fe02-41dd-b405-423ef8313afc admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:36.082183 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 924/1857] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:42:36 2022] PUT /identity/v3/projects/79ffb1481fc347baa241129f0c25be00/users/00ca99b10bdb45dc9a0c2d33948f5ea2/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:36.093846 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475e332-116c-4deb-983b-0315b796e1e1 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:36.094369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475e332-116c-4deb-983b-0315b796e1e1 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:36.094650 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475e332-116c-4deb-983b-0315b796e1e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:36.126220 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-3475e332-116c-4deb-983b-0315b796e1e1 None None] MFA Rules not processed for user `00ca99b10bdb45dc9a0c2d33948f5ea2`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:36.128190 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-3475e332-116c-4deb-983b-0315b796e1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:36.256786 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 934/1858] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:42:36 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:36.355704 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd3ceee-fe02-41dd-b405-423ef8313afc admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:36.357765 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-4bd3ceee-fe02-41dd-b405-423ef8313afc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:36.455579 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd3ceee-fe02-41dd-b405-423ef8313afc admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:36.471204 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abecd9d-a140-4f28-8f47-896d0d2d66bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:36.472051 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abecd9d-a140-4f28-8f47-896d0d2d66bb service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:36.472709 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abecd9d-a140-4f28-8f47-896d0d2d66bb service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:36.472980 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abecd9d-a140-4f28-8f47-896d0d2d66bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:36.486001 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abecd9d-a140-4f28-8f47-896d0d2d66bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:36.488018 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abecd9d-a140-4f28-8f47-896d0d2d66bb service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:36.508187 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 925/1859] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:36 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:42:36.697839 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=82,keystone:DELETE=14,keystone:INSERT=4 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:36.710308 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:37.206732 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3475e332-116c-4deb-983b-0315b796e1e1 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:37.208261 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-3475e332-116c-4deb-983b-0315b796e1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:37.344705 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3475e332-116c-4deb-983b-0315b796e1e1 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:37.357618 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2018973-0697-4254-b130-2dc405d87cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:37.360647 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2018973-0697-4254-b130-2dc405d87cbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:37.363143 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2018973-0697-4254-b130-2dc405d87cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:37.374878 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2018973-0697-4254-b130-2dc405d87cbe admin admin] PATH_INFO: `/v3/users/d7a8d9db575b48feb9c43bc661617a5d` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:37.380227 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2018973-0697-4254-b130-2dc405d87cbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7a8d9db575b48feb9c43bc661617a5d)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:37.383651 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2018973-0697-4254-b130-2dc405d87cbe admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:37.747629 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-c2018973-0697-4254-b130-2dc405d87cbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7a8d9db575b48feb9c43bc661617a5d'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:37.762901 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abecd9d-a140-4f28-8f47-896d0d2d66bb service cinder] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:37.770267 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-1abecd9d-a140-4f28-8f47-896d0d2d66bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:37.812795 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abecd9d-a140-4f28-8f47-896d0d2d66bb service cinder] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:37.818225 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-c2018973-0697-4254-b130-2dc405d87cbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7a8d9db575b48feb9c43bc661617a5d'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:37.819140 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-c2018973-0697-4254-b130-2dc405d87cbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7a8d9db575b48feb9c43bc661617a5d'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:37.827925 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1367fbc-0edb-43de-9a21-c48184519b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:37.833608 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1367fbc-0edb-43de-9a21-c48184519b8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:37.833608 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1367fbc-0edb-43de-9a21-c48184519b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:37.833608 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1367fbc-0edb-43de-9a21-c48184519b8b admin admin] PATH_INFO: `/v3/users/b0d277cd5b864c22acc3258624594832` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:37.842448 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-c2018973-0697-4254-b130-2dc405d87cbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7a8d9db575b48feb9c43bc661617a5d'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:37.853994 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1367fbc-0edb-43de-9a21-c48184519b8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0d277cd5b864c22acc3258624594832)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:37.855035 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-c2018973-0697-4254-b130-2dc405d87cbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7a8d9db575b48feb9c43bc661617a5d'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:37.862305 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1367fbc-0edb-43de-9a21-c48184519b8b admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:37.863153 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 935/1860] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:42:37 2022] DELETE /identity/v3/users/d7a8d9db575b48feb9c43bc661617a5d => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:37.867965 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20558d5a-1c56-43eb-97aa-cfa39ed7c9a6 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:37.868347 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20558d5a-1c56-43eb-97aa-cfa39ed7c9a6 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:37.868763 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20558d5a-1c56-43eb-97aa-cfa39ed7c9a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:37.910351 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-20558d5a-1c56-43eb-97aa-cfa39ed7c9a6 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:37.911792 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-20558d5a-1c56-43eb-97aa-cfa39ed7c9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:38.016705 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 936/1861] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:42:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:42:38.017936 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20558d5a-1c56-43eb-97aa-cfa39ed7c9a6 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:38.026400 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-20558d5a-1c56-43eb-97aa-cfa39ed7c9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:38.042835 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20558d5a-1c56-43eb-97aa-cfa39ed7c9a6 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:38.048219 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d361fac-59e9-4ce4-a190-398e5240c9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:38.049269 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d361fac-59e9-4ce4-a190-398e5240c9c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:38.049551 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d361fac-59e9-4ce4-a190-398e5240c9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:38.049823 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d361fac-59e9-4ce4-a190-398e5240c9c4 admin admin] PATH_INFO: `/v3/users/ecc0420029354870a65e4bd7cef4c37c` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:38.051091 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d361fac-59e9-4ce4-a190-398e5240c9c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecc0420029354870a65e4bd7cef4c37c)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:38.053098 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d361fac-59e9-4ce4-a190-398e5240c9c4 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:38.109814 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-d1367fbc-0edb-43de-9a21-c48184519b8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0d277cd5b864c22acc3258624594832'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:38.195563 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-d1367fbc-0edb-43de-9a21-c48184519b8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0d277cd5b864c22acc3258624594832'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:38.196201 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-d1367fbc-0edb-43de-9a21-c48184519b8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0d277cd5b864c22acc3258624594832'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:38.214325 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-d1367fbc-0edb-43de-9a21-c48184519b8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0d277cd5b864c22acc3258624594832'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:38.222878 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-d1367fbc-0edb-43de-9a21-c48184519b8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0d277cd5b864c22acc3258624594832'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:38.233163 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 926/1862] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:42:37 2022] DELETE /identity/v3/users/b0d277cd5b864c22acc3258624594832 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:38.233163 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1367fbc-0edb-43de-9a21-c48184519b8b admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:38.233163 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-d1367fbc-0edb-43de-9a21-c48184519b8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:38.295669 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1367fbc-0edb-43de-9a21-c48184519b8b admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:38.299889 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bf30e5-5325-42f7-86dd-9acbb999654b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:38.300947 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf30e5-5325-42f7-86dd-9acbb999654b service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:38.301489 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf30e5-5325-42f7-86dd-9acbb999654b service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:38.301912 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf30e5-5325-42f7-86dd-9acbb999654b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:38.303915 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-f0bf30e5-5325-42f7-86dd-9acbb999654b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:38.356808 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-7d361fac-59e9-4ce4-a190-398e5240c9c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecc0420029354870a65e4bd7cef4c37c'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:38.385447 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bf30e5-5325-42f7-86dd-9acbb999654b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:38.386957 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bf30e5-5325-42f7-86dd-9acbb999654b service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:38.402485 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 927/1863] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:42:38.406154 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec3d12-c967-4353-8b1b-71f9e94c2838 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:38.407340 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec3d12-c967-4353-8b1b-71f9e94c2838 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:38.407340 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec3d12-c967-4353-8b1b-71f9e94c2838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:38.418965 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-7d361fac-59e9-4ce4-a190-398e5240c9c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecc0420029354870a65e4bd7cef4c37c'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:38.420448 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-7d361fac-59e9-4ce4-a190-398e5240c9c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecc0420029354870a65e4bd7cef4c37c'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:38.450697 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-7d361fac-59e9-4ce4-a190-398e5240c9c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecc0420029354870a65e4bd7cef4c37c'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:38.455916 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-50ec3d12-c967-4353-8b1b-71f9e94c2838 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:38.456044 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-50ec3d12-c967-4353-8b1b-71f9e94c2838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:38.465415 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-7d361fac-59e9-4ce4-a190-398e5240c9c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecc0420029354870a65e4bd7cef4c37c'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:38.470182 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 928/1864] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:42:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:38.477356 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c197c9-101c-450b-804f-f5f1c7bd705d None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:38.477820 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c197c9-101c-450b-804f-f5f1c7bd705d None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:38.478273 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c197c9-101c-450b-804f-f5f1c7bd705d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:38.479058 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 937/1865] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:42:38 2022] DELETE /identity/v3/users/ecc0420029354870a65e4bd7cef4c37c => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:38.486162 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d361fac-59e9-4ce4-a190-398e5240c9c4 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:38.490187 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-7d361fac-59e9-4ce4-a190-398e5240c9c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:38.526702 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-64c197c9-101c-450b-804f-f5f1c7bd705d None None] MFA Rules not processed for user `8b8c227ea8e64dc19038a37f78e6faa2`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:38.528142 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-64c197c9-101c-450b-804f-f5f1c7bd705d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:38.605861 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d361fac-59e9-4ce4-a190-398e5240c9c4 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:38.612630 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9904b8-e748-4c16-bf97-d4527226065a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:38.613367 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9904b8-e748-4c16-bf97-d4527226065a service neutron] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:38.613742 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9904b8-e748-4c16-bf97-d4527226065a service neutron] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:38.614120 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9904b8-e748-4c16-bf97-d4527226065a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:38.618805 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 929/1866] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:42:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:38.620880 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c944bd-aba5-45fe-8c10-8dea09e5bd62 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:38.621219 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c944bd-aba5-45fe-8c10-8dea09e5bd62 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:38.621660 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c944bd-aba5-45fe-8c10-8dea09e5bd62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:38.645985 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-12c944bd-aba5-45fe-8c10-8dea09e5bd62 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:38.653358 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-12c944bd-aba5-45fe-8c10-8dea09e5bd62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:38.730510 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9904b8-e748-4c16-bf97-d4527226065a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:38.732147 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9904b8-e748-4c16-bf97-d4527226065a service neutron] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:38.743978 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 930/1867] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:42:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:38.744912 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c944bd-aba5-45fe-8c10-8dea09e5bd62 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:38.747497 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-12c944bd-aba5-45fe-8c10-8dea09e5bd62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:38.764410 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 938/1868] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:42:38.765506 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9904b8-e748-4c16-bf97-d4527226065a service neutron] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:38.769000 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-1f9904b8-e748-4c16-bf97-d4527226065a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:38.782542 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c944bd-aba5-45fe-8c10-8dea09e5bd62 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:38.785889 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9904b8-e748-4c16-bf97-d4527226065a service neutron] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:38.790674 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1dfeb7-a34a-4e57-9313-6ac4f5958677 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:38.791717 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1dfeb7-a34a-4e57-9313-6ac4f5958677 service neutron] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:38.792109 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1dfeb7-a34a-4e57-9313-6ac4f5958677 service neutron] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:38.792488 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1dfeb7-a34a-4e57-9313-6ac4f5958677 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:38.801560 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd1a21-2424-4785-b7a1-d04aa4705acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:38.809289 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1dfeb7-a34a-4e57-9313-6ac4f5958677 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:38.813896 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1dfeb7-a34a-4e57-9313-6ac4f5958677 service neutron] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:38.815256 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd1a21-2424-4785-b7a1-d04aa4705acd admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:38.815548 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd1a21-2424-4785-b7a1-d04aa4705acd admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:38.815829 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd1a21-2424-4785-b7a1-d04aa4705acd admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:38.816553 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcd1a21-2424-4785-b7a1-d04aa4705acd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:38.818565 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcd1a21-2424-4785-b7a1-d04aa4705acd admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:38.842966 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 939/1869] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:42:38.962285 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 931/1870] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:42:38 2022] POST /identity/v3/projects => generated 371 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:42:38.963613 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1dfeb7-a34a-4e57-9313-6ac4f5958677 service neutron] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:38.969748 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd1a21-2424-4785-b7a1-d04aa4705acd admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:38.974788 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-1fcd1a21-2424-4785-b7a1-d04aa4705acd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:38.980643 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1dfeb7-a34a-4e57-9313-6ac4f5958677 service neutron] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:39.144183 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd1a21-2424-4785-b7a1-d04aa4705acd admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:39.149393 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b787dc04-0169-4dcb-8a53-b50a5397dde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:39.150093 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787dc04-0169-4dcb-8a53-b50a5397dde3 admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:39.150381 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787dc04-0169-4dcb-8a53-b50a5397dde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:39.150664 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787dc04-0169-4dcb-8a53-b50a5397dde3 admin admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:39.151356 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b787dc04-0169-4dcb-8a53-b50a5397dde3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:39.153321 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b787dc04-0169-4dcb-8a53-b50a5397dde3 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:39.166693 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a10fc-67d8-4a99-a793-24a1d0e594a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:39.168855 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a10fc-67d8-4a99-a793-24a1d0e594a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:39.169630 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a10fc-67d8-4a99-a793-24a1d0e594a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:39.170757 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a10fc-67d8-4a99-a793-24a1d0e594a9 admin admin] PATH_INFO: `/v3/projects/9739e3d6689240a097a130e0458fb7a6` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:39.173096 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5a10fc-67d8-4a99-a793-24a1d0e594a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9739e3d6689240a097a130e0458fb7a6)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:39.177751 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5a10fc-67d8-4a99-a793-24a1d0e594a9 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:39.237634 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 940/1871] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:42:38 2022] POST /identity/v3/users => generated 292 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:42:39.240588 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b787dc04-0169-4dcb-8a53-b50a5397dde3 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:39.259414 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b787dc04-0169-4dcb-8a53-b50a5397dde3 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:39.269437 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d98d9c-671b-487e-bca6-c79d6ee87336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:39.270566 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d98d9c-671b-487e-bca6-c79d6ee87336 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:39.271623 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d98d9c-671b-487e-bca6-c79d6ee87336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:39.272057 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d98d9c-671b-487e-bca6-c79d6ee87336 admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:39.273647 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d98d9c-671b-487e-bca6-c79d6ee87336 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:39.275723 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d98d9c-671b-487e-bca6-c79d6ee87336 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:39.304971 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 941/1872] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:42:39.306876 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d98d9c-671b-487e-bca6-c79d6ee87336 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:39.323443 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d98d9c-671b-487e-bca6-c79d6ee87336 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:39.334552 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc9c435-6e30-431a-980b-c9aa7b0a935a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:39.334552 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9c435-6e30-431a-980b-c9aa7b0a935a admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:39.334552 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9c435-6e30-431a-980b-c9aa7b0a935a admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:39.334552 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9c435-6e30-431a-980b-c9aa7b0a935a admin admin] PATH_INFO: `/v3/projects/4b06eb4656fa4ca18f6a72e3b434a20f/users/cdd5469c53254381ac438139cb3655d2/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:39.362377 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc9c435-6e30-431a-980b-c9aa7b0a935a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b06eb4656fa4ca18f6a72e3b434a20f, user_id=cdd5469c53254381ac438139cb3655d2, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:39.365778 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc9c435-6e30-431a-980b-c9aa7b0a935a admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:39.390403 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1b5a10fc-67d8-4a99-a793-24a1d0e594a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9739e3d6689240a097a130e0458fb7a6', 'request_id': 'req-1b5a10fc-67d8-4a99-a793-24a1d0e594a9'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:39.407316 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1b5a10fc-67d8-4a99-a793-24a1d0e594a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9739e3d6689240a097a130e0458fb7a6', 'request_id': 'req-1b5a10fc-67d8-4a99-a793-24a1d0e594a9'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:39.424424 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:39.431548 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1b5a10fc-67d8-4a99-a793-24a1d0e594a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9739e3d6689240a097a130e0458fb7a6', 'request_id': 'req-1b5a10fc-67d8-4a99-a793-24a1d0e594a9'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:39.462031 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 942/1873] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:42:39 2022] PUT /identity/v3/projects/4b06eb4656fa4ca18f6a72e3b434a20f/users/cdd5469c53254381ac438139cb3655d2/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:39.466434 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc9c435-6e30-431a-980b-c9aa7b0a935a admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:39.553326 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1b5a10fc-67d8-4a99-a793-24a1d0e594a9 admin admin] The token cache is being invalidate because project 9739e3d6689240a097a130e0458fb7a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:42:39.553326 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1b5a10fc-67d8-4a99-a793-24a1d0e594a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:39.554696 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1b5a10fc-67d8-4a99-a793-24a1d0e594a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:39.556556 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 932/1874] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:42:38 2022] DELETE /identity/v3/projects/9739e3d6689240a097a130e0458fb7a6 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:39.560643 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a10fc-67d8-4a99-a793-24a1d0e594a9 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:39.563977 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-1b5a10fc-67d8-4a99-a793-24a1d0e594a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:39.596451 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc9c435-6e30-431a-980b-c9aa7b0a935a admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:39.614982 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:39.622808 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce47ef0-7367-418b-b555-b6aadf534c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:39.624121 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce47ef0-7367-418b-b555-b6aadf534c23 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:39.624997 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce47ef0-7367-418b-b555-b6aadf534c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:39.624997 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce47ef0-7367-418b-b555-b6aadf534c23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:39.625774 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce47ef0-7367-418b-b555-b6aadf534c23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:39.627410 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce47ef0-7367-418b-b555-b6aadf534c23 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:39.662647 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 943/1875] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:42:39.663612 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce47ef0-7367-418b-b555-b6aadf534c23 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:39.667349 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-fce47ef0-7367-418b-b555-b6aadf534c23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:39.689822 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce47ef0-7367-418b-b555-b6aadf534c23 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:39.698678 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a22991-a31e-4e86-9871-0e6e39ff7022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:39.699654 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a22991-a31e-4e86-9871-0e6e39ff7022 admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:39.700013 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a22991-a31e-4e86-9871-0e6e39ff7022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:39.700293 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a22991-a31e-4e86-9871-0e6e39ff7022 admin admin] PATH_INFO: `/v3/projects/4b06eb4656fa4ca18f6a72e3b434a20f/users/cdd5469c53254381ac438139cb3655d2/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:39.704157 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a22991-a31e-4e86-9871-0e6e39ff7022 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b06eb4656fa4ca18f6a72e3b434a20f, user_id=cdd5469c53254381ac438139cb3655d2, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:39.707540 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a22991-a31e-4e86-9871-0e6e39ff7022 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:39.730393 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a10fc-67d8-4a99-a793-24a1d0e594a9 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:39.730607 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 944/1876] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:42:39 2022] PUT /identity/v3/projects/4b06eb4656fa4ca18f6a72e3b434a20f/users/cdd5469c53254381ac438139cb3655d2/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:39.824301 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a410edbb-5fb3-44de-9f7f-ee10cbe3bfcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:39.825708 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a410edbb-5fb3-44de-9f7f-ee10cbe3bfcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:39.826743 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a410edbb-5fb3-44de-9f7f-ee10cbe3bfcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:39.827894 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a410edbb-5fb3-44de-9f7f-ee10cbe3bfcc admin admin] PATH_INFO: `/v3/users/98bd9c5463c646f3a9ae86cad0645649` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:39.829407 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a410edbb-5fb3-44de-9f7f-ee10cbe3bfcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=98bd9c5463c646f3a9ae86cad0645649)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:39.831562 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a410edbb-5fb3-44de-9f7f-ee10cbe3bfcc admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:39.849326 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a0876-d25b-4324-898d-7495089a518f None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:39.850654 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a0876-d25b-4324-898d-7495089a518f None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:39.854746 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31a0876-d25b-4324-898d-7495089a518f None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:39.854746 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 945/1877] 10.222.0.39 () {54 vars in 921 bytes} [Mon Jul 18 10:42:39 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:42:39.868123 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa8b49-8fba-4b89-bdd9-3811440c99bd None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:39.868919 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa8b49-8fba-4b89-bdd9-3811440c99bd None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:39.869561 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa8b49-8fba-4b89-bdd9-3811440c99bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:39.892801 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-87aa8b49-8fba-4b89-bdd9-3811440c99bd None None] MFA Rules not processed for user `8bbebf16219943879df84bdc9a900516`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:39.895777 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-87aa8b49-8fba-4b89-bdd9-3811440c99bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:39.971755 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 946/1878] 10.222.0.39 () {58 vars in 1018 bytes} [Mon Jul 18 10:42:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:39.987734 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa8b49-8fba-4b89-bdd9-3811440c99bd None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:39.989729 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-87aa8b49-8fba-4b89-bdd9-3811440c99bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:40.007376 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa8b49-8fba-4b89-bdd9-3811440c99bd None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:40.016061 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088df20b-e006-480e-ae0d-a856f7a27ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:40.017355 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088df20b-e006-480e-ae0d-a856f7a27ee3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:40.017776 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088df20b-e006-480e-ae0d-a856f7a27ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:40.018126 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088df20b-e006-480e-ae0d-a856f7a27ee3 admin admin] PATH_INFO: `/v3/projects/e0b03242dfed4080a0cde44bc4ebbd95` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:40.020346 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088df20b-e006-480e-ae0d-a856f7a27ee3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0b03242dfed4080a0cde44bc4ebbd95)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:40.024091 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088df20b-e006-480e-ae0d-a856f7a27ee3 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:40.054938 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a410edbb-5fb3-44de-9f7f-ee10cbe3bfcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98bd9c5463c646f3a9ae86cad0645649'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:40.115237 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a410edbb-5fb3-44de-9f7f-ee10cbe3bfcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98bd9c5463c646f3a9ae86cad0645649'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:40.115937 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a410edbb-5fb3-44de-9f7f-ee10cbe3bfcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98bd9c5463c646f3a9ae86cad0645649'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:40.136898 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a410edbb-5fb3-44de-9f7f-ee10cbe3bfcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98bd9c5463c646f3a9ae86cad0645649'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:40.148205 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a410edbb-5fb3-44de-9f7f-ee10cbe3bfcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98bd9c5463c646f3a9ae86cad0645649'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:40.155486 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 933/1879] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:42:39 2022] DELETE /identity/v3/users/98bd9c5463c646f3a9ae86cad0645649 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:40.156471 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a410edbb-5fb3-44de-9f7f-ee10cbe3bfcc admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:40.159301 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-a410edbb-5fb3-44de-9f7f-ee10cbe3bfcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:40.163458 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-088df20b-e006-480e-ae0d-a856f7a27ee3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0b03242dfed4080a0cde44bc4ebbd95', 'request_id': 'req-088df20b-e006-480e-ae0d-a856f7a27ee3'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:40.174391 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-088df20b-e006-480e-ae0d-a856f7a27ee3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0b03242dfed4080a0cde44bc4ebbd95', 'request_id': 'req-088df20b-e006-480e-ae0d-a856f7a27ee3'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:40.182547 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-088df20b-e006-480e-ae0d-a856f7a27ee3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0b03242dfed4080a0cde44bc4ebbd95', 'request_id': 'req-088df20b-e006-480e-ae0d-a856f7a27ee3'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:40.268723 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a410edbb-5fb3-44de-9f7f-ee10cbe3bfcc admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:40.274764 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7812b512-e884-4856-a04b-d82682731ed3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bbebf16219943879df84bdc9a900516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:40.275441 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812b512-e884-4856-a04b-d82682731ed3 service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:40.275730 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812b512-e884-4856-a04b-d82682731ed3 service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:40.276012 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7812b512-e884-4856-a04b-d82682731ed3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:40.278625 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-7812b512-e884-4856-a04b-d82682731ed3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:40.283008 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-088df20b-e006-480e-ae0d-a856f7a27ee3 admin admin] The token cache is being invalidate because project e0b03242dfed4080a0cde44bc4ebbd95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80392) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:42:40.283308 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-088df20b-e006-480e-ae0d-a856f7a27ee3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:40.283959 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-088df20b-e006-480e-ae0d-a856f7a27ee3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:40.285601 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 947/1880] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:42:39 2022] DELETE /identity/v3/projects/e0b03242dfed4080a0cde44bc4ebbd95 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:40.286500 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088df20b-e006-480e-ae0d-a856f7a27ee3 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:40.287846 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-088df20b-e006-480e-ae0d-a856f7a27ee3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:40.291569 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7812b512-e884-4856-a04b-d82682731ed3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:40.293344 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7812b512-e884-4856-a04b-d82682731ed3 service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:40.306552 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 934/1881] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:42:40.311525 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7812b512-e884-4856-a04b-d82682731ed3 service nova] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:40.311525 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-7812b512-e884-4856-a04b-d82682731ed3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:40.376466 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088df20b-e006-480e-ae0d-a856f7a27ee3 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:40.490866 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7812b512-e884-4856-a04b-d82682731ed3 service nova] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:40.496691 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78627bc6-43c8-4215-af92-5f2cc1b72f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:40.497943 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78627bc6-43c8-4215-af92-5f2cc1b72f68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:40.499190 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78627bc6-43c8-4215-af92-5f2cc1b72f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:40.499190 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78627bc6-43c8-4215-af92-5f2cc1b72f68 admin admin] PATH_INFO: `/v3/users/86f517e68b184c77b040dabbe1e9f663` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:40.501079 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78627bc6-43c8-4215-af92-5f2cc1b72f68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86f517e68b184c77b040dabbe1e9f663)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:40.503514 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78627bc6-43c8-4215-af92-5f2cc1b72f68 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:40.520319 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee77cb-e5b5-4d1d-86c8-328196f9cc68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:40.532575 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee77cb-e5b5-4d1d-86c8-328196f9cc68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:40.532911 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee77cb-e5b5-4d1d-86c8-328196f9cc68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:40.533231 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee77cb-e5b5-4d1d-86c8-328196f9cc68 admin admin] PATH_INFO: `/v3/projects/d17c53793a9f46d1a194d4889653cf36` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:40.536579 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ee77cb-e5b5-4d1d-86c8-328196f9cc68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d17c53793a9f46d1a194d4889653cf36)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:40.538824 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ee77cb-e5b5-4d1d-86c8-328196f9cc68 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:40.703109 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-76ee77cb-e5b5-4d1d-86c8-328196f9cc68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd17c53793a9f46d1a194d4889653cf36', 'request_id': 'req-76ee77cb-e5b5-4d1d-86c8-328196f9cc68'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:40.724124 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-76ee77cb-e5b5-4d1d-86c8-328196f9cc68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd17c53793a9f46d1a194d4889653cf36', 'request_id': 'req-76ee77cb-e5b5-4d1d-86c8-328196f9cc68'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:40.731331 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-76ee77cb-e5b5-4d1d-86c8-328196f9cc68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd17c53793a9f46d1a194d4889653cf36', 'request_id': 'req-76ee77cb-e5b5-4d1d-86c8-328196f9cc68'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:40.764329 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-78627bc6-43c8-4215-af92-5f2cc1b72f68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86f517e68b184c77b040dabbe1e9f663'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:40.852569 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-76ee77cb-e5b5-4d1d-86c8-328196f9cc68 admin admin] The token cache is being invalidate because project d17c53793a9f46d1a194d4889653cf36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80392) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:42:40.853844 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-76ee77cb-e5b5-4d1d-86c8-328196f9cc68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:40.854741 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-76ee77cb-e5b5-4d1d-86c8-328196f9cc68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:40.856875 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 948/1882] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:42:40 2022] DELETE /identity/v3/projects/d17c53793a9f46d1a194d4889653cf36 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:40.858114 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee77cb-e5b5-4d1d-86c8-328196f9cc68 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:40.860117 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-76ee77cb-e5b5-4d1d-86c8-328196f9cc68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:40.938415 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-78627bc6-43c8-4215-af92-5f2cc1b72f68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86f517e68b184c77b040dabbe1e9f663'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:40.940009 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-78627bc6-43c8-4215-af92-5f2cc1b72f68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86f517e68b184c77b040dabbe1e9f663'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:40.948961 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee77cb-e5b5-4d1d-86c8-328196f9cc68 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:40.956977 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a5664-787a-4e81-80c3-b583142c7377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:40.958769 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a5664-787a-4e81-80c3-b583142c7377 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:40.959047 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-78627bc6-43c8-4215-af92-5f2cc1b72f68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86f517e68b184c77b040dabbe1e9f663'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:40.959287 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a5664-787a-4e81-80c3-b583142c7377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:40.959624 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a5664-787a-4e81-80c3-b583142c7377 admin admin] PATH_INFO: `/v3/projects/832c4d8926d94e2492f21c4117d2f413` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:40.960936 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a5664-787a-4e81-80c3-b583142c7377 admin admin] RBAC: Authorizing `identity:delete_project(project_id=832c4d8926d94e2492f21c4117d2f413)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:40.963112 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a5664-787a-4e81-80c3-b583142c7377 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:40.972215 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-78627bc6-43c8-4215-af92-5f2cc1b72f68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86f517e68b184c77b040dabbe1e9f663'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:40.981525 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 935/1883] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:42:40 2022] DELETE /identity/v3/users/86f517e68b184c77b040dabbe1e9f663 => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:40.983364 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78627bc6-43c8-4215-af92-5f2cc1b72f68 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:40.985802 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-78627bc6-43c8-4215-af92-5f2cc1b72f68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:41.073312 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78627bc6-43c8-4215-af92-5f2cc1b72f68 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:41.080812 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2952dbd2-66bc-45ff-99a4-373597ca21c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:41.082400 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952dbd2-66bc-45ff-99a4-373597ca21c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:41.082907 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952dbd2-66bc-45ff-99a4-373597ca21c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:41.083640 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952dbd2-66bc-45ff-99a4-373597ca21c5 admin admin] PATH_INFO: `/v3/users/00ca99b10bdb45dc9a0c2d33948f5ea2` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:41.087437 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2952dbd2-66bc-45ff-99a4-373597ca21c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00ca99b10bdb45dc9a0c2d33948f5ea2)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:41.090842 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2952dbd2-66bc-45ff-99a4-373597ca21c5 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:41.129963 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-ad7a5664-787a-4e81-80c3-b583142c7377 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '832c4d8926d94e2492f21c4117d2f413', 'request_id': 'req-ad7a5664-787a-4e81-80c3-b583142c7377'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:41.139618 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-ad7a5664-787a-4e81-80c3-b583142c7377 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '832c4d8926d94e2492f21c4117d2f413', 'request_id': 'req-ad7a5664-787a-4e81-80c3-b583142c7377'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:41.147496 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-ad7a5664-787a-4e81-80c3-b583142c7377 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '832c4d8926d94e2492f21c4117d2f413', 'request_id': 'req-ad7a5664-787a-4e81-80c3-b583142c7377'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:41.167661 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:41.211287 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-ad7a5664-787a-4e81-80c3-b583142c7377 admin admin] The token cache is being invalidate because project 832c4d8926d94e2492f21c4117d2f413 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80392) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:42:41.211659 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-ad7a5664-787a-4e81-80c3-b583142c7377 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:41.212478 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-ad7a5664-787a-4e81-80c3-b583142c7377 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:41.214454 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 949/1884] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:42:40 2022] DELETE /identity/v3/projects/832c4d8926d94e2492f21c4117d2f413 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:41.219834 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a5664-787a-4e81-80c3-b583142c7377 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:41.225238 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-ad7a5664-787a-4e81-80c3-b583142c7377 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:41.287377 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-2952dbd2-66bc-45ff-99a4-373597ca21c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00ca99b10bdb45dc9a0c2d33948f5ea2'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:41.333318 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a5664-787a-4e81-80c3-b583142c7377 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:41.338208 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88586f4a-ca4f-4984-85e9-e7fbe781c428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:41.339135 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88586f4a-ca4f-4984-85e9-e7fbe781c428 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:41.339423 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88586f4a-ca4f-4984-85e9-e7fbe781c428 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:41.339714 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88586f4a-ca4f-4984-85e9-e7fbe781c428 admin admin] PATH_INFO: `/v3/users/dd5edf5fd3864e03a4402e9c31fa67c7` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:41.340950 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88586f4a-ca4f-4984-85e9-e7fbe781c428 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd5edf5fd3864e03a4402e9c31fa67c7)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:41.343142 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88586f4a-ca4f-4984-85e9-e7fbe781c428 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:41.373012 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-2952dbd2-66bc-45ff-99a4-373597ca21c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00ca99b10bdb45dc9a0c2d33948f5ea2'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:41.375540 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-2952dbd2-66bc-45ff-99a4-373597ca21c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00ca99b10bdb45dc9a0c2d33948f5ea2'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:41.389256 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-2952dbd2-66bc-45ff-99a4-373597ca21c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00ca99b10bdb45dc9a0c2d33948f5ea2'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:41.396632 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-2952dbd2-66bc-45ff-99a4-373597ca21c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00ca99b10bdb45dc9a0c2d33948f5ea2'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:41.407001 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 936/1885] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:42:40 2022] DELETE /identity/v3/users/00ca99b10bdb45dc9a0c2d33948f5ea2 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:41.448432 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:41.500669 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a5c58-945b-45e8-8756-7d1ee54adcd8 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:41.500993 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a5c58-945b-45e8-8756-7d1ee54adcd8 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:41.501290 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a5c58-945b-45e8-8756-7d1ee54adcd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:41.533774 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-312a5c58-945b-45e8-8756-7d1ee54adcd8 None None] MFA Rules not processed for user `cdd5469c53254381ac438139cb3655d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:41.535109 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-312a5c58-945b-45e8-8756-7d1ee54adcd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:41.637028 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 937/1886] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:42:41 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:42:41.641788 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce02d97-ce2b-4a2d-a432-abfc0015fee6 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:41.643101 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce02d97-ce2b-4a2d-a432-abfc0015fee6 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:41.643780 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce02d97-ce2b-4a2d-a432-abfc0015fee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:41.653560 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-88586f4a-ca4f-4984-85e9-e7fbe781c428 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd5edf5fd3864e03a4402e9c31fa67c7'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:41.665191 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-1ce02d97-ce2b-4a2d-a432-abfc0015fee6 None None] MFA Rules not processed for user `8b8c227ea8e64dc19038a37f78e6faa2`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:41.666724 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-1ce02d97-ce2b-4a2d-a432-abfc0015fee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:41.715128 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-88586f4a-ca4f-4984-85e9-e7fbe781c428 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd5edf5fd3864e03a4402e9c31fa67c7'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:41.716204 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-88586f4a-ca4f-4984-85e9-e7fbe781c428 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd5edf5fd3864e03a4402e9c31fa67c7'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:41.735824 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 938/1887] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:42:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:41.745692 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-88586f4a-ca4f-4984-85e9-e7fbe781c428 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd5edf5fd3864e03a4402e9c31fa67c7'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:41.757065 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-88586f4a-ca4f-4984-85e9-e7fbe781c428 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd5edf5fd3864e03a4402e9c31fa67c7'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:41.764450 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 950/1888] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:42:41 2022] DELETE /identity/v3/users/dd5edf5fd3864e03a4402e9c31fa67c7 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:41.842832 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce02d97-ce2b-4a2d-a432-abfc0015fee6 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:41.844518 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-1ce02d97-ce2b-4a2d-a432-abfc0015fee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:41.903799 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:41.923057 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce02d97-ce2b-4a2d-a432-abfc0015fee6 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:41.987079 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db43a565-f305-4b4a-abc8-24092a538e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:41.988106 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43a565-f305-4b4a-abc8-24092a538e41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:41.988452 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43a565-f305-4b4a-abc8-24092a538e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:41.988730 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43a565-f305-4b4a-abc8-24092a538e41 admin admin] PATH_INFO: `/v3/projects/0baf522b73a54909950a304a024ceddf` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:41.989978 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db43a565-f305-4b4a-abc8-24092a538e41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0baf522b73a54909950a304a024ceddf)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:41.992068 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db43a565-f305-4b4a-abc8-24092a538e41 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:42.049468 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88586f4a-ca4f-4984-85e9-e7fbe781c428 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:42.061689 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-88586f4a-ca4f-4984-85e9-e7fbe781c428 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:42.175938 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88586f4a-ca4f-4984-85e9-e7fbe781c428 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:42.179663 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-db43a565-f305-4b4a-abc8-24092a538e41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0baf522b73a54909950a304a024ceddf', 'request_id': 'req-db43a565-f305-4b4a-abc8-24092a538e41'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:42.187539 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-db43a565-f305-4b4a-abc8-24092a538e41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0baf522b73a54909950a304a024ceddf', 'request_id': 'req-db43a565-f305-4b4a-abc8-24092a538e41'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:42.193846 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-db43a565-f305-4b4a-abc8-24092a538e41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0baf522b73a54909950a304a024ceddf', 'request_id': 'req-db43a565-f305-4b4a-abc8-24092a538e41'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:42.245947 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6695a5-e528-43f0-a3a4-b8246bf2fad1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bbebf16219943879df84bdc9a900516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:42.246977 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6695a5-e528-43f0-a3a4-b8246bf2fad1 service nova] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:42.246977 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6695a5-e528-43f0-a3a4-b8246bf2fad1 service nova] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:42.247260 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6695a5-e528-43f0-a3a4-b8246bf2fad1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:42.250443 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-ac6695a5-e528-43f0-a3a4-b8246bf2fad1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:42.320469 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6695a5-e528-43f0-a3a4-b8246bf2fad1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:42.322481 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6695a5-e528-43f0-a3a4-b8246bf2fad1 service nova] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:42.333007 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-db43a565-f305-4b4a-abc8-24092a538e41 admin admin] The token cache is being invalidate because project 0baf522b73a54909950a304a024ceddf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:42:42.333320 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-db43a565-f305-4b4a-abc8-24092a538e41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:42.333991 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-db43a565-f305-4b4a-abc8-24092a538e41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:42.335802 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 939/1889] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:42:41 2022] DELETE /identity/v3/projects/0baf522b73a54909950a304a024ceddf => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:42.336559 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 951/1890] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:42:42.347228 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f2618-5fea-4593-a102-26ec0499edd9 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:42.349419 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f2618-5fea-4593-a102-26ec0499edd9 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:42.353374 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f2618-5fea-4593-a102-26ec0499edd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:42.378412 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6695a5-e528-43f0-a3a4-b8246bf2fad1 service nova] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:42.380072 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-ac6695a5-e528-43f0-a3a4-b8246bf2fad1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:42.408313 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-125f2618-5fea-4593-a102-26ec0499edd9 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:42.417125 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-125f2618-5fea-4593-a102-26ec0499edd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:42.507341 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 940/1891] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:42:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:42.513450 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6695a5-e528-43f0-a3a4-b8246bf2fad1 service nova] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:42.518348 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee84619-c608-4f1d-aa13-cd0b8245cd74 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:42.518629 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee84619-c608-4f1d-aa13-cd0b8245cd74 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:42.519015 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee84619-c608-4f1d-aa13-cd0b8245cd74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:42.525631 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb9887-66bd-4544-8a21-440e62d682c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:42.526816 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb9887-66bd-4544-8a21-440e62d682c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:42.526930 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb9887-66bd-4544-8a21-440e62d682c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:42.527216 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffb9887-66bd-4544-8a21-440e62d682c7 admin admin] PATH_INFO: `/v3/projects/79ffb1481fc347baa241129f0c25be00` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:42.529102 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffb9887-66bd-4544-8a21-440e62d682c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79ffb1481fc347baa241129f0c25be00)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:42.532039 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffb9887-66bd-4544-8a21-440e62d682c7 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:42.555927 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-aee84619-c608-4f1d-aa13-cd0b8245cd74 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:42.558896 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-aee84619-c608-4f1d-aa13-cd0b8245cd74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:42.596031 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 941/1892] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:42:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:42:42.597165 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee84619-c608-4f1d-aa13-cd0b8245cd74 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:42.599596 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-aee84619-c608-4f1d-aa13-cd0b8245cd74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:42.616673 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee84619-c608-4f1d-aa13-cd0b8245cd74 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:42.627234 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ff606b-ed3a-4894-a10c-f1d4468361da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:42.631438 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff606b-ed3a-4894-a10c-f1d4468361da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:42.631438 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff606b-ed3a-4894-a10c-f1d4468361da admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:42.631438 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff606b-ed3a-4894-a10c-f1d4468361da admin admin] PATH_INFO: `/v3/projects/9cc5a36866d44f579c8903936cadca70` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:42.631438 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ff606b-ed3a-4894-a10c-f1d4468361da admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cc5a36866d44f579c8903936cadca70)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:42.632021 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ff606b-ed3a-4894-a10c-f1d4468361da admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:42.671975 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-fffb9887-66bd-4544-8a21-440e62d682c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79ffb1481fc347baa241129f0c25be00', 'request_id': 'req-fffb9887-66bd-4544-8a21-440e62d682c7'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:42.678308 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-fffb9887-66bd-4544-8a21-440e62d682c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79ffb1481fc347baa241129f0c25be00', 'request_id': 'req-fffb9887-66bd-4544-8a21-440e62d682c7'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:42.685621 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-fffb9887-66bd-4544-8a21-440e62d682c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79ffb1481fc347baa241129f0c25be00', 'request_id': 'req-fffb9887-66bd-4544-8a21-440e62d682c7'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:42.731605 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:42.771181 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-fffb9887-66bd-4544-8a21-440e62d682c7 admin admin] The token cache is being invalidate because project 79ffb1481fc347baa241129f0c25be00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80392) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:42:42.771475 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-fffb9887-66bd-4544-8a21-440e62d682c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:42.772107 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-fffb9887-66bd-4544-8a21-440e62d682c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:42.777722 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 952/1893] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:42:42 2022] DELETE /identity/v3/projects/79ffb1481fc347baa241129f0c25be00 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:42.777722 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb9887-66bd-4544-8a21-440e62d682c7 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:42.777722 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-fffb9887-66bd-4544-8a21-440e62d682c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:42.790131 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-18ff606b-ed3a-4894-a10c-f1d4468361da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cc5a36866d44f579c8903936cadca70', 'request_id': 'req-18ff606b-ed3a-4894-a10c-f1d4468361da'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:42.796931 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-18ff606b-ed3a-4894-a10c-f1d4468361da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cc5a36866d44f579c8903936cadca70', 'request_id': 'req-18ff606b-ed3a-4894-a10c-f1d4468361da'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:42.802477 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-18ff606b-ed3a-4894-a10c-f1d4468361da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cc5a36866d44f579c8903936cadca70', 'request_id': 'req-18ff606b-ed3a-4894-a10c-f1d4468361da'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:42.846417 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffb9887-66bd-4544-8a21-440e62d682c7 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:42.887997 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-18ff606b-ed3a-4894-a10c-f1d4468361da admin admin] The token cache is being invalidate because project 9cc5a36866d44f579c8903936cadca70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:42:42.888416 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-18ff606b-ed3a-4894-a10c-f1d4468361da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:42.889978 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-18ff606b-ed3a-4894-a10c-f1d4468361da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:42.891690 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 942/1894] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:42:42 2022] DELETE /identity/v3/projects/9cc5a36866d44f579c8903936cadca70 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:42.892998 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f20ea-0279-45b2-a6e8-1e8f8ad8522e None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:42.893598 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f20ea-0279-45b2-a6e8-1e8f8ad8522e None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:42.893933 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7f20ea-0279-45b2-a6e8-1e8f8ad8522e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:42.904024 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646787a5-35c2-4726-b696-bc15c5a9ba6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:42.905753 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646787a5-35c2-4726-b696-bc15c5a9ba6e admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:42.906043 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646787a5-35c2-4726-b696-bc15c5a9ba6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:42.906323 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646787a5-35c2-4726-b696-bc15c5a9ba6e admin admin] PATH_INFO: `/v3/domains` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:42.907061 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646787a5-35c2-4726-b696-bc15c5a9ba6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:42:42.907436 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646787a5-35c2-4726-b696-bc15c5a9ba6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:42.908987 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646787a5-35c2-4726-b696-bc15c5a9ba6e admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:42.915077 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-4c7f20ea-0279-45b2-a6e8-1e8f8ad8522e None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:42.916558 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-4c7f20ea-0279-45b2-a6e8-1e8f8ad8522e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:42.922012 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 953/1895] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 10:42:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:42:42.925906 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb715a2-5974-4a22-bb43-90ada6f5568d None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:42.925906 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb715a2-5974-4a22-bb43-90ada6f5568d None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:42.925906 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb715a2-5974-4a22-bb43-90ada6f5568d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:42.927712 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 943/1896] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:42:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:42.936515 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f20ea-0279-45b2-a6e8-1e8f8ad8522e None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:42.946643 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-4c7f20ea-0279-45b2-a6e8-1e8f8ad8522e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:42.959001 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-6fb715a2-5974-4a22-bb43-90ada6f5568d None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:42.962329 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-6fb715a2-5974-4a22-bb43-90ada6f5568d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:42.963733 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7f20ea-0279-45b2-a6e8-1e8f8ad8522e None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:42.969301 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7533818-96d4-470b-b3e1-6779b1e5569b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:42.969961 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7533818-96d4-470b-b3e1-6779b1e5569b admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:42.970244 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7533818-96d4-470b-b3e1-6779b1e5569b admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:42.970526 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7533818-96d4-470b-b3e1-6779b1e5569b admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:42.971228 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7533818-96d4-470b-b3e1-6779b1e5569b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:42.972434 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 954/1897] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:42:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:42.973993 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441db114-6e1c-48bb-a984-be0b0bbc6bc1 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:42.974286 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441db114-6e1c-48bb-a984-be0b0bbc6bc1 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:42.974576 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441db114-6e1c-48bb-a984-be0b0bbc6bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:42.975259 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7533818-96d4-470b-b3e1-6779b1e5569b admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:42.994936 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-441db114-6e1c-48bb-a984-be0b0bbc6bc1 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:42.996147 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-441db114-6e1c-48bb-a984-be0b0bbc6bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:43.004655 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 955/1898] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:42:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:43.005935 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c77ee4-3214-4f89-9a70-89e4b84cc071 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:43.006227 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c77ee4-3214-4f89-9a70-89e4b84cc071 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:43.006498 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c77ee4-3214-4f89-9a70-89e4b84cc071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:43.024872 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-d9c77ee4-3214-4f89-9a70-89e4b84cc071 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:43.026097 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-d9c77ee4-3214-4f89-9a70-89e4b84cc071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:43.035134 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 956/1899] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:42:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:43.036002 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c77ee4-3214-4f89-9a70-89e4b84cc071 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:43.045947 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c77ee4-3214-4f89-9a70-89e4b84cc071 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:43.050573 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7219a8-be3c-417b-b1d8-baa7c04aa5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:43.051225 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7219a8-be3c-417b-b1d8-baa7c04aa5a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:43.051511 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7219a8-be3c-417b-b1d8-baa7c04aa5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:43.051785 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7219a8-be3c-417b-b1d8-baa7c04aa5a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:43.052540 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7219a8-be3c-417b-b1d8-baa7c04aa5a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:42:43.052848 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7219a8-be3c-417b-b1d8-baa7c04aa5a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:43.054759 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7219a8-be3c-417b-b1d8-baa7c04aa5a1 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:43.071508 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 957/1900] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 10:42:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:42:43.071508 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7219a8-be3c-417b-b1d8-baa7c04aa5a1 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:43.079989 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7219a8-be3c-417b-b1d8-baa7c04aa5a1 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:43.084800 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702a736-1ba0-40d7-a612-5ef8c2b08bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:43.085937 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702a736-1ba0-40d7-a612-5ef8c2b08bc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:43.086224 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702a736-1ba0-40d7-a612-5ef8c2b08bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:43.086504 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702a736-1ba0-40d7-a612-5ef8c2b08bc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:43.087234 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0702a736-1ba0-40d7-a612-5ef8c2b08bc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:42:43.087542 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0702a736-1ba0-40d7-a612-5ef8c2b08bc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:43.089297 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0702a736-1ba0-40d7-a612-5ef8c2b08bc8 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:43.096150 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 944/1901] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:42:42 2022] POST /identity/v3/projects => generated 369 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:42:43.097209 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7533818-96d4-470b-b3e1-6779b1e5569b admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:43.105612 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 958/1902] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 10:42:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:42:43.106501 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702a736-1ba0-40d7-a612-5ef8c2b08bc8 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:43.118717 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702a736-1ba0-40d7-a612-5ef8c2b08bc8 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:43.198191 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7533818-96d4-470b-b3e1-6779b1e5569b admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:43.206802 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b0971b-a69d-412e-8b6f-6f9059e6b3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:43.207903 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0971b-a69d-412e-8b6f-6f9059e6b3b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:43.208198 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0971b-a69d-412e-8b6f-6f9059e6b3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:43.208488 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0971b-a69d-412e-8b6f-6f9059e6b3b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:43.209416 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b0971b-a69d-412e-8b6f-6f9059e6b3b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:43.212113 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b0971b-a69d-412e-8b6f-6f9059e6b3b6 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:43.235068 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4cc865-0583-42fd-b053-29357226f2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:43.236013 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4cc865-0583-42fd-b053-29357226f2ce admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:43.236445 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4cc865-0583-42fd-b053-29357226f2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:43.236993 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4cc865-0583-42fd-b053-29357226f2ce admin admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:43.237896 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4cc865-0583-42fd-b053-29357226f2ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:43.240684 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4cc865-0583-42fd-b053-29357226f2ce admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:43.300272 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 945/1903] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:42:43 2022] POST /identity/v3/projects => generated 365 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:42:43.304462 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b0971b-a69d-412e-8b6f-6f9059e6b3b6 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:43.340870 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 959/1904] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:42:43 2022] POST /identity/v3/users => generated 285 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:42:43.340870 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4cc865-0583-42fd-b053-29357226f2ce admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:43.368904 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4cc865-0583-42fd-b053-29357226f2ce admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:43.437129 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b0971b-a69d-412e-8b6f-6f9059e6b3b6 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:43.455442 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ab07f-f298-452a-b8c5-01f3a1b6d73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:43.456681 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ab07f-f298-452a-b8c5-01f3a1b6d73d admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:43.456848 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ab07f-f298-452a-b8c5-01f3a1b6d73d admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:43.457324 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ab07f-f298-452a-b8c5-01f3a1b6d73d admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:43.458113 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1ab07f-f298-452a-b8c5-01f3a1b6d73d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:43.461112 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1ab07f-f298-452a-b8c5-01f3a1b6d73d admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:43.486006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa037fab-b4dc-4671-8087-ffb03d8504db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:43.487265 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa037fab-b4dc-4671-8087-ffb03d8504db admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:43.487764 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa037fab-b4dc-4671-8087-ffb03d8504db admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:43.488224 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa037fab-b4dc-4671-8087-ffb03d8504db admin admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:43.489155 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa037fab-b4dc-4671-8087-ffb03d8504db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:43.491356 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa037fab-b4dc-4671-8087-ffb03d8504db admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:43.631315 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 946/1905] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:42:43 2022] POST /identity/v3/projects => generated 383 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:42:43.631315 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ab07f-f298-452a-b8c5-01f3a1b6d73d admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:43.632375 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 960/1906] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:42:43 2022] POST /identity/v3/users => generated 283 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:42:43.633819 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa037fab-b4dc-4671-8087-ffb03d8504db admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:43.645899 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa037fab-b4dc-4671-8087-ffb03d8504db admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:43.746525 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0e8891-6281-466f-ad98-04950157fe2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:43.747255 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e8891-6281-466f-ad98-04950157fe2b admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:43.747543 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e8891-6281-466f-ad98-04950157fe2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:43.748556 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0e8891-6281-466f-ad98-04950157fe2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:43.749484 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ab07f-f298-452a-b8c5-01f3a1b6d73d admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:43.749620 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0e8891-6281-466f-ad98-04950157fe2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:43.751855 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0e8891-6281-466f-ad98-04950157fe2b admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:43.762879 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daa607c-d50c-42be-913f-a3fd005872f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:43.764711 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa607c-d50c-42be-913f-a3fd005872f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:43.764711 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa607c-d50c-42be-913f-a3fd005872f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:43.764711 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa607c-d50c-42be-913f-a3fd005872f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:43.765247 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 961/1907] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:42:43.765553 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0e8891-6281-466f-ad98-04950157fe2b admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:43.767021 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daa607c-d50c-42be-913f-a3fd005872f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:43.769538 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daa607c-d50c-42be-913f-a3fd005872f1 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:43.781268 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0e8891-6281-466f-ad98-04950157fe2b admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:43.784297 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 947/1908] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:42:43.785425 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daa607c-d50c-42be-913f-a3fd005872f1 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:43.787931 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce359f7f-07ae-4042-b64b-83a8244dc240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:43.789305 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce359f7f-07ae-4042-b64b-83a8244dc240 admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:43.790255 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce359f7f-07ae-4042-b64b-83a8244dc240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:43.790900 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce359f7f-07ae-4042-b64b-83a8244dc240 admin admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:43.791810 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce359f7f-07ae-4042-b64b-83a8244dc240 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:43.796213 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce359f7f-07ae-4042-b64b-83a8244dc240 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:43.800229 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daa607c-d50c-42be-913f-a3fd005872f1 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:43.808117 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b2d9a-1177-40b3-b776-68d68060e1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:43.809456 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b2d9a-1177-40b3-b776-68d68060e1a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:43.809878 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b2d9a-1177-40b3-b776-68d68060e1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:43.810309 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b2d9a-1177-40b3-b776-68d68060e1a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:43.811622 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9b2d9a-1177-40b3-b776-68d68060e1a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:43.814467 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9b2d9a-1177-40b3-b776-68d68060e1a6 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:43.834256 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:43.834368 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 948/1909] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:42:43.834368 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b2d9a-1177-40b3-b776-68d68060e1a6 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:43.852937 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b2d9a-1177-40b3-b776-68d68060e1a6 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:43.859867 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ec581-b845-4d58-a635-e85bdfe7d2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:43.860563 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ec581-b845-4d58-a635-e85bdfe7d2c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:43.863288 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ec581-b845-4d58-a635-e85bdfe7d2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:43.863585 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ec581-b845-4d58-a635-e85bdfe7d2c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:43.864341 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006ec581-b845-4d58-a635-e85bdfe7d2c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:43.867268 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006ec581-b845-4d58-a635-e85bdfe7d2c7 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:43.885281 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 949/1910] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:42:43.890586 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ec581-b845-4d58-a635-e85bdfe7d2c7 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:43.903520 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ec581-b845-4d58-a635-e85bdfe7d2c7 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:43.910305 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a73793-c62a-49f0-bdad-5337fcfac4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:43.913372 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a73793-c62a-49f0-bdad-5337fcfac4b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:43.914140 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a73793-c62a-49f0-bdad-5337fcfac4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:43.914776 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a73793-c62a-49f0-bdad-5337fcfac4b3 admin admin] PATH_INFO: `/v3/projects/d89fb25ca4bb468aa769c0f94ec91508/users/225535920da844f0abe27c3493eb1692/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:43.933651 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 962/1911] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:42:43 2022] POST /identity/v3/users => generated 292 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:42:43.941236 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce359f7f-07ae-4042-b64b-83a8244dc240 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:43.941363 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a73793-c62a-49f0-bdad-5337fcfac4b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d89fb25ca4bb468aa769c0f94ec91508, user_id=225535920da844f0abe27c3493eb1692, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:43.943754 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a73793-c62a-49f0-bdad-5337fcfac4b3 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:43.950592 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce359f7f-07ae-4042-b64b-83a8244dc240 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:43.957804 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688bc266-483d-43ea-aa8b-6e6d2de53069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:43.958661 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688bc266-483d-43ea-aa8b-6e6d2de53069 admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:43.958994 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688bc266-483d-43ea-aa8b-6e6d2de53069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:43.959549 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688bc266-483d-43ea-aa8b-6e6d2de53069 admin admin] PATH_INFO: `/v3/projects/1b41b95ac36b40fa8a6aea5e5ae27bd8/users/d670fec4466a4f97ae029067ba7cc032/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:43.990011 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688bc266-483d-43ea-aa8b-6e6d2de53069 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b41b95ac36b40fa8a6aea5e5ae27bd8, user_id=d670fec4466a4f97ae029067ba7cc032, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:43.992865 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688bc266-483d-43ea-aa8b-6e6d2de53069 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:44.078361 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 950/1912] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:42:43 2022] PUT /identity/v3/projects/d89fb25ca4bb468aa769c0f94ec91508/users/225535920da844f0abe27c3493eb1692/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:44.087222 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 963/1913] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:42:43 2022] PUT /identity/v3/projects/1b41b95ac36b40fa8a6aea5e5ae27bd8/users/d670fec4466a4f97ae029067ba7cc032/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:44.087222 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688bc266-483d-43ea-aa8b-6e6d2de53069 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:44.089654 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb5912-36cb-4677-b652-24af6c69db1f None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:44.090134 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb5912-36cb-4677-b652-24af6c69db1f None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:44.090718 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb5912-36cb-4677-b652-24af6c69db1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:44.131675 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-4dcb5912-36cb-4677-b652-24af6c69db1f None None] MFA Rules not processed for user `d670fec4466a4f97ae029067ba7cc032`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:44.134071 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-4dcb5912-36cb-4677-b652-24af6c69db1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:44.163447 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688bc266-483d-43ea-aa8b-6e6d2de53069 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:44.169482 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c864a-9ba7-40e6-bed0-ba2a9bc8f969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:44.171704 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c864a-9ba7-40e6-bed0-ba2a9bc8f969 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:44.172069 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c864a-9ba7-40e6-bed0-ba2a9bc8f969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:44.172418 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c864a-9ba7-40e6-bed0-ba2a9bc8f969 admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:44.173288 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4c864a-9ba7-40e6-bed0-ba2a9bc8f969 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:44.175082 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4c864a-9ba7-40e6-bed0-ba2a9bc8f969 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:44.189662 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 964/1914] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:44 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:42:44.190368 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7d108-f16d-4cf9-9a04-de492e17014a None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:44.190852 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7d108-f16d-4cf9-9a04-de492e17014a None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:44.191193 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb7d108-f16d-4cf9-9a04-de492e17014a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:44.222180 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-fcb7d108-f16d-4cf9-9a04-de492e17014a None None] MFA Rules not processed for user `225535920da844f0abe27c3493eb1692`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:44.223123 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-fcb7d108-f16d-4cf9-9a04-de492e17014a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:44.246477 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 951/1915] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:42:44 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:44.246699 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb5912-36cb-4677-b652-24af6c69db1f None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:44.274113 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb5912-36cb-4677-b652-24af6c69db1f None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:44.287160 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e042d735-e794-4ca9-817b-010bd428eb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:44.287771 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042d735-e794-4ca9-817b-010bd428eb77 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:44.288054 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042d735-e794-4ca9-817b-010bd428eb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:44.288579 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e042d735-e794-4ca9-817b-010bd428eb77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:44.289093 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e042d735-e794-4ca9-817b-010bd428eb77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:44.290770 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e042d735-e794-4ca9-817b-010bd428eb77 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:44.318343 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 952/1916] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:44 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:42:44.318343 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e042d735-e794-4ca9-817b-010bd428eb77 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:44.319126 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 965/1917] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:42:44 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:44.320741 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb7d108-f16d-4cf9-9a04-de492e17014a None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:44.336871 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb7d108-f16d-4cf9-9a04-de492e17014a None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:44.343954 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb124bcc-05c8-4fa1-9040-1a74d5a41389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:44.345271 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb124bcc-05c8-4fa1-9040-1a74d5a41389 admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:44.345792 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb124bcc-05c8-4fa1-9040-1a74d5a41389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:44.346315 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb124bcc-05c8-4fa1-9040-1a74d5a41389 admin admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:44.347740 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb124bcc-05c8-4fa1-9040-1a74d5a41389 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:44.350718 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e042d735-e794-4ca9-817b-010bd428eb77 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:44.351172 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb124bcc-05c8-4fa1-9040-1a74d5a41389 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:44.363956 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0d4d5a-5793-47fa-9eb6-a8739a650432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:44.363956 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d4d5a-5793-47fa-9eb6-a8739a650432 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:44.363956 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d4d5a-5793-47fa-9eb6-a8739a650432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:44.363956 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d4d5a-5793-47fa-9eb6-a8739a650432 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:44.364452 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0d4d5a-5793-47fa-9eb6-a8739a650432 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:44.366679 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0d4d5a-5793-47fa-9eb6-a8739a650432 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:44.497567 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 966/1918] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:42:44 2022] POST /identity/v3/projects => generated 367 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:42:44.498968 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb124bcc-05c8-4fa1-9040-1a74d5a41389 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:44.505280 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 953/1919] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:42:44 2022] POST /identity/v3/projects => generated 369 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:42:44.505280 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0d4d5a-5793-47fa-9eb6-a8739a650432 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:44.612332 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb124bcc-05c8-4fa1-9040-1a74d5a41389 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:44.680219 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0d4d5a-5793-47fa-9eb6-a8739a650432 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:44.686200 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a4e786-b818-471e-993f-fd01224b5b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:44.686948 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4e786-b818-471e-993f-fd01224b5b92 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:44.687628 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4e786-b818-471e-993f-fd01224b5b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:44.687762 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4e786-b818-471e-993f-fd01224b5b92 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:44.688477 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a4e786-b818-471e-993f-fd01224b5b92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:44.690493 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a4e786-b818-471e-993f-fd01224b5b92 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:44.739669 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a93181-34ca-4d73-aab5-33b1d3edacc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:44.741396 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a93181-34ca-4d73-aab5-33b1d3edacc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:44.746372 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a93181-34ca-4d73-aab5-33b1d3edacc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:44.746372 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a93181-34ca-4d73-aab5-33b1d3edacc1 admin admin] PATH_INFO: `/v3/projects/b9734ac9849649ba83b61614293cdc72/users/8a6717b02c654f8c9ceaba22754d46f7/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:44.763802 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a93181-34ca-4d73-aab5-33b1d3edacc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9734ac9849649ba83b61614293cdc72, user_id=8a6717b02c654f8c9ceaba22754d46f7, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:44.767382 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a93181-34ca-4d73-aab5-33b1d3edacc1 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:44.838426 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 954/1920] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:42:44 2022] POST /identity/v3/users => generated 290 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:42:44.839339 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a4e786-b818-471e-993f-fd01224b5b92 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:44.856332 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a4e786-b818-471e-993f-fd01224b5b92 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:44.863715 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 967/1921] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:42:44 2022] PUT /identity/v3/projects/b9734ac9849649ba83b61614293cdc72/users/8a6717b02c654f8c9ceaba22754d46f7/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:44.864903 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a93181-34ca-4d73-aab5-33b1d3edacc1 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:44.927862 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:44.946386 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4074654a-ed16-434b-b4d4-8bbcd67bd1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:44.947077 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074654a-ed16-434b-b4d4-8bbcd67bd1f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:44.947481 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074654a-ed16-434b-b4d4-8bbcd67bd1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:44.947662 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074654a-ed16-434b-b4d4-8bbcd67bd1f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:44.954849 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4074654a-ed16-434b-b4d4-8bbcd67bd1f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:44.958198 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a93181-34ca-4d73-aab5-33b1d3edacc1 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:44.961444 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4074654a-ed16-434b-b4d4-8bbcd67bd1f8 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:44.968616 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d783bcf-96f2-4fc5-8d42-254c59de9cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:44.970438 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d783bcf-96f2-4fc5-8d42-254c59de9cc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:44.971246 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d783bcf-96f2-4fc5-8d42-254c59de9cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:44.971676 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d783bcf-96f2-4fc5-8d42-254c59de9cc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:44.973295 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d783bcf-96f2-4fc5-8d42-254c59de9cc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:44.975482 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d783bcf-96f2-4fc5-8d42-254c59de9cc8 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:44.989077 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 968/1922] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:44 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:42:44.990291 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd0971a-d01e-4ac2-aad8-8a77b0d40664 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:44.990607 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd0971a-d01e-4ac2-aad8-8a77b0d40664 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:44.990852 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd0971a-d01e-4ac2-aad8-8a77b0d40664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:45.018941 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-5cd0971a-d01e-4ac2-aad8-8a77b0d40664 None None] MFA Rules not processed for user `8a6717b02c654f8c9ceaba22754d46f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:45.020162 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-5cd0971a-d01e-4ac2-aad8-8a77b0d40664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:45.096526 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 955/1923] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:42:44 2022] POST /identity/v3/users => generated 291 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:42:45.097580 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4074654a-ed16-434b-b4d4-8bbcd67bd1f8 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:45.119075 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4074654a-ed16-434b-b4d4-8bbcd67bd1f8 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:45.125836 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e203b-d613-4950-8efe-2406a414698d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:45.129766 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 969/1924] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:42:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:45.129933 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e203b-d613-4950-8efe-2406a414698d admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:45.129933 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e203b-d613-4950-8efe-2406a414698d admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:45.130108 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd0971a-d01e-4ac2-aad8-8a77b0d40664 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:45.130207 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e203b-d613-4950-8efe-2406a414698d admin admin] PATH_INFO: `/v3/projects/a4a16e49230244cdb233edf63c3ebf85/users/d9620146f8eb4ec695f49301cbe4ba2e/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:45.147635 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd0971a-d01e-4ac2-aad8-8a77b0d40664 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:45.148564 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572e203b-d613-4950-8efe-2406a414698d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4a16e49230244cdb233edf63c3ebf85, user_id=d9620146f8eb4ec695f49301cbe4ba2e, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:45.152501 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c437c8-9ea6-4da6-bdf5-b099e195ac34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:45.153231 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c437c8-9ea6-4da6-bdf5-b099e195ac34 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:45.153611 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c437c8-9ea6-4da6-bdf5-b099e195ac34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:45.154555 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c437c8-9ea6-4da6-bdf5-b099e195ac34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:45.155228 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c437c8-9ea6-4da6-bdf5-b099e195ac34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:45.156846 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c437c8-9ea6-4da6-bdf5-b099e195ac34 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:45.165355 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572e203b-d613-4950-8efe-2406a414698d admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:45.171930 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 970/1925] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:45 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:42:45.172890 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c437c8-9ea6-4da6-bdf5-b099e195ac34 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:45.184376 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c437c8-9ea6-4da6-bdf5-b099e195ac34 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:45.189802 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c22c11-6f49-49b4-959f-10d310bc1b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:45.190466 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c22c11-6f49-49b4-959f-10d310bc1b2c admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:45.190972 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c22c11-6f49-49b4-959f-10d310bc1b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:45.191087 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c22c11-6f49-49b4-959f-10d310bc1b2c admin admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:45.191729 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c22c11-6f49-49b4-959f-10d310bc1b2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:45.193692 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c22c11-6f49-49b4-959f-10d310bc1b2c admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:45.292962 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 956/1926] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:42:45 2022] PUT /identity/v3/projects/a4a16e49230244cdb233edf63c3ebf85/users/d9620146f8eb4ec695f49301cbe4ba2e/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:45.293880 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e203b-d613-4950-8efe-2406a414698d admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:45.304360 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 971/1927] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:42:45 2022] POST /identity/v3/projects => generated 385 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:42:45.305239 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c22c11-6f49-49b4-959f-10d310bc1b2c admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:45.364298 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e203b-d613-4950-8efe-2406a414698d admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:45.368935 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b960b3b6-b0dd-4497-9a03-4cb350bcc5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:45.369859 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960b3b6-b0dd-4497-9a03-4cb350bcc5f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:45.370204 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960b3b6-b0dd-4497-9a03-4cb350bcc5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:45.375226 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960b3b6-b0dd-4497-9a03-4cb350bcc5f8 admin admin] PATH_INFO: `/v3/projects/1a68a79d308049c1a6a82d387cdb653f/users/352d8dd011c843a98e837a6ddbd34c6c/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:45.375568 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c22c11-6f49-49b4-959f-10d310bc1b2c admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:45.376564 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7541482-8767-48b1-82bc-fa7c7ac463b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:45.377373 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7541482-8767-48b1-82bc-fa7c7ac463b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:45.377655 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7541482-8767-48b1-82bc-fa7c7ac463b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:45.377932 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7541482-8767-48b1-82bc-fa7c7ac463b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:45.378663 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7541482-8767-48b1-82bc-fa7c7ac463b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:45.380339 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7541482-8767-48b1-82bc-fa7c7ac463b1 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:45.390245 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b960b3b6-b0dd-4497-9a03-4cb350bcc5f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a68a79d308049c1a6a82d387cdb653f, user_id=352d8dd011c843a98e837a6ddbd34c6c, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:45.393735 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 972/1928] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:45 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:42:45.393735 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7541482-8767-48b1-82bc-fa7c7ac463b1 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:45.393942 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b960b3b6-b0dd-4497-9a03-4cb350bcc5f8 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:45.403715 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7541482-8767-48b1-82bc-fa7c7ac463b1 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:45.409783 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f94a9e9-b055-439b-99fc-766306a1d814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:45.410339 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94a9e9-b055-439b-99fc-766306a1d814 admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:45.410625 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94a9e9-b055-439b-99fc-766306a1d814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:45.410930 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94a9e9-b055-439b-99fc-766306a1d814 admin admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:45.411612 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f94a9e9-b055-439b-99fc-766306a1d814 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:45.413657 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f94a9e9-b055-439b-99fc-766306a1d814 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:45.476423 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 957/1929] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:42:45 2022] PUT /identity/v3/projects/1a68a79d308049c1a6a82d387cdb653f/users/352d8dd011c843a98e837a6ddbd34c6c/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:45.477066 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b960b3b6-b0dd-4497-9a03-4cb350bcc5f8 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:45.521934 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 973/1930] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:42:45 2022] POST /identity/v3/users => generated 299 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:42:45.523112 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f94a9e9-b055-439b-99fc-766306a1d814 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:45.533325 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f94a9e9-b055-439b-99fc-766306a1d814 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:45.556613 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b960b3b6-b0dd-4497-9a03-4cb350bcc5f8 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:45.562963 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8edbdea-580e-4e57-90b6-60cd314f0182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:45.563958 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8edbdea-580e-4e57-90b6-60cd314f0182 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:45.564413 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8edbdea-580e-4e57-90b6-60cd314f0182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:45.564714 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8edbdea-580e-4e57-90b6-60cd314f0182 admin admin] PATH_INFO: `/v3/projects/a4a16e49230244cdb233edf63c3ebf85/users/d9620146f8eb4ec695f49301cbe4ba2e/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:45.567787 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8edbdea-580e-4e57-90b6-60cd314f0182 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4a16e49230244cdb233edf63c3ebf85, user_id=d9620146f8eb4ec695f49301cbe4ba2e, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:45.571040 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8edbdea-580e-4e57-90b6-60cd314f0182 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:45.612107 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 958/1931] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:42:45 2022] PUT /identity/v3/projects/a4a16e49230244cdb233edf63c3ebf85/users/d9620146f8eb4ec695f49301cbe4ba2e/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:45.612107 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8edbdea-580e-4e57-90b6-60cd314f0182 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:45.619829 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf27bb9e-1f56-4e27-9df8-03890fc2bf9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:45.620529 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27bb9e-1f56-4e27-9df8-03890fc2bf9b admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:45.620865 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27bb9e-1f56-4e27-9df8-03890fc2bf9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:45.621177 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27bb9e-1f56-4e27-9df8-03890fc2bf9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:45.622148 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf27bb9e-1f56-4e27-9df8-03890fc2bf9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:45.624551 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf27bb9e-1f56-4e27-9df8-03890fc2bf9b admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:45.638331 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 974/1932] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:45 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:42:45.641567 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137ea87-5bcd-4ae4-a394-d490530e2128 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:45.641567 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137ea87-5bcd-4ae4-a394-d490530e2128 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:45.641567 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137ea87-5bcd-4ae4-a394-d490530e2128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:45.676537 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-7137ea87-5bcd-4ae4-a394-d490530e2128 None None] MFA Rules not processed for user `d9620146f8eb4ec695f49301cbe4ba2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:45.679582 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-7137ea87-5bcd-4ae4-a394-d490530e2128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:45.723137 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8edbdea-580e-4e57-90b6-60cd314f0182 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:45.731225 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e99d8f4-5184-4c86-b61e-5528f8f44bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:45.731912 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e99d8f4-5184-4c86-b61e-5528f8f44bdd admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:45.732259 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e99d8f4-5184-4c86-b61e-5528f8f44bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:45.732762 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e99d8f4-5184-4c86-b61e-5528f8f44bdd admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:45.733312 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e99d8f4-5184-4c86-b61e-5528f8f44bdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:45.734908 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e99d8f4-5184-4c86-b61e-5528f8f44bdd admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:45.746158 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 959/1933] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:45 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:42:45.746830 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e99d8f4-5184-4c86-b61e-5528f8f44bdd admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:45.757169 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e99d8f4-5184-4c86-b61e-5528f8f44bdd admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:45.765070 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bbc420-8957-4e96-b8be-dfef1643edbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:45.765922 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bbc420-8957-4e96-b8be-dfef1643edbf admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:45.766196 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bbc420-8957-4e96-b8be-dfef1643edbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:45.766467 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bbc420-8957-4e96-b8be-dfef1643edbf admin admin] PATH_INFO: `/v3/projects/1a68a79d308049c1a6a82d387cdb653f/users/352d8dd011c843a98e837a6ddbd34c6c/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:45.768446 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bbc420-8957-4e96-b8be-dfef1643edbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a68a79d308049c1a6a82d387cdb653f, user_id=352d8dd011c843a98e837a6ddbd34c6c, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:45.771424 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bbc420-8957-4e96-b8be-dfef1643edbf admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:45.777841 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 975/1934] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:42:45 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:45.778656 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7137ea87-5bcd-4ae4-a394-d490530e2128 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:45.785306 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 960/1935] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:42:45 2022] PUT /identity/v3/projects/1a68a79d308049c1a6a82d387cdb653f/users/352d8dd011c843a98e837a6ddbd34c6c/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:45.791323 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bbc420-8957-4e96-b8be-dfef1643edbf admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:45.793145 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-a8bbc420-8957-4e96-b8be-dfef1643edbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:45.798003 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7137ea87-5bcd-4ae4-a394-d490530e2128 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:45.866456 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a88d5c-43b7-4568-847e-21354118b550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:45.867681 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a88d5c-43b7-4568-847e-21354118b550 admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:45.869281 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a88d5c-43b7-4568-847e-21354118b550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:45.869281 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a88d5c-43b7-4568-847e-21354118b550 admin admin] PATH_INFO: `/v3/projects/b0a76d4684a648888eaacd668628580f/users/38aeb9a587b1486bb150c95c9f8c14d1/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:45.871222 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bbc420-8957-4e96-b8be-dfef1643edbf admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:45.887120 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a88d5c-43b7-4568-847e-21354118b550 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0a76d4684a648888eaacd668628580f, user_id=38aeb9a587b1486bb150c95c9f8c14d1, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:45.891063 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a88d5c-43b7-4568-847e-21354118b550 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:45.895148 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a41f77e-07dc-45fe-849d-39587e8b2d5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:45.895953 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41f77e-07dc-45fe-849d-39587e8b2d5e service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:45.896241 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41f77e-07dc-45fe-849d-39587e8b2d5e service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:45.896533 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41f77e-07dc-45fe-849d-39587e8b2d5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:45.973411 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a41f77e-07dc-45fe-849d-39587e8b2d5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:45.974969 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a41f77e-07dc-45fe-849d-39587e8b2d5e service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:45.985292 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 961/1937] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:45 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:42:45.986491 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f5108-12f0-4cf2-be4a-f7ede5cbf98c None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:45.987019 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f5108-12f0-4cf2-be4a-f7ede5cbf98c None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:45.987367 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f5108-12f0-4cf2-be4a-f7ede5cbf98c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:45.987574 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 976/1937] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:42:45 2022] PUT /identity/v3/projects/b0a76d4684a648888eaacd668628580f/users/38aeb9a587b1486bb150c95c9f8c14d1/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:45.988806 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a88d5c-43b7-4568-847e-21354118b550 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:46.018869 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-786f5108-12f0-4cf2-be4a-f7ede5cbf98c None None] MFA Rules not processed for user `352d8dd011c843a98e837a6ddbd34c6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:46.020637 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-786f5108-12f0-4cf2-be4a-f7ede5cbf98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:46.072981 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a88d5c-43b7-4568-847e-21354118b550 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:46.081712 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b1a5b-d12b-4edf-939c-b1dc255fb064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:46.084322 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b1a5b-d12b-4edf-939c-b1dc255fb064 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:46.085124 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b1a5b-d12b-4edf-939c-b1dc255fb064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:46.093404 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b1a5b-d12b-4edf-939c-b1dc255fb064 admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:46.094754 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14b1a5b-d12b-4edf-939c-b1dc255fb064 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:46.099134 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14b1a5b-d12b-4edf-939c-b1dc255fb064 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:46.127205 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 977/1938] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:45 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:42:46.139694 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b1a5b-d12b-4edf-939c-b1dc255fb064 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:46.157441 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b1a5b-d12b-4edf-939c-b1dc255fb064 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:46.172616 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5588cc-01e9-4941-af49-5680feca5fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:46.173714 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5588cc-01e9-4941-af49-5680feca5fba admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:46.173999 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5588cc-01e9-4941-af49-5680feca5fba admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:46.174275 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5588cc-01e9-4941-af49-5680feca5fba admin admin] PATH_INFO: `/v3/projects/b0a76d4684a648888eaacd668628580f/users/38aeb9a587b1486bb150c95c9f8c14d1/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:46.194176 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 962/1939] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:42:45 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:46.195089 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5588cc-01e9-4941-af49-5680feca5fba admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0a76d4684a648888eaacd668628580f, user_id=38aeb9a587b1486bb150c95c9f8c14d1, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:46.211605 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786f5108-12f0-4cf2-be4a-f7ede5cbf98c None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:46.224259 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5588cc-01e9-4941-af49-5680feca5fba admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:46.252037 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 978/1940] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:42:46 2022] PUT /identity/v3/projects/b0a76d4684a648888eaacd668628580f/users/38aeb9a587b1486bb150c95c9f8c14d1/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:46.258077 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5588cc-01e9-4941-af49-5680feca5fba admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:46.271596 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-3d5588cc-01e9-4941-af49-5680feca5fba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:46.294192 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:46.314500 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786f5108-12f0-4cf2-be4a-f7ede5cbf98c None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:46.388585 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5588cc-01e9-4941-af49-5680feca5fba admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:46.394038 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ebccde-39a8-4c9d-bad6-563617c6125c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:46.394866 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ebccde-39a8-4c9d-bad6-563617c6125c service cinder] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:46.395213 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ebccde-39a8-4c9d-bad6-563617c6125c service cinder] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:46.395497 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ebccde-39a8-4c9d-bad6-563617c6125c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:46.404866 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd6674-6ff3-4c7b-b2cd-96a42b1a7fcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:46.405484 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd6674-6ff3-4c7b-b2cd-96a42b1a7fcb service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:46.412927 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd6674-6ff3-4c7b-b2cd-96a42b1a7fcb service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:46.412927 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd6674-6ff3-4c7b-b2cd-96a42b1a7fcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:46.462949 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ebccde-39a8-4c9d-bad6-563617c6125c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:46.464764 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ebccde-39a8-4c9d-bad6-563617c6125c service cinder] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:46.486692 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 979/1941] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:46 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:42:46.488709 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f805cd-29fe-41b7-997b-60bbb61eff6e None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:46.489244 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f805cd-29fe-41b7-997b-60bbb61eff6e None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:46.490458 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f805cd-29fe-41b7-997b-60bbb61eff6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:46.502037 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fd6674-6ff3-4c7b-b2cd-96a42b1a7fcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:46.505256 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fd6674-6ff3-4c7b-b2cd-96a42b1a7fcb service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:46.520047 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-f9f805cd-29fe-41b7-997b-60bbb61eff6e None None] MFA Rules not processed for user `38aeb9a587b1486bb150c95c9f8c14d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:46.521619 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-f9f805cd-29fe-41b7-997b-60bbb61eff6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:46.535835 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 963/1942] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:46 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:42:46.600608 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:46.604489 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 980/1943] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:42:46 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:46.735121 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd6674-6ff3-4c7b-b2cd-96a42b1a7fcb service cinder] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:46.748678 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd6674-6ff3-4c7b-b2cd-96a42b1a7fcb service cinder] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:46.760925 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a79720e-17d5-4349-b964-b86a32ff4c7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:46.762141 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79720e-17d5-4349-b964-b86a32ff4c7e service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:46.762860 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79720e-17d5-4349-b964-b86a32ff4c7e service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:46.763951 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a79720e-17d5-4349-b964-b86a32ff4c7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:46.853292 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a79720e-17d5-4349-b964-b86a32ff4c7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:46.855265 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a79720e-17d5-4349-b964-b86a32ff4c7e service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:46.867346 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 964/1944] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:42:46.979332 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f805cd-29fe-41b7-997b-60bbb61eff6e None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:46.992462 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f805cd-29fe-41b7-997b-60bbb61eff6e None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:46.996318 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c27791a-fc15-4861-8e95-820a499ec081 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:46.997174 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27791a-fc15-4861-8e95-820a499ec081 service cinder] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:46.998625 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27791a-fc15-4861-8e95-820a499ec081 service cinder] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:46.999054 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27791a-fc15-4861-8e95-820a499ec081 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:47.078004 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c27791a-fc15-4861-8e95-820a499ec081 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:47.079488 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c27791a-fc15-4861-8e95-820a499ec081 service cinder] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:47.103671 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 981/1945] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:46 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:42:47.749535 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:48.669970 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:49.971985 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:50.943826 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:51.665472 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:52.756174 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:53.321152 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:53.392179 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:53.687825 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a79720e-17d5-4349-b964-b86a32ff4c7e service cinder] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:53.748500 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c27791a-fc15-4861-8e95-820a499ec081 service cinder] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:53.760903 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c27791a-fc15-4861-8e95-820a499ec081 service cinder] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:53.766882 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d45b8-0512-4d3a-9c85-2c8c0a474859 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:53.767964 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d45b8-0512-4d3a-9c85-2c8c0a474859 service cinder] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:53.768437 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d45b8-0512-4d3a-9c85-2c8c0a474859 service cinder] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:53.768923 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d45b8-0512-4d3a-9c85-2c8c0a474859 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:53.784604 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050d45b8-0512-4d3a-9c85-2c8c0a474859 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:53.785721 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a79720e-17d5-4349-b964-b86a32ff4c7e service cinder] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:53.787710 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050d45b8-0512-4d3a-9c85-2c8c0a474859 service cinder] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:53.792479 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63073779-901f-4a91-a870-d7aa8a42d554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:53.793421 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63073779-901f-4a91-a870-d7aa8a42d554 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:53.793712 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63073779-901f-4a91-a870-d7aa8a42d554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:53.793979 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63073779-901f-4a91-a870-d7aa8a42d554 admin admin] PATH_INFO: `/v3/users/d670fec4466a4f97ae029067ba7cc032` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:53.796096 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63073779-901f-4a91-a870-d7aa8a42d554 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d670fec4466a4f97ae029067ba7cc032)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:53.798150 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63073779-901f-4a91-a870-d7aa8a42d554 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:53.804817 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 982/1946] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:53 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:42:54.078400 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-63073779-901f-4a91-a870-d7aa8a42d554 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd670fec4466a4f97ae029067ba7cc032'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:54.155802 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-63073779-901f-4a91-a870-d7aa8a42d554 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd670fec4466a4f97ae029067ba7cc032'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:54.156199 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-63073779-901f-4a91-a870-d7aa8a42d554 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd670fec4466a4f97ae029067ba7cc032'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:54.174360 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-63073779-901f-4a91-a870-d7aa8a42d554 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd670fec4466a4f97ae029067ba7cc032'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:54.186267 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-63073779-901f-4a91-a870-d7aa8a42d554 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd670fec4466a4f97ae029067ba7cc032'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:54.193078 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 965/1947] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:42:53 2022] DELETE /identity/v3/users/d670fec4466a4f97ae029067ba7cc032 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:42:54.197643 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3a064-f9e4-441f-b25c-74cd2e9996bf None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:54.202666 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3a064-f9e4-441f-b25c-74cd2e9996bf None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:54.202666 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3a064-f9e4-441f-b25c-74cd2e9996bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:54.219189 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-08c3a064-f9e4-441f-b25c-74cd2e9996bf None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:54.220556 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-08c3a064-f9e4-441f-b25c-74cd2e9996bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:54.302270 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 983/1948] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:42:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:54.313659 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63073779-901f-4a91-a870-d7aa8a42d554 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:54.315164 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-63073779-901f-4a91-a870-d7aa8a42d554 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:54.384766 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63073779-901f-4a91-a870-d7aa8a42d554 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:54.390144 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c27f8a-1ca6-4451-a9e5-a78ddea45d36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:54.390893 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c27f8a-1ca6-4451-a9e5-a78ddea45d36 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:54.391405 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c27f8a-1ca6-4451-a9e5-a78ddea45d36 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:54.391576 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c27f8a-1ca6-4451-a9e5-a78ddea45d36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:54.402545 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c27f8a-1ca6-4451-a9e5-a78ddea45d36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:54.404511 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c27f8a-1ca6-4451-a9e5-a78ddea45d36 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:54.422977 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 966/1949] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:42:54.450236 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c3a064-f9e4-441f-b25c-74cd2e9996bf None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:54.452375 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-08c3a064-f9e4-441f-b25c-74cd2e9996bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:54.466077 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c3a064-f9e4-441f-b25c-74cd2e9996bf None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:54.472683 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c788381-5d58-4891-8ce9-4636493b2547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:54.474016 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c788381-5d58-4891-8ce9-4636493b2547 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:54.474016 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c788381-5d58-4891-8ce9-4636493b2547 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:54.474298 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c788381-5d58-4891-8ce9-4636493b2547 admin admin] PATH_INFO: `/v3/users/225535920da844f0abe27c3493eb1692` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:54.475465 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c788381-5d58-4891-8ce9-4636493b2547 admin admin] RBAC: Authorizing `identity:delete_user(user_id=225535920da844f0abe27c3493eb1692)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:54.477803 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c788381-5d58-4891-8ce9-4636493b2547 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:54.754110 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-3c788381-5d58-4891-8ce9-4636493b2547 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '225535920da844f0abe27c3493eb1692'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:54.859704 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-3c788381-5d58-4891-8ce9-4636493b2547 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '225535920da844f0abe27c3493eb1692'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:54.869832 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-3c788381-5d58-4891-8ce9-4636493b2547 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '225535920da844f0abe27c3493eb1692'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:54.906345 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-3c788381-5d58-4891-8ce9-4636493b2547 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '225535920da844f0abe27c3493eb1692'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:54.914478 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-3c788381-5d58-4891-8ce9-4636493b2547 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '225535920da844f0abe27c3493eb1692'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:54.921750 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 984/1950] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:42:54 2022] DELETE /identity/v3/users/225535920da844f0abe27c3493eb1692 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:42:54.926352 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b8cab4-ef37-4835-8796-4f6fe6cac646 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:54.926837 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b8cab4-ef37-4835-8796-4f6fe6cac646 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:54.926983 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b8cab4-ef37-4835-8796-4f6fe6cac646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:54.948528 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-24b8cab4-ef37-4835-8796-4f6fe6cac646 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:54.949814 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-24b8cab4-ef37-4835-8796-4f6fe6cac646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:55.016901 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 967/1951] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:42:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:42:55.026563 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c788381-5d58-4891-8ce9-4636493b2547 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:55.027998 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-3c788381-5d58-4891-8ce9-4636493b2547 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:55.093754 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c788381-5d58-4891-8ce9-4636493b2547 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:55.098870 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ee1309-4ccf-4c8b-b9e1-8e2ec72b6849 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:55.099743 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee1309-4ccf-4c8b-b9e1-8e2ec72b6849 service neutron] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:55.100637 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee1309-4ccf-4c8b-b9e1-8e2ec72b6849 service neutron] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:55.100637 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ee1309-4ccf-4c8b-b9e1-8e2ec72b6849 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:55.117386 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b8cab4-ef37-4835-8796-4f6fe6cac646 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:55.119382 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-24b8cab4-ef37-4835-8796-4f6fe6cac646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:55.149311 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ee1309-4ccf-4c8b-b9e1-8e2ec72b6849 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:55.151496 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ee1309-4ccf-4c8b-b9e1-8e2ec72b6849 service neutron] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:55.166590 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 985/1952] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:42:55.167512 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b8cab4-ef37-4835-8796-4f6fe6cac646 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:55.179225 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba6360-d72a-4049-8007-a6af48fa6b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:55.180126 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba6360-d72a-4049-8007-a6af48fa6b26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:55.180411 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba6360-d72a-4049-8007-a6af48fa6b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:55.180691 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba6360-d72a-4049-8007-a6af48fa6b26 admin admin] PATH_INFO: `/v3/projects/1b41b95ac36b40fa8a6aea5e5ae27bd8` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:55.182031 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ba6360-d72a-4049-8007-a6af48fa6b26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b41b95ac36b40fa8a6aea5e5ae27bd8)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:55.190055 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ba6360-d72a-4049-8007-a6af48fa6b26 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:55.353459 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c5ba6360-d72a-4049-8007-a6af48fa6b26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b41b95ac36b40fa8a6aea5e5ae27bd8', 'request_id': 'req-c5ba6360-d72a-4049-8007-a6af48fa6b26'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:55.367347 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c5ba6360-d72a-4049-8007-a6af48fa6b26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b41b95ac36b40fa8a6aea5e5ae27bd8', 'request_id': 'req-c5ba6360-d72a-4049-8007-a6af48fa6b26'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:55.381687 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c5ba6360-d72a-4049-8007-a6af48fa6b26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b41b95ac36b40fa8a6aea5e5ae27bd8', 'request_id': 'req-c5ba6360-d72a-4049-8007-a6af48fa6b26'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:55.531994 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c5ba6360-d72a-4049-8007-a6af48fa6b26 admin admin] The token cache is being invalidate because project 1b41b95ac36b40fa8a6aea5e5ae27bd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:42:55.532517 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c5ba6360-d72a-4049-8007-a6af48fa6b26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:55.533383 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c5ba6360-d72a-4049-8007-a6af48fa6b26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:55.535230 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 968/1953] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:42:55 2022] DELETE /identity/v3/projects/1b41b95ac36b40fa8a6aea5e5ae27bd8 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:55.545105 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ee1309-4ccf-4c8b-b9e1-8e2ec72b6849 service neutron] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:55.555456 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ee1309-4ccf-4c8b-b9e1-8e2ec72b6849 service neutron] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:55.614010 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:55.636841 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ecf326-070f-459a-b277-995d0d8f5f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:55.637785 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ecf326-070f-459a-b277-995d0d8f5f8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:55.638145 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ecf326-070f-459a-b277-995d0d8f5f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:55.638783 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ecf326-070f-459a-b277-995d0d8f5f8f admin admin] PATH_INFO: `/v3/users/352d8dd011c843a98e837a6ddbd34c6c` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:55.640005 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ecf326-070f-459a-b277-995d0d8f5f8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=352d8dd011c843a98e837a6ddbd34c6c)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:55.642019 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ecf326-070f-459a-b277-995d0d8f5f8f admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:55.667899 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:55.877791 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-a7ecf326-070f-459a-b277-995d0d8f5f8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '352d8dd011c843a98e837a6ddbd34c6c'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:55.971197 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-a7ecf326-070f-459a-b277-995d0d8f5f8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '352d8dd011c843a98e837a6ddbd34c6c'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:55.972086 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-a7ecf326-070f-459a-b277-995d0d8f5f8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '352d8dd011c843a98e837a6ddbd34c6c'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:55.986856 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-a7ecf326-070f-459a-b277-995d0d8f5f8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '352d8dd011c843a98e837a6ddbd34c6c'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:55.994279 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-a7ecf326-070f-459a-b277-995d0d8f5f8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '352d8dd011c843a98e837a6ddbd34c6c'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:56.004550 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 986/1954] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:42:55 2022] DELETE /identity/v3/users/352d8dd011c843a98e837a6ddbd34c6c => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:56.007485 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba6360-d72a-4049-8007-a6af48fa6b26 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:56.011088 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c5ba6360-d72a-4049-8007-a6af48fa6b26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:56.042289 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba6360-d72a-4049-8007-a6af48fa6b26 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:56.118480 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b94252-3642-4631-a596-e48c0d1ac555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:56.119555 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b94252-3642-4631-a596-e48c0d1ac555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:56.120013 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b94252-3642-4631-a596-e48c0d1ac555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:56.120297 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b94252-3642-4631-a596-e48c0d1ac555 admin admin] PATH_INFO: `/v3/projects/d89fb25ca4bb468aa769c0f94ec91508` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:56.121585 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b94252-3642-4631-a596-e48c0d1ac555 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d89fb25ca4bb468aa769c0f94ec91508)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:56.123903 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b94252-3642-4631-a596-e48c0d1ac555 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:56.238181 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-e6b94252-3642-4631-a596-e48c0d1ac555 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd89fb25ca4bb468aa769c0f94ec91508', 'request_id': 'req-e6b94252-3642-4631-a596-e48c0d1ac555'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:56.250603 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-e6b94252-3642-4631-a596-e48c0d1ac555 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd89fb25ca4bb468aa769c0f94ec91508', 'request_id': 'req-e6b94252-3642-4631-a596-e48c0d1ac555'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:56.256905 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-e6b94252-3642-4631-a596-e48c0d1ac555 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd89fb25ca4bb468aa769c0f94ec91508', 'request_id': 'req-e6b94252-3642-4631-a596-e48c0d1ac555'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:56.366238 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-e6b94252-3642-4631-a596-e48c0d1ac555 admin admin] The token cache is being invalidate because project d89fb25ca4bb468aa769c0f94ec91508 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:42:56.366613 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-e6b94252-3642-4631-a596-e48c0d1ac555 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:56.367263 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-e6b94252-3642-4631-a596-e48c0d1ac555 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:56.368850 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 969/1955] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:42:56 2022] DELETE /identity/v3/projects/d89fb25ca4bb468aa769c0f94ec91508 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:42:56.376598 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ecf326-070f-459a-b277-995d0d8f5f8f admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:56.378422 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-a7ecf326-070f-459a-b277-995d0d8f5f8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:56.396438 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ecf326-070f-459a-b277-995d0d8f5f8f admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:56.459142 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0506d2e-c2fc-44b5-8476-0f72766e4303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:56.459142 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0506d2e-c2fc-44b5-8476-0f72766e4303 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:56.459142 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0506d2e-c2fc-44b5-8476-0f72766e4303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:56.459142 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0506d2e-c2fc-44b5-8476-0f72766e4303 admin admin] PATH_INFO: `/v3/users/d9620146f8eb4ec695f49301cbe4ba2e` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:56.459496 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0506d2e-c2fc-44b5-8476-0f72766e4303 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9620146f8eb4ec695f49301cbe4ba2e)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:56.460777 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0506d2e-c2fc-44b5-8476-0f72766e4303 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:56.513354 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b94252-3642-4631-a596-e48c0d1ac555 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:56.520542 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-e6b94252-3642-4631-a596-e48c0d1ac555 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:56.532765 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b94252-3642-4631-a596-e48c0d1ac555 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:56.539353 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4369f4-010d-4786-890d-72f41e9ce4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:56.543432 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4369f4-010d-4786-890d-72f41e9ce4c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:56.543432 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4369f4-010d-4786-890d-72f41e9ce4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:56.543432 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4369f4-010d-4786-890d-72f41e9ce4c1 admin admin] PATH_INFO: `/v3/projects/1a68a79d308049c1a6a82d387cdb653f` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:56.543432 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4369f4-010d-4786-890d-72f41e9ce4c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a68a79d308049c1a6a82d387cdb653f)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:56.544166 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4369f4-010d-4786-890d-72f41e9ce4c1 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:56.687578 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-e0506d2e-c2fc-44b5-8476-0f72766e4303 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9620146f8eb4ec695f49301cbe4ba2e'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:56.690644 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-bb4369f4-010d-4786-890d-72f41e9ce4c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a68a79d308049c1a6a82d387cdb653f', 'request_id': 'req-bb4369f4-010d-4786-890d-72f41e9ce4c1'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:56.700633 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-bb4369f4-010d-4786-890d-72f41e9ce4c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a68a79d308049c1a6a82d387cdb653f', 'request_id': 'req-bb4369f4-010d-4786-890d-72f41e9ce4c1'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:56.708917 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-bb4369f4-010d-4786-890d-72f41e9ce4c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a68a79d308049c1a6a82d387cdb653f', 'request_id': 'req-bb4369f4-010d-4786-890d-72f41e9ce4c1'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:56.737335 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-e0506d2e-c2fc-44b5-8476-0f72766e4303 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9620146f8eb4ec695f49301cbe4ba2e'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:56.737444 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-e0506d2e-c2fc-44b5-8476-0f72766e4303 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9620146f8eb4ec695f49301cbe4ba2e'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:56.750937 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-e0506d2e-c2fc-44b5-8476-0f72766e4303 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9620146f8eb4ec695f49301cbe4ba2e'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:56.758522 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-e0506d2e-c2fc-44b5-8476-0f72766e4303 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9620146f8eb4ec695f49301cbe4ba2e'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:56.767138 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 987/1956] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:42:56 2022] DELETE /identity/v3/users/d9620146f8eb4ec695f49301cbe4ba2e => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:56.855235 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-bb4369f4-010d-4786-890d-72f41e9ce4c1 admin admin] The token cache is being invalidate because project 1a68a79d308049c1a6a82d387cdb653f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:42:56.858415 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-bb4369f4-010d-4786-890d-72f41e9ce4c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:56.858970 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-bb4369f4-010d-4786-890d-72f41e9ce4c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:56.861336 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 970/1957] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:42:56 2022] DELETE /identity/v3/projects/1a68a79d308049c1a6a82d387cdb653f => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:56.866315 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed261c9c-95d5-46a9-bdda-a003c693e5c3 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:56.866607 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed261c9c-95d5-46a9-bdda-a003c693e5c3 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:56.866987 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed261c9c-95d5-46a9-bdda-a003c693e5c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:56.886653 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-ed261c9c-95d5-46a9-bdda-a003c693e5c3 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:56.887937 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-ed261c9c-95d5-46a9-bdda-a003c693e5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:56.957143 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 988/1958] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:42:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:56.964771 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81934924-5500-444c-8350-8472dc005062 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:56.969350 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81934924-5500-444c-8350-8472dc005062 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:56.969350 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81934924-5500-444c-8350-8472dc005062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:56.988144 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-81934924-5500-444c-8350-8472dc005062 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:56.991071 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-81934924-5500-444c-8350-8472dc005062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:57.010171 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 971/1959] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:42:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:42:57.013478 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed261c9c-95d5-46a9-bdda-a003c693e5c3 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:57.033883 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed261c9c-95d5-46a9-bdda-a003c693e5c3 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:57.041739 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d59df-5797-4820-a419-9570787d6901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:57.042517 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d59df-5797-4820-a419-9570787d6901 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:57.042806 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d59df-5797-4820-a419-9570787d6901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:57.043074 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d59df-5797-4820-a419-9570787d6901 admin admin] PATH_INFO: `/v3/domains` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:57.044957 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4d59df-5797-4820-a419-9570787d6901 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:42:57.045489 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4d59df-5797-4820-a419-9570787d6901 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:57.048487 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4d59df-5797-4820-a419-9570787d6901 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:57.063047 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 989/1960] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 10:42:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:42:57.067805 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81934924-5500-444c-8350-8472dc005062 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:57.083680 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81934924-5500-444c-8350-8472dc005062 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:57.090310 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d12b6dc-abbb-471e-b1d7-4239b0a47667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:57.091972 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12b6dc-abbb-471e-b1d7-4239b0a47667 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:57.092638 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12b6dc-abbb-471e-b1d7-4239b0a47667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:57.093239 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12b6dc-abbb-471e-b1d7-4239b0a47667 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:57.094738 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d12b6dc-abbb-471e-b1d7-4239b0a47667 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:57.096713 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d12b6dc-abbb-471e-b1d7-4239b0a47667 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:57.186856 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 972/1961] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:42:57 2022] POST /identity/v3/projects => generated 393 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:42:57.191003 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d59df-5797-4820-a419-9570787d6901 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:57.202012 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d59df-5797-4820-a419-9570787d6901 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:57.273131 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e824b3-aad0-460d-a50d-a0f8a17c72bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:57.273830 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e824b3-aad0-460d-a50d-a0f8a17c72bb admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:57.274168 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e824b3-aad0-460d-a50d-a0f8a17c72bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:57.274451 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e824b3-aad0-460d-a50d-a0f8a17c72bb admin admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:57.275221 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e824b3-aad0-460d-a50d-a0f8a17c72bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:57.277588 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e824b3-aad0-460d-a50d-a0f8a17c72bb admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:57.391795 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d12b6dc-abbb-471e-b1d7-4239b0a47667 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:57.393534 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-4d12b6dc-abbb-471e-b1d7-4239b0a47667 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:57.409055 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d12b6dc-abbb-471e-b1d7-4239b0a47667 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:57.414117 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f7bf5-e0b7-45a5-9c7b-d2f5e239bd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:57.415178 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f7bf5-e0b7-45a5-9c7b-d2f5e239bd52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:57.415478 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f7bf5-e0b7-45a5-9c7b-d2f5e239bd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:57.416744 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f7bf5-e0b7-45a5-9c7b-d2f5e239bd52 admin admin] PATH_INFO: `/v3/projects/a4a16e49230244cdb233edf63c3ebf85` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:57.418566 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176f7bf5-e0b7-45a5-9c7b-d2f5e239bd52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4a16e49230244cdb233edf63c3ebf85)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:57.420655 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176f7bf5-e0b7-45a5-9c7b-d2f5e239bd52 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:57.443081 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 990/1962] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:42:57 2022] POST /identity/v3/users => generated 297 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:42:57.444435 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e824b3-aad0-460d-a50d-a0f8a17c72bb admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:57.458035 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e824b3-aad0-460d-a50d-a0f8a17c72bb admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:57.463706 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0908d-2a3d-4154-8515-797e44dd469a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:57.464532 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0908d-2a3d-4154-8515-797e44dd469a admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:57.464880 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0908d-2a3d-4154-8515-797e44dd469a admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:57.465242 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0908d-2a3d-4154-8515-797e44dd469a admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:57.478328 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec0908d-2a3d-4154-8515-797e44dd469a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:57.478328 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec0908d-2a3d-4154-8515-797e44dd469a admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:57.488651 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 991/1963] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:57 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:42:57.492527 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0908d-2a3d-4154-8515-797e44dd469a admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:57.501188 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:57.505287 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0908d-2a3d-4154-8515-797e44dd469a admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:57.510040 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9978e5ed-f7d5-4158-8210-bfb7a66dba4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:57.510716 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978e5ed-f7d5-4158-8210-bfb7a66dba4e admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:57.511002 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978e5ed-f7d5-4158-8210-bfb7a66dba4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:57.511282 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978e5ed-f7d5-4158-8210-bfb7a66dba4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:57.512010 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9978e5ed-f7d5-4158-8210-bfb7a66dba4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:57.514321 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9978e5ed-f7d5-4158-8210-bfb7a66dba4e admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:57.530185 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 992/1964] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 10:42:57.533330 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9978e5ed-f7d5-4158-8210-bfb7a66dba4e admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:57.544683 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9978e5ed-f7d5-4158-8210-bfb7a66dba4e admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:57.549537 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29225c96-2870-482f-959e-d0a52a61919a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:57.550491 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29225c96-2870-482f-959e-d0a52a61919a admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:57.550723 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29225c96-2870-482f-959e-d0a52a61919a admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:57.551003 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29225c96-2870-482f-959e-d0a52a61919a admin admin] PATH_INFO: `/v3/projects/ce34a4bb65fb415aa5af22f7c2ef9f4a/users/de720e68afa8486ba99ddd57338d175d/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:57.567366 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29225c96-2870-482f-959e-d0a52a61919a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce34a4bb65fb415aa5af22f7c2ef9f4a, user_id=de720e68afa8486ba99ddd57338d175d, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:57.570297 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29225c96-2870-482f-959e-d0a52a61919a admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:57.646269 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 993/1965] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:42:57 2022] PUT /identity/v3/projects/ce34a4bb65fb415aa5af22f7c2ef9f4a/users/de720e68afa8486ba99ddd57338d175d/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:57.657963 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d20858-b039-4bf9-a0fc-0a8f9c30f024 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:57.658261 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d20858-b039-4bf9-a0fc-0a8f9c30f024 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:57.658546 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d20858-b039-4bf9-a0fc-0a8f9c30f024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:57.659931 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-176f7bf5-e0b7-45a5-9c7b-d2f5e239bd52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4a16e49230244cdb233edf63c3ebf85', 'request_id': 'req-176f7bf5-e0b7-45a5-9c7b-d2f5e239bd52'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:57.666750 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-176f7bf5-e0b7-45a5-9c7b-d2f5e239bd52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4a16e49230244cdb233edf63c3ebf85', 'request_id': 'req-176f7bf5-e0b7-45a5-9c7b-d2f5e239bd52'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:57.673549 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-176f7bf5-e0b7-45a5-9c7b-d2f5e239bd52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4a16e49230244cdb233edf63c3ebf85', 'request_id': 'req-176f7bf5-e0b7-45a5-9c7b-d2f5e239bd52'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:57.690797 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-f2d20858-b039-4bf9-a0fc-0a8f9c30f024 None None] MFA Rules not processed for user `de720e68afa8486ba99ddd57338d175d`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:57.692070 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-f2d20858-b039-4bf9-a0fc-0a8f9c30f024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:57.760005 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-176f7bf5-e0b7-45a5-9c7b-d2f5e239bd52 admin admin] The token cache is being invalidate because project a4a16e49230244cdb233edf63c3ebf85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:42:57.760565 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-176f7bf5-e0b7-45a5-9c7b-d2f5e239bd52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:57.761449 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-176f7bf5-e0b7-45a5-9c7b-d2f5e239bd52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:42:57.761674 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 994/1966] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:42:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:57.763779 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 973/1967] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:42:57 2022] DELETE /identity/v3/projects/a4a16e49230244cdb233edf63c3ebf85 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:42:57.772447 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d20858-b039-4bf9-a0fc-0a8f9c30f024 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:57.773587 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda1eea-b460-494e-8d88-b72ad21f630a None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:57.773951 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda1eea-b460-494e-8d88-b72ad21f630a None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:57.774298 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda1eea-b460-494e-8d88-b72ad21f630a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:57.797344 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-9cda1eea-b460-494e-8d88-b72ad21f630a None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:57.798739 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-9cda1eea-b460-494e-8d88-b72ad21f630a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:57.848160 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d20858-b039-4bf9-a0fc-0a8f9c30f024 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:57.858879 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7417f63f-ee24-4fce-9960-5285e976e6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:57.859723 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7417f63f-ee24-4fce-9960-5285e976e6ce admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:57.860065 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7417f63f-ee24-4fce-9960-5285e976e6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:57.860399 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7417f63f-ee24-4fce-9960-5285e976e6ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:57.861237 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7417f63f-ee24-4fce-9960-5285e976e6ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:57.863282 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7417f63f-ee24-4fce-9960-5285e976e6ce admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:57.875413 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 974/1968] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:42:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:42:57.882880 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e73e4-bf2a-436b-83e0-4e80a999ff2c None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:57.883169 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e73e4-bf2a-436b-83e0-4e80a999ff2c None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:57.883449 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e73e4-bf2a-436b-83e0-4e80a999ff2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:57.905325 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-984e73e4-bf2a-436b-83e0-4e80a999ff2c None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:57.906633 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-984e73e4-bf2a-436b-83e0-4e80a999ff2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:57.915714 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 975/1969] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:42:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:42:57.921448 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e73e4-bf2a-436b-83e0-4e80a999ff2c None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:57.932052 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e73e4-bf2a-436b-83e0-4e80a999ff2c None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:57.937730 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9584c06e-6038-48a2-b7f4-337fda693e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:57.938408 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9584c06e-6038-48a2-b7f4-337fda693e18 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:57.938693 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9584c06e-6038-48a2-b7f4-337fda693e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:57.938975 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9584c06e-6038-48a2-b7f4-337fda693e18 admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:57.939706 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9584c06e-6038-48a2-b7f4-337fda693e18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:42:57.940017 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9584c06e-6038-48a2-b7f4-337fda693e18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:57.941751 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9584c06e-6038-48a2-b7f4-337fda693e18 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:57.954152 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 995/1970] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:42:57 2022] POST /identity/v3/projects => generated 393 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:42:57.955091 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 976/1971] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 10:42:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:42:57.959464 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9584c06e-6038-48a2-b7f4-337fda693e18 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:57.960478 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7417f63f-ee24-4fce-9960-5285e976e6ce admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:57.961926 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-9584c06e-6038-48a2-b7f4-337fda693e18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:57.979611 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9584c06e-6038-48a2-b7f4-337fda693e18 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:58.034806 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7417f63f-ee24-4fce-9960-5285e976e6ce admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:58.039733 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd53109-f50e-4d1b-99f6-2b714f4dee05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:58.040007 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7cc4d2-f9be-4242-ad4e-74a6764523b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:58.040465 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd53109-f50e-4d1b-99f6-2b714f4dee05 admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:58.040683 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7cc4d2-f9be-4242-ad4e-74a6764523b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:58.040788 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd53109-f50e-4d1b-99f6-2b714f4dee05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:58.040962 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd53109-f50e-4d1b-99f6-2b714f4dee05 admin admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:58.041091 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7cc4d2-f9be-4242-ad4e-74a6764523b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:58.041287 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7cc4d2-f9be-4242-ad4e-74a6764523b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:58.041695 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd53109-f50e-4d1b-99f6-2b714f4dee05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:58.041956 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7cc4d2-f9be-4242-ad4e-74a6764523b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:58.044308 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd53109-f50e-4d1b-99f6-2b714f4dee05 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:58.044571 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7cc4d2-f9be-4242-ad4e-74a6764523b8 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:58.154118 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 977/1972] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:42:57 2022] POST /identity/v3/users => generated 303 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:42:58.155708 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7cc4d2-f9be-4242-ad4e-74a6764523b8 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:58.167065 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7cc4d2-f9be-4242-ad4e-74a6764523b8 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:58.173448 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:58.176102 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f310bd-08cb-4ba8-b2f7-16acc5ae35d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:58.177385 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f310bd-08cb-4ba8-b2f7-16acc5ae35d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:58.177775 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f310bd-08cb-4ba8-b2f7-16acc5ae35d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:58.178582 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f310bd-08cb-4ba8-b2f7-16acc5ae35d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:58.179540 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f310bd-08cb-4ba8-b2f7-16acc5ae35d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:58.181304 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f310bd-08cb-4ba8-b2f7-16acc5ae35d7 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:58.185169 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 996/1973] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:42:57 2022] POST /identity/v3/projects => generated 385 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:42:58.190191 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd53109-f50e-4d1b-99f6-2b714f4dee05 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:58.194053 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 978/1974] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:58 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 10:42:58.201472 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f310bd-08cb-4ba8-b2f7-16acc5ae35d7 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:58.213243 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f310bd-08cb-4ba8-b2f7-16acc5ae35d7 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:58.288436 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6866bb8-fee3-421f-847f-4b4a97170eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:58.297837 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6866bb8-fee3-421f-847f-4b4a97170eb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:58.297837 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6866bb8-fee3-421f-847f-4b4a97170eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:58.297837 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6866bb8-fee3-421f-847f-4b4a97170eb0 admin admin] PATH_INFO: `/v3/projects/05638887ba3f4506b34cb47c585fbd4c/users/38dc4a647bbb4c28b8d3f5a05da431d3/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:58.314919 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6866bb8-fee3-421f-847f-4b4a97170eb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05638887ba3f4506b34cb47c585fbd4c, user_id=38dc4a647bbb4c28b8d3f5a05da431d3, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:58.316154 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd53109-f50e-4d1b-99f6-2b714f4dee05 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:58.318559 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6866bb8-fee3-421f-847f-4b4a97170eb0 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:58.322115 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b15899-3e81-4e33-a28f-3e018e28032c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:58.328700 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b15899-3e81-4e33-a28f-3e018e28032c admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:58.328700 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b15899-3e81-4e33-a28f-3e018e28032c admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:58.328700 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b15899-3e81-4e33-a28f-3e018e28032c admin admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:58.328700 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b15899-3e81-4e33-a28f-3e018e28032c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:58.329982 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b15899-3e81-4e33-a28f-3e018e28032c admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:58.434882 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 979/1975] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:42:58 2022] PUT /identity/v3/projects/05638887ba3f4506b34cb47c585fbd4c/users/38dc4a647bbb4c28b8d3f5a05da431d3/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:58.440615 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6866bb8-fee3-421f-847f-4b4a97170eb0 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:58.462547 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 997/1976] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:42:58 2022] POST /identity/v3/users => generated 293 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:42:58.467662 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b15899-3e81-4e33-a28f-3e018e28032c admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:58.480940 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b15899-3e81-4e33-a28f-3e018e28032c admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:58.507517 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6866bb8-fee3-421f-847f-4b4a97170eb0 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:58.512197 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd69e374-1b75-49dd-914a-43f758f6d761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:58.513522 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd69e374-1b75-49dd-914a-43f758f6d761 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:58.513809 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd69e374-1b75-49dd-914a-43f758f6d761 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:58.514088 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd69e374-1b75-49dd-914a-43f758f6d761 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:58.514818 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd69e374-1b75-49dd-914a-43f758f6d761 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:58.516423 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd69e374-1b75-49dd-914a-43f758f6d761 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:58.531656 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 980/1977] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:58 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 10:42:58.532853 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd69e374-1b75-49dd-914a-43f758f6d761 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:58.543334 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd69e374-1b75-49dd-914a-43f758f6d761 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:58.548943 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdaed71-6c4e-4672-82db-2de9209595b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:58.548943 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdaed71-6c4e-4672-82db-2de9209595b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:58.548943 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdaed71-6c4e-4672-82db-2de9209595b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:58.548943 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdaed71-6c4e-4672-82db-2de9209595b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:58.549349 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdaed71-6c4e-4672-82db-2de9209595b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:58.549432 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11cc33d-175e-4220-8556-decdb834fb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:58.549432 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11cc33d-175e-4220-8556-decdb834fb7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:58.549685 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11cc33d-175e-4220-8556-decdb834fb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:58.549953 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdaed71-6c4e-4672-82db-2de9209595b7 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:58.550061 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11cc33d-175e-4220-8556-decdb834fb7e admin admin] PATH_INFO: `/v3/projects/05638887ba3f4506b34cb47c585fbd4c/users/38dc4a647bbb4c28b8d3f5a05da431d3/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:58.552116 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11cc33d-175e-4220-8556-decdb834fb7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=05638887ba3f4506b34cb47c585fbd4c, user_id=38dc4a647bbb4c28b8d3f5a05da431d3, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:58.555072 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11cc33d-175e-4220-8556-decdb834fb7e admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:58.560855 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 998/1978] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:58 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:42:58.570330 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 981/1979] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:42:58 2022] PUT /identity/v3/projects/05638887ba3f4506b34cb47c585fbd4c/users/38dc4a647bbb4c28b8d3f5a05da431d3/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:58.571017 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdaed71-6c4e-4672-82db-2de9209595b7 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:58.582636 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a069ef-4604-4333-ab0e-dc50acc58f26 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:58.582862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdaed71-6c4e-4672-82db-2de9209595b7 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:58.583073 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a069ef-4604-4333-ab0e-dc50acc58f26 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:58.583582 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a069ef-4604-4333-ab0e-dc50acc58f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:58.623598 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-49a069ef-4604-4333-ab0e-dc50acc58f26 None None] MFA Rules not processed for user `38dc4a647bbb4c28b8d3f5a05da431d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:58.623598 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-49a069ef-4604-4333-ab0e-dc50acc58f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:58.656739 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71083011-1e92-481a-b50a-1b890d78e2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:58.657453 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71083011-1e92-481a-b50a-1b890d78e2d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:58.657746 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71083011-1e92-481a-b50a-1b890d78e2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:58.658163 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71083011-1e92-481a-b50a-1b890d78e2d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:58.658907 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71083011-1e92-481a-b50a-1b890d78e2d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:58.660522 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71083011-1e92-481a-b50a-1b890d78e2d5 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:58.672654 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 999/1980] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:58 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:42:58.676810 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71083011-1e92-481a-b50a-1b890d78e2d5 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:58.687273 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71083011-1e92-481a-b50a-1b890d78e2d5 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:58.692007 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff53fd-0b5c-4609-8709-a7cc6c194cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:58.692930 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff53fd-0b5c-4609-8709-a7cc6c194cc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:58.693298 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff53fd-0b5c-4609-8709-a7cc6c194cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:58.693579 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff53fd-0b5c-4609-8709-a7cc6c194cc8 admin admin] PATH_INFO: `/v3/projects/9ac353e2497646d0ab333c6560e36aac/users/88febedb779841fd8d5ed2f39540b1c7/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:58.709534 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ff53fd-0b5c-4609-8709-a7cc6c194cc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ac353e2497646d0ab333c6560e36aac, user_id=88febedb779841fd8d5ed2f39540b1c7, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:58.710123 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 982/1981] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:42:58 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:58.712364 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ff53fd-0b5c-4609-8709-a7cc6c194cc8 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:58.721734 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a069ef-4604-4333-ab0e-dc50acc58f26 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:58.723111 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-49a069ef-4604-4333-ab0e-dc50acc58f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:58.737881 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:58.779108 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1000/1982] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:42:58 2022] PUT /identity/v3/projects/9ac353e2497646d0ab333c6560e36aac/users/88febedb779841fd8d5ed2f39540b1c7/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:42:58.790056 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d4502-4e7a-4030-97bd-dd13ea8ac185 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:58.790416 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d4502-4e7a-4030-97bd-dd13ea8ac185 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:58.790855 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d4502-4e7a-4030-97bd-dd13ea8ac185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:58.791096 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a069ef-4604-4333-ab0e-dc50acc58f26 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:58.823085 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-8d9d4502-4e7a-4030-97bd-dd13ea8ac185 None None] MFA Rules not processed for user `88febedb779841fd8d5ed2f39540b1c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:58.824490 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-8d9d4502-4e7a-4030-97bd-dd13ea8ac185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:58.858378 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5fb16e-5155-4239-b8a2-4ff69449b8ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:58.859114 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5fb16e-5155-4239-b8a2-4ff69449b8ec service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:58.859405 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5fb16e-5155-4239-b8a2-4ff69449b8ec service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:58.859676 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5fb16e-5155-4239-b8a2-4ff69449b8ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:58.905912 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1001/1983] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:42:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:58.910663 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d4502-4e7a-4030-97bd-dd13ea8ac185 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:58.926316 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5fb16e-5155-4239-b8a2-4ff69449b8ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:58.928013 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5fb16e-5155-4239-b8a2-4ff69449b8ec service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:58.945676 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 983/1984] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:58 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:42:58.994861 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5fb16e-5155-4239-b8a2-4ff69449b8ec service cinder] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:58.996101 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-0e5fb16e-5155-4239-b8a2-4ff69449b8ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:59.005627 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d4502-4e7a-4030-97bd-dd13ea8ac185 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:59.008172 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5fb16e-5155-4239-b8a2-4ff69449b8ec service cinder] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:59.011706 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463037c-1248-481e-b3bd-e31480efc311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:59.013441 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463037c-1248-481e-b3bd-e31480efc311 admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:59.014015 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463037c-1248-481e-b3bd-e31480efc311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:59.014405 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d304b-ca66-46dc-a5d0-2f8b75b81622 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:59.014642 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463037c-1248-481e-b3bd-e31480efc311 admin admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:59.015577 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2463037c-1248-481e-b3bd-e31480efc311 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:59.015837 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d304b-ca66-46dc-a5d0-2f8b75b81622 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:59.016605 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d304b-ca66-46dc-a5d0-2f8b75b81622 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:59.017628 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d304b-ca66-46dc-a5d0-2f8b75b81622 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:59.017736 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2463037c-1248-481e-b3bd-e31480efc311 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:59.019960 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c68d304b-ca66-46dc-a5d0-2f8b75b81622 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:59.083300 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1002/1985] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:42:58 2022] POST /identity/v3/projects => generated 387 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:42:59.087634 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463037c-1248-481e-b3bd-e31480efc311 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:59.095711 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68d304b-ca66-46dc-a5d0-2f8b75b81622 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:59.097188 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68d304b-ca66-46dc-a5d0-2f8b75b81622 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:59.111638 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 984/1986] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:58 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:42:59.161507 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463037c-1248-481e-b3bd-e31480efc311 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:59.170024 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f36333-1b2d-409f-b57e-cbcd8e181860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:59.171315 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f36333-1b2d-409f-b57e-cbcd8e181860 admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:59.171688 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f36333-1b2d-409f-b57e-cbcd8e181860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:59.172039 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f36333-1b2d-409f-b57e-cbcd8e181860 admin admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:59.172897 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f36333-1b2d-409f-b57e-cbcd8e181860 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:59.175369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f36333-1b2d-409f-b57e-cbcd8e181860 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:59.286932 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1003/1987] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:42:59 2022] POST /identity/v3/users => generated 300 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:42:59.290673 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d304b-ca66-46dc-a5d0-2f8b75b81622 service cinder] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:59.302658 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d304b-ca66-46dc-a5d0-2f8b75b81622 service cinder] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:59.308298 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44ec684-f5e6-46cd-88e1-ceab3622368a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:59.309302 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ec684-f5e6-46cd-88e1-ceab3622368a admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:59.309641 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ec684-f5e6-46cd-88e1-ceab3622368a admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:59.310143 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ec684-f5e6-46cd-88e1-ceab3622368a admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:59.311101 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44ec684-f5e6-46cd-88e1-ceab3622368a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:59.313232 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44ec684-f5e6-46cd-88e1-ceab3622368a admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:59.327734 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 985/1988] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:42:59.329383 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:59.335661 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f36333-1b2d-409f-b57e-cbcd8e181860 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:59.351940 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f36333-1b2d-409f-b57e-cbcd8e181860 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:59.361701 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1986032-d03f-4e3b-8441-4f9ce5466db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:59.364939 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1986032-d03f-4e3b-8441-4f9ce5466db3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:59.365347 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1986032-d03f-4e3b-8441-4f9ce5466db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:59.365831 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1986032-d03f-4e3b-8441-4f9ce5466db3 admin admin] PATH_INFO: `/v3/projects/1b441ac569a142b2ac632c3215e28fbc/users/7002a025f8c6465194726fe5ed309494/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:59.388476 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1986032-d03f-4e3b-8441-4f9ce5466db3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b441ac569a142b2ac632c3215e28fbc, user_id=7002a025f8c6465194726fe5ed309494, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:59.392326 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1986032-d03f-4e3b-8441-4f9ce5466db3 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:59.528867 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1004/1989] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:42:59 2022] PUT /identity/v3/projects/1b441ac569a142b2ac632c3215e28fbc/users/7002a025f8c6465194726fe5ed309494/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:59.533617 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44ec684-f5e6-46cd-88e1-ceab3622368a admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:59.545138 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44ec684-f5e6-46cd-88e1-ceab3622368a admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:59.622846 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19331bc6-9835-43ef-b0af-29473f70a27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:59.624206 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19331bc6-9835-43ef-b0af-29473f70a27f admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:59.624492 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19331bc6-9835-43ef-b0af-29473f70a27f admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:59.625202 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19331bc6-9835-43ef-b0af-29473f70a27f admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:59.625550 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19331bc6-9835-43ef-b0af-29473f70a27f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:59.627489 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19331bc6-9835-43ef-b0af-29473f70a27f admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:59.639490 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 986/1990] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:42:59 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:42:59.643958 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1986032-d03f-4e3b-8441-4f9ce5466db3 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:59.657168 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1986032-d03f-4e3b-8441-4f9ce5466db3 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:42:59.664478 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea57424-dca4-40a2-8d1b-dc0620783043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:42:59.664911 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea57424-dca4-40a2-8d1b-dc0620783043 admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:59.665328 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea57424-dca4-40a2-8d1b-dc0620783043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:59.665701 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea57424-dca4-40a2-8d1b-dc0620783043 admin admin] PATH_INFO: `/v3/projects/1b441ac569a142b2ac632c3215e28fbc/users/7002a025f8c6465194726fe5ed309494/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:59.669305 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea57424-dca4-40a2-8d1b-dc0620783043 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b441ac569a142b2ac632c3215e28fbc, user_id=7002a025f8c6465194726fe5ed309494, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:42:59.673028 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea57424-dca4-40a2-8d1b-dc0620783043 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:42:59.699118 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1005/1991] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:42:59 2022] PUT /identity/v3/projects/1b441ac569a142b2ac632c3215e28fbc/users/7002a025f8c6465194726fe5ed309494/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:42:59.703129 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a233e36-f0c8-4cd1-975c-f5c617eaf61e None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:42:59.703422 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a233e36-f0c8-4cd1-975c-f5c617eaf61e None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:42:59.703705 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a233e36-f0c8-4cd1-975c-f5c617eaf61e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:42:59.743607 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-5a233e36-f0c8-4cd1-975c-f5c617eaf61e None None] MFA Rules not processed for user `7002a025f8c6465194726fe5ed309494`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:42:59.745701 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-5a233e36-f0c8-4cd1-975c-f5c617eaf61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:59.855171 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 987/1992] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:42:59 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:42:59.908596 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea57424-dca4-40a2-8d1b-dc0620783043 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:42:59.908596 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-1ea57424-dca4-40a2-8d1b-dc0620783043 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:42:59.909018 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a233e36-f0c8-4cd1-975c-f5c617eaf61e None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:00.026571 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a233e36-f0c8-4cd1-975c-f5c617eaf61e None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:00.040072 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea57424-dca4-40a2-8d1b-dc0620783043 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:00.042041 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eff62b-e90a-4332-ae3b-efda1a8c61e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:00.042741 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eff62b-e90a-4332-ae3b-efda1a8c61e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:00.043020 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eff62b-e90a-4332-ae3b-efda1a8c61e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:00.046347 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eff62b-e90a-4332-ae3b-efda1a8c61e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:00.056101 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe0576-6ed6-496b-804c-a2b14460a177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:00.057211 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe0576-6ed6-496b-804c-a2b14460a177 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:00.058005 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe0576-6ed6-496b-804c-a2b14460a177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:00.058005 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe0576-6ed6-496b-804c-a2b14460a177 admin admin] PATH_INFO: `/v3/users/8a6717b02c654f8c9ceaba22754d46f7` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:00.075551 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eff62b-e90a-4332-ae3b-efda1a8c61e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:00.075962 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eff62b-e90a-4332-ae3b-efda1a8c61e9 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:00.080776 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe0576-6ed6-496b-804c-a2b14460a177 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a6717b02c654f8c9ceaba22754d46f7)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:00.084188 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe0576-6ed6-496b-804c-a2b14460a177 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:00.092683 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 988/1993] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:42:59 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:43:00.172990 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:00.392907 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-8efe0576-6ed6-496b-804c-a2b14460a177 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a6717b02c654f8c9ceaba22754d46f7'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:00.468292 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-8efe0576-6ed6-496b-804c-a2b14460a177 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a6717b02c654f8c9ceaba22754d46f7'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:00.469006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-8efe0576-6ed6-496b-804c-a2b14460a177 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a6717b02c654f8c9ceaba22754d46f7'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:00.494530 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-8efe0576-6ed6-496b-804c-a2b14460a177 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a6717b02c654f8c9ceaba22754d46f7'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:00.519514 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-8efe0576-6ed6-496b-804c-a2b14460a177 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a6717b02c654f8c9ceaba22754d46f7'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:00.530618 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1006/1994] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:42:59 2022] DELETE /identity/v3/users/8a6717b02c654f8c9ceaba22754d46f7 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:43:00.535423 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51abbe-2288-4c69-bc11-26b96c824412 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:00.536509 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51abbe-2288-4c69-bc11-26b96c824412 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:00.536854 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51abbe-2288-4c69-bc11-26b96c824412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:00.557299 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-ab51abbe-2288-4c69-bc11-26b96c824412 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:43:00.558617 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-ab51abbe-2288-4c69-bc11-26b96c824412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:00.666944 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:00.682614 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 989/1995] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:43:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:43:00.695070 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe0576-6ed6-496b-804c-a2b14460a177 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:00.696654 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-8efe0576-6ed6-496b-804c-a2b14460a177 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:00.779287 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe0576-6ed6-496b-804c-a2b14460a177 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:00.782959 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e495d4d8-573d-463f-8361-b57264bf02ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:00.783634 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e495d4d8-573d-463f-8361-b57264bf02ac service neutron] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:00.783923 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e495d4d8-573d-463f-8361-b57264bf02ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:00.784200 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e495d4d8-573d-463f-8361-b57264bf02ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:00.799993 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e495d4d8-573d-463f-8361-b57264bf02ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:00.801722 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e495d4d8-573d-463f-8361-b57264bf02ac service neutron] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:00.817501 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1007/1996] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:43:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:43:01.165658 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:01.282238 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab51abbe-2288-4c69-bc11-26b96c824412 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:01.283941 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-ab51abbe-2288-4c69-bc11-26b96c824412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:01.298429 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab51abbe-2288-4c69-bc11-26b96c824412 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:01.307214 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b11586-3ae0-490e-814b-96729ddb7759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:01.308200 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b11586-3ae0-490e-814b-96729ddb7759 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:01.308485 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b11586-3ae0-490e-814b-96729ddb7759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:01.308763 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b11586-3ae0-490e-814b-96729ddb7759 admin admin] PATH_INFO: `/v3/projects/b9734ac9849649ba83b61614293cdc72` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:01.310575 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b11586-3ae0-490e-814b-96729ddb7759 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9734ac9849649ba83b61614293cdc72)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:01.312523 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b11586-3ae0-490e-814b-96729ddb7759 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:01.457682 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c7b11586-3ae0-490e-814b-96729ddb7759 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9734ac9849649ba83b61614293cdc72', 'request_id': 'req-c7b11586-3ae0-490e-814b-96729ddb7759'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:01.468796 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c7b11586-3ae0-490e-814b-96729ddb7759 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9734ac9849649ba83b61614293cdc72', 'request_id': 'req-c7b11586-3ae0-490e-814b-96729ddb7759'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:01.475886 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c7b11586-3ae0-490e-814b-96729ddb7759 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9734ac9849649ba83b61614293cdc72', 'request_id': 'req-c7b11586-3ae0-490e-814b-96729ddb7759'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:01.526324 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e495d4d8-573d-463f-8361-b57264bf02ac service neutron] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:01.529995 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-e495d4d8-573d-463f-8361-b57264bf02ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:01.543580 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e495d4d8-573d-463f-8361-b57264bf02ac service neutron] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:01.550244 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c7b11586-3ae0-490e-814b-96729ddb7759 admin admin] The token cache is being invalidate because project b9734ac9849649ba83b61614293cdc72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:43:01.550906 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c7b11586-3ae0-490e-814b-96729ddb7759 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:01.551214 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c7b11586-3ae0-490e-814b-96729ddb7759 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:01.553513 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 990/1997] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:43:01 2022] DELETE /identity/v3/projects/b9734ac9849649ba83b61614293cdc72 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:43:01.557189 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b11586-3ae0-490e-814b-96729ddb7759 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:01.558533 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c7b11586-3ae0-490e-814b-96729ddb7759 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:01.635157 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:01.644669 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c4333-6d26-465a-8cc9-12d8fc6d2b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:01.645599 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c4333-6d26-465a-8cc9-12d8fc6d2b0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:01.645889 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c4333-6d26-465a-8cc9-12d8fc6d2b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:01.646169 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c4333-6d26-465a-8cc9-12d8fc6d2b0c admin admin] PATH_INFO: `/v3/users/88febedb779841fd8d5ed2f39540b1c7` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:01.647462 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c4333-6d26-465a-8cc9-12d8fc6d2b0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=88febedb779841fd8d5ed2f39540b1c7)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:01.658043 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c4333-6d26-465a-8cc9-12d8fc6d2b0c admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:01.664553 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b11586-3ae0-490e-814b-96729ddb7759 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:01.672122 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52060883-4061-4bc1-acce-ea3ddc2ca937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:01.673139 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52060883-4061-4bc1-acce-ea3ddc2ca937 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:01.673419 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52060883-4061-4bc1-acce-ea3ddc2ca937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:01.673698 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52060883-4061-4bc1-acce-ea3ddc2ca937 admin admin] PATH_INFO: `/v3/users/38aeb9a587b1486bb150c95c9f8c14d1` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:01.675044 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52060883-4061-4bc1-acce-ea3ddc2ca937 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38aeb9a587b1486bb150c95c9f8c14d1)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:01.676848 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52060883-4061-4bc1-acce-ea3ddc2ca937 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:01.887769 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-52060883-4061-4bc1-acce-ea3ddc2ca937 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38aeb9a587b1486bb150c95c9f8c14d1'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:01.891426 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-1e6c4333-6d26-465a-8cc9-12d8fc6d2b0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88febedb779841fd8d5ed2f39540b1c7'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:01.983602 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-52060883-4061-4bc1-acce-ea3ddc2ca937 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38aeb9a587b1486bb150c95c9f8c14d1'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:01.984416 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-52060883-4061-4bc1-acce-ea3ddc2ca937 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38aeb9a587b1486bb150c95c9f8c14d1'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:01.999999 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-52060883-4061-4bc1-acce-ea3ddc2ca937 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38aeb9a587b1486bb150c95c9f8c14d1'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:02.008460 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-52060883-4061-4bc1-acce-ea3ddc2ca937 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38aeb9a587b1486bb150c95c9f8c14d1'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:02.016353 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 991/1998] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:43:01 2022] DELETE /identity/v3/users/38aeb9a587b1486bb150c95c9f8c14d1 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:43:02.046250 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:02.073718 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-1e6c4333-6d26-465a-8cc9-12d8fc6d2b0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88febedb779841fd8d5ed2f39540b1c7'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:02.074433 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-1e6c4333-6d26-465a-8cc9-12d8fc6d2b0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88febedb779841fd8d5ed2f39540b1c7'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:02.096437 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-1e6c4333-6d26-465a-8cc9-12d8fc6d2b0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88febedb779841fd8d5ed2f39540b1c7'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:02.104551 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-1e6c4333-6d26-465a-8cc9-12d8fc6d2b0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88febedb779841fd8d5ed2f39540b1c7'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:02.122266 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1008/1999] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:43:01 2022] DELETE /identity/v3/users/88febedb779841fd8d5ed2f39540b1c7 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:43:02.126985 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa578614-89a1-4939-8f76-ee62225ae06c None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:02.127279 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa578614-89a1-4939-8f76-ee62225ae06c None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:02.127557 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa578614-89a1-4939-8f76-ee62225ae06c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:02.144188 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:02.147432 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-fa578614-89a1-4939-8f76-ee62225ae06c None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:43:02.148734 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-fa578614-89a1-4939-8f76-ee62225ae06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:02.217090 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 992/2000] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:43:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:43:02.226252 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c4333-6d26-465a-8cc9-12d8fc6d2b0c admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:02.227975 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-1e6c4333-6d26-465a-8cc9-12d8fc6d2b0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:02.310145 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c4333-6d26-465a-8cc9-12d8fc6d2b0c admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:02.314865 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636c3a46-e413-40de-b195-0a33fbc8c62d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:02.315542 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c3a46-e413-40de-b195-0a33fbc8c62d service neutron] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:02.315893 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c3a46-e413-40de-b195-0a33fbc8c62d service neutron] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:02.321928 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c3a46-e413-40de-b195-0a33fbc8c62d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:02.338716 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636c3a46-e413-40de-b195-0a33fbc8c62d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:02.340373 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636c3a46-e413-40de-b195-0a33fbc8c62d service neutron] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:02.353978 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1009/2001] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:43:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:43:02.643220 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa578614-89a1-4939-8f76-ee62225ae06c None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:02.645406 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-fa578614-89a1-4939-8f76-ee62225ae06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:02.662517 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa578614-89a1-4939-8f76-ee62225ae06c None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:02.669732 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f4192-7724-4391-adbb-319857aa0eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:02.683203 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f4192-7724-4391-adbb-319857aa0eab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:02.685482 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f4192-7724-4391-adbb-319857aa0eab admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:02.685873 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f4192-7724-4391-adbb-319857aa0eab admin admin] PATH_INFO: `/v3/projects/b0a76d4684a648888eaacd668628580f` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:02.689145 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49f4192-7724-4391-adbb-319857aa0eab admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0a76d4684a648888eaacd668628580f)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:02.699514 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49f4192-7724-4391-adbb-319857aa0eab admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:02.896904 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a49f4192-7724-4391-adbb-319857aa0eab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0a76d4684a648888eaacd668628580f', 'request_id': 'req-a49f4192-7724-4391-adbb-319857aa0eab'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:02.903567 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a49f4192-7724-4391-adbb-319857aa0eab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0a76d4684a648888eaacd668628580f', 'request_id': 'req-a49f4192-7724-4391-adbb-319857aa0eab'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:02.909452 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a49f4192-7724-4391-adbb-319857aa0eab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0a76d4684a648888eaacd668628580f', 'request_id': 'req-a49f4192-7724-4391-adbb-319857aa0eab'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:02.984668 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636c3a46-e413-40de-b195-0a33fbc8c62d service neutron] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:02.986586 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-636c3a46-e413-40de-b195-0a33fbc8c62d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:03.009453 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636c3a46-e413-40de-b195-0a33fbc8c62d service neutron] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:03.012667 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a49f4192-7724-4391-adbb-319857aa0eab admin admin] The token cache is being invalidate because project b0a76d4684a648888eaacd668628580f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:43:03.013235 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a49f4192-7724-4391-adbb-319857aa0eab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:03.016338 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a49f4192-7724-4391-adbb-319857aa0eab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:03.023073 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 993/2002] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:43:02 2022] DELETE /identity/v3/projects/b0a76d4684a648888eaacd668628580f => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:43:03.024565 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f5566f-7c73-4913-9be7-4fcd178a0acf None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:03.024878 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f5566f-7c73-4913-9be7-4fcd178a0acf None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:03.025372 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f5566f-7c73-4913-9be7-4fcd178a0acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:03.046690 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-18f5566f-7c73-4913-9be7-4fcd178a0acf None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:43:03.048147 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-18f5566f-7c73-4913-9be7-4fcd178a0acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:03.102597 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9448201d-9f47-4fa7-a198-a18dbfdeca92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:03.103637 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448201d-9f47-4fa7-a198-a18dbfdeca92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:03.104103 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448201d-9f47-4fa7-a198-a18dbfdeca92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:03.104553 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448201d-9f47-4fa7-a198-a18dbfdeca92 admin admin] PATH_INFO: `/v3/projects/9ac353e2497646d0ab333c6560e36aac` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:03.106942 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9448201d-9f47-4fa7-a198-a18dbfdeca92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ac353e2497646d0ab333c6560e36aac)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:03.109407 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9448201d-9f47-4fa7-a198-a18dbfdeca92 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:03.125626 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 994/2003] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:43:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:43:03.134248 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60585f6-00a6-4b42-8129-075cbea18f8b None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:03.134544 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60585f6-00a6-4b42-8129-075cbea18f8b None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:03.134824 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60585f6-00a6-4b42-8129-075cbea18f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:03.157513 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-c60585f6-00a6-4b42-8129-075cbea18f8b None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:43:03.158752 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c60585f6-00a6-4b42-8129-075cbea18f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:03.167262 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 995/2004] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:43:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:43:03.171899 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60585f6-00a6-4b42-8129-075cbea18f8b None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:03.182259 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60585f6-00a6-4b42-8129-075cbea18f8b None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:03.187430 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb0a93f-414d-4ac6-8faa-14d63e6ee04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:03.188243 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb0a93f-414d-4ac6-8faa-14d63e6ee04e admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:03.188528 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb0a93f-414d-4ac6-8faa-14d63e6ee04e admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:03.188818 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb0a93f-414d-4ac6-8faa-14d63e6ee04e admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:03.189642 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb0a93f-414d-4ac6-8faa-14d63e6ee04e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:43:03.189949 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb0a93f-414d-4ac6-8faa-14d63e6ee04e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:03.191547 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb0a93f-414d-4ac6-8faa-14d63e6ee04e admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:03.204561 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 996/2005] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 10:43:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:43:03.219790 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb0a93f-414d-4ac6-8faa-14d63e6ee04e admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:03.229946 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb0a93f-414d-4ac6-8faa-14d63e6ee04e admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:03.237362 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe2e890-b1ee-4d6a-9179-8d18ebc57112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:03.238539 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2e890-b1ee-4d6a-9179-8d18ebc57112 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:03.239041 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2e890-b1ee-4d6a-9179-8d18ebc57112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:03.239547 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe2e890-b1ee-4d6a-9179-8d18ebc57112 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:03.240867 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe2e890-b1ee-4d6a-9179-8d18ebc57112 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:03.244632 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe2e890-b1ee-4d6a-9179-8d18ebc57112 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:03.303907 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:03.307609 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-9448201d-9f47-4fa7-a198-a18dbfdeca92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ac353e2497646d0ab333c6560e36aac', 'request_id': 'req-9448201d-9f47-4fa7-a198-a18dbfdeca92'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:03.314714 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-9448201d-9f47-4fa7-a198-a18dbfdeca92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ac353e2497646d0ab333c6560e36aac', 'request_id': 'req-9448201d-9f47-4fa7-a198-a18dbfdeca92'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:03.322387 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-9448201d-9f47-4fa7-a198-a18dbfdeca92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ac353e2497646d0ab333c6560e36aac', 'request_id': 'req-9448201d-9f47-4fa7-a198-a18dbfdeca92'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:03.338073 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 997/2006] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:43:03 2022] POST /identity/v3/projects => generated 373 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:43:03.342622 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe2e890-b1ee-4d6a-9179-8d18ebc57112 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:03.410581 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe2e890-b1ee-4d6a-9179-8d18ebc57112 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:03.415359 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d716bd7-92e9-4c1f-bfa9-44b8965cbb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:03.416056 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d716bd7-92e9-4c1f-bfa9-44b8965cbb78 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:03.416338 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d716bd7-92e9-4c1f-bfa9-44b8965cbb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:03.416918 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d716bd7-92e9-4c1f-bfa9-44b8965cbb78 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:03.417801 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d716bd7-92e9-4c1f-bfa9-44b8965cbb78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:03.420178 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d716bd7-92e9-4c1f-bfa9-44b8965cbb78 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:03.470116 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-9448201d-9f47-4fa7-a198-a18dbfdeca92 admin admin] The token cache is being invalidate because project 9ac353e2497646d0ab333c6560e36aac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80392) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:43:03.470464 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-9448201d-9f47-4fa7-a198-a18dbfdeca92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:03.471170 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-9448201d-9f47-4fa7-a198-a18dbfdeca92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:03.473882 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1010/2007] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:43:02 2022] DELETE /identity/v3/projects/9ac353e2497646d0ab333c6560e36aac => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:43:03.478200 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9448201d-9f47-4fa7-a198-a18dbfdeca92 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:03.479769 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-9448201d-9f47-4fa7-a198-a18dbfdeca92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:03.551655 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9448201d-9f47-4fa7-a198-a18dbfdeca92 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:03.560903 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e043ae9-4ada-4369-b618-45df50dd184b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:03.560903 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e043ae9-4ada-4369-b618-45df50dd184b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:03.560903 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e043ae9-4ada-4369-b618-45df50dd184b admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:03.560903 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e043ae9-4ada-4369-b618-45df50dd184b admin admin] PATH_INFO: `/v3/users/7002a025f8c6465194726fe5ed309494` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:03.562167 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e043ae9-4ada-4369-b618-45df50dd184b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7002a025f8c6465194726fe5ed309494)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:03.563441 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e043ae9-4ada-4369-b618-45df50dd184b admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:03.854955 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 998/2008] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:43:03 2022] POST /identity/v3/users => generated 287 bytes in 510 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:43:03.856704 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d716bd7-92e9-4c1f-bfa9-44b8965cbb78 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:03.858517 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-6d716bd7-92e9-4c1f-bfa9-44b8965cbb78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:03.872333 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d716bd7-92e9-4c1f-bfa9-44b8965cbb78 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:03.877358 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29c9fb-411d-461e-b895-8af65fd2178d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:03.878272 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29c9fb-411d-461e-b895-8af65fd2178d admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:03.878561 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29c9fb-411d-461e-b895-8af65fd2178d admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:03.878837 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf29c9fb-411d-461e-b895-8af65fd2178d admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:03.879562 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf29c9fb-411d-461e-b895-8af65fd2178d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:03.881196 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf29c9fb-411d-461e-b895-8af65fd2178d admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:03.898765 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 999/2009] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:43:03 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:43:03.904547 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29c9fb-411d-461e-b895-8af65fd2178d admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:03.917589 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf29c9fb-411d-461e-b895-8af65fd2178d admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:03.923463 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e1851d-8a84-40ad-b7ca-521c7f559389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:03.924381 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e1851d-8a84-40ad-b7ca-521c7f559389 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:03.924723 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e1851d-8a84-40ad-b7ca-521c7f559389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:03.925102 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e1851d-8a84-40ad-b7ca-521c7f559389 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:03.925862 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e1851d-8a84-40ad-b7ca-521c7f559389 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:03.927443 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e1851d-8a84-40ad-b7ca-521c7f559389 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:03.941441 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1000/2010] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:43:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:43:03.987723 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e1851d-8a84-40ad-b7ca-521c7f559389 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:03.999025 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e1851d-8a84-40ad-b7ca-521c7f559389 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:04.008934 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a18883-792c-451b-a543-288475b414c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:04.008934 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a18883-792c-451b-a543-288475b414c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:04.008934 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a18883-792c-451b-a543-288475b414c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:04.008934 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a18883-792c-451b-a543-288475b414c1 admin admin] PATH_INFO: `/v3/projects/b472b9d596244d00b9beda2a4b39b524/users/55807e815fd9401b8f3d392c26e4cb49/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:04.022510 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a18883-792c-451b-a543-288475b414c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b472b9d596244d00b9beda2a4b39b524, user_id=55807e815fd9401b8f3d392c26e4cb49, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:04.025318 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a18883-792c-451b-a543-288475b414c1 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:04.182993 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-5e043ae9-4ada-4369-b618-45df50dd184b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7002a025f8c6465194726fe5ed309494'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:04.274138 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-5e043ae9-4ada-4369-b618-45df50dd184b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7002a025f8c6465194726fe5ed309494'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:04.275028 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-5e043ae9-4ada-4369-b618-45df50dd184b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7002a025f8c6465194726fe5ed309494'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:04.284389 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1001/2011] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:43:03 2022] PUT /identity/v3/projects/b472b9d596244d00b9beda2a4b39b524/users/55807e815fd9401b8f3d392c26e4cb49/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:43:04.290997 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-5e043ae9-4ada-4369-b618-45df50dd184b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7002a025f8c6465194726fe5ed309494'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:04.298751 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-5e043ae9-4ada-4369-b618-45df50dd184b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7002a025f8c6465194726fe5ed309494'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:04.302363 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472006f6-79b0-472b-8847-d113f0775652 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:04.303121 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472006f6-79b0-472b-8847-d113f0775652 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:04.303568 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472006f6-79b0-472b-8847-d113f0775652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:04.305458 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1011/2012] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:43:03 2022] DELETE /identity/v3/users/7002a025f8c6465194726fe5ed309494 => generated 0 bytes in 828 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:43:04.332444 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-472006f6-79b0-472b-8847-d113f0775652 None None] MFA Rules not processed for user `55807e815fd9401b8f3d392c26e4cb49`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:43:04.333835 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-472006f6-79b0-472b-8847-d113f0775652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:04.384268 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:04.421775 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1002/2013] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:43:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:43:04.718147 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e043ae9-4ada-4369-b618-45df50dd184b admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:04.720107 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-5e043ae9-4ada-4369-b618-45df50dd184b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:04.758435 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472006f6-79b0-472b-8847-d113f0775652 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:04.760200 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-472006f6-79b0-472b-8847-d113f0775652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:04.782244 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e043ae9-4ada-4369-b618-45df50dd184b admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:04.786156 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f714d2d7-09fb-4739-8132-54696fbf0d2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:04.786826 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714d2d7-09fb-4739-8132-54696fbf0d2a service cinder] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:04.787113 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714d2d7-09fb-4739-8132-54696fbf0d2a service cinder] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:04.787393 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714d2d7-09fb-4739-8132-54696fbf0d2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:04.796648 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f714d2d7-09fb-4739-8132-54696fbf0d2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:04.798148 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f714d2d7-09fb-4739-8132-54696fbf0d2a service cinder] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:04.827090 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1012/2014] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:43:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:43:04.842899 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f714d2d7-09fb-4739-8132-54696fbf0d2a service cinder] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:04.844336 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-f714d2d7-09fb-4739-8132-54696fbf0d2a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:04.859509 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472006f6-79b0-472b-8847-d113f0775652 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:04.866407 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58efb5e5-3922-435e-92c1-cd3735715b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:04.867499 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efb5e5-3922-435e-92c1-cd3735715b0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:04.867972 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efb5e5-3922-435e-92c1-cd3735715b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:04.868414 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efb5e5-3922-435e-92c1-cd3735715b0b admin admin] PATH_INFO: `/v3/users/de720e68afa8486ba99ddd57338d175d` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:04.870039 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58efb5e5-3922-435e-92c1-cd3735715b0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=de720e68afa8486ba99ddd57338d175d)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:04.873663 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58efb5e5-3922-435e-92c1-cd3735715b0b admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:04.880138 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f714d2d7-09fb-4739-8132-54696fbf0d2a service cinder] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:04.907760 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457020d1-067b-43ef-929f-4051ea8894d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:04.909082 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457020d1-067b-43ef-929f-4051ea8894d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:04.909527 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457020d1-067b-43ef-929f-4051ea8894d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:04.910264 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457020d1-067b-43ef-929f-4051ea8894d5 admin admin] PATH_INFO: `/v3/projects/1b441ac569a142b2ac632c3215e28fbc` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:04.920472 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457020d1-067b-43ef-929f-4051ea8894d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b441ac569a142b2ac632c3215e28fbc)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:04.932378 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457020d1-067b-43ef-929f-4051ea8894d5 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:05.176855 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-58efb5e5-3922-435e-92c1-cd3735715b0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de720e68afa8486ba99ddd57338d175d'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:05.178827 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-457020d1-067b-43ef-929f-4051ea8894d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b441ac569a142b2ac632c3215e28fbc', 'request_id': 'req-457020d1-067b-43ef-929f-4051ea8894d5'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:05.185955 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-457020d1-067b-43ef-929f-4051ea8894d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b441ac569a142b2ac632c3215e28fbc', 'request_id': 'req-457020d1-067b-43ef-929f-4051ea8894d5'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:05.192466 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-457020d1-067b-43ef-929f-4051ea8894d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b441ac569a142b2ac632c3215e28fbc', 'request_id': 'req-457020d1-067b-43ef-929f-4051ea8894d5'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:05.267523 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-58efb5e5-3922-435e-92c1-cd3735715b0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de720e68afa8486ba99ddd57338d175d'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:05.268262 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-58efb5e5-3922-435e-92c1-cd3735715b0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de720e68afa8486ba99ddd57338d175d'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:05.284280 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-58efb5e5-3922-435e-92c1-cd3735715b0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de720e68afa8486ba99ddd57338d175d'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:05.291059 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-58efb5e5-3922-435e-92c1-cd3735715b0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de720e68afa8486ba99ddd57338d175d'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:05.298651 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1003/2015] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:43:04 2022] DELETE /identity/v3/users/de720e68afa8486ba99ddd57338d175d => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:43:05.299674 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58efb5e5-3922-435e-92c1-cd3735715b0b admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:05.301117 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-58efb5e5-3922-435e-92c1-cd3735715b0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:05.314640 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-457020d1-067b-43ef-929f-4051ea8894d5 admin admin] The token cache is being invalidate because project 1b441ac569a142b2ac632c3215e28fbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80392) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:43:05.315429 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-457020d1-067b-43ef-929f-4051ea8894d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:05.316417 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-457020d1-067b-43ef-929f-4051ea8894d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:05.319514 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1013/2016] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:43:04 2022] DELETE /identity/v3/projects/1b441ac569a142b2ac632c3215e28fbc => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:43:05.320093 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:05.321829 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26acba72-ff46-4505-9e9c-8a550476f0d2 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:05.328706 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26acba72-ff46-4505-9e9c-8a550476f0d2 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:05.328706 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26acba72-ff46-4505-9e9c-8a550476f0d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:05.346533 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-26acba72-ff46-4505-9e9c-8a550476f0d2 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:43:05.353546 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-26acba72-ff46-4505-9e9c-8a550476f0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:05.375550 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58efb5e5-3922-435e-92c1-cd3735715b0b admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:05.380397 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdda255-ba9a-4e44-98d2-adfa612633ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:05.381312 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdda255-ba9a-4e44-98d2-adfa612633ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:05.381598 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdda255-ba9a-4e44-98d2-adfa612633ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:05.381868 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdda255-ba9a-4e44-98d2-adfa612633ba admin admin] PATH_INFO: `/v3/users/55807e815fd9401b8f3d392c26e4cb49` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:05.383079 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdda255-ba9a-4e44-98d2-adfa612633ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=55807e815fd9401b8f3d392c26e4cb49)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:05.385142 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdda255-ba9a-4e44-98d2-adfa612633ba admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:05.415413 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1014/2017] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:43:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:43:05.416724 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162e195-b557-41f4-a7ee-51b18b679125 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:05.417018 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162e195-b557-41f4-a7ee-51b18b679125 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:05.417325 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162e195-b557-41f4-a7ee-51b18b679125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:05.436638 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-7162e195-b557-41f4-a7ee-51b18b679125 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:43:05.437876 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-7162e195-b557-41f4-a7ee-51b18b679125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:05.446059 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1015/2018] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:43:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:43:05.446889 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7162e195-b557-41f4-a7ee-51b18b679125 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:05.448140 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-7162e195-b557-41f4-a7ee-51b18b679125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:05.504307 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7162e195-b557-41f4-a7ee-51b18b679125 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:05.508091 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a539d505-df14-45f7-9a27-2d289f64acfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:05.508743 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539d505-df14-45f7-9a27-2d289f64acfb service neutron] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:05.509025 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539d505-df14-45f7-9a27-2d289f64acfb service neutron] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:05.509328 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a539d505-df14-45f7-9a27-2d289f64acfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:05.519714 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a539d505-df14-45f7-9a27-2d289f64acfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:05.523221 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a539d505-df14-45f7-9a27-2d289f64acfb service neutron] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:05.531518 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1016/2019] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:43:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:43:05.532863 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994c387-32b8-48c7-80bc-05a84dd77830 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:05.533185 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994c387-32b8-48c7-80bc-05a84dd77830 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:05.533467 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994c387-32b8-48c7-80bc-05a84dd77830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:05.551961 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-5994c387-32b8-48c7-80bc-05a84dd77830 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:43:05.553485 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-5994c387-32b8-48c7-80bc-05a84dd77830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:05.562303 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1017/2020] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:43:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:43:05.566646 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5994c387-32b8-48c7-80bc-05a84dd77830 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:05.575918 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5994c387-32b8-48c7-80bc-05a84dd77830 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:05.580684 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9295531d-fbee-4b49-816e-9b9eac148e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:05.581610 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295531d-fbee-4b49-816e-9b9eac148e67 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:05.581892 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295531d-fbee-4b49-816e-9b9eac148e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:05.582166 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295531d-fbee-4b49-816e-9b9eac148e67 admin admin] PATH_INFO: `/v3/domains` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:05.583079 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9295531d-fbee-4b49-816e-9b9eac148e67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:43:05.583385 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9295531d-fbee-4b49-816e-9b9eac148e67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:05.585127 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9295531d-fbee-4b49-816e-9b9eac148e67 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:05.601734 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1018/2021] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 10:43:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:43:05.603856 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9295531d-fbee-4b49-816e-9b9eac148e67 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:05.614768 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9295531d-fbee-4b49-816e-9b9eac148e67 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:05.619645 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85b2a89-cbaf-4889-ba5a-0e27612537ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:05.620306 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b2a89-cbaf-4889-ba5a-0e27612537ee admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:05.620591 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b2a89-cbaf-4889-ba5a-0e27612537ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:05.620873 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b2a89-cbaf-4889-ba5a-0e27612537ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:05.622218 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85b2a89-cbaf-4889-ba5a-0e27612537ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:05.624544 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85b2a89-cbaf-4889-ba5a-0e27612537ee admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:05.640057 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-4bdda255-ba9a-4e44-98d2-adfa612633ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55807e815fd9401b8f3d392c26e4cb49'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:05.742323 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-4bdda255-ba9a-4e44-98d2-adfa612633ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55807e815fd9401b8f3d392c26e4cb49'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:05.743055 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-4bdda255-ba9a-4e44-98d2-adfa612633ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55807e815fd9401b8f3d392c26e4cb49'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:05.754488 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1019/2022] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:43:05 2022] POST /identity/v3/projects => generated 383 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:43:05.755758 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85b2a89-cbaf-4889-ba5a-0e27612537ee admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:05.757545 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-f85b2a89-cbaf-4889-ba5a-0e27612537ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:05.758248 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-4bdda255-ba9a-4e44-98d2-adfa612633ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55807e815fd9401b8f3d392c26e4cb49'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:05.766905 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-4bdda255-ba9a-4e44-98d2-adfa612633ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55807e815fd9401b8f3d392c26e4cb49'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:05.774340 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1004/2023] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:43:05 2022] DELETE /identity/v3/users/55807e815fd9401b8f3d392c26e4cb49 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:43:05.779220 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a099d-5353-4d8e-b411-998ab31a7600 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:05.779917 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a099d-5353-4d8e-b411-998ab31a7600 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:05.780387 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a099d-5353-4d8e-b411-998ab31a7600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:05.806305 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-a85a099d-5353-4d8e-b411-998ab31a7600 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:43:05.808254 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-a85a099d-5353-4d8e-b411-998ab31a7600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:05.840190 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85b2a89-cbaf-4889-ba5a-0e27612537ee admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:05.909378 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1005/2024] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:43:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:43:05.922113 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a099d-5353-4d8e-b411-998ab31a7600 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:05.924617 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-a85a099d-5353-4d8e-b411-998ab31a7600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:05.926221 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a24962-f6db-456e-9739-34f5082f9e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:05.926913 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a24962-f6db-456e-9739-34f5082f9e5b admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:05.927193 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a24962-f6db-456e-9739-34f5082f9e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:05.927742 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a24962-f6db-456e-9739-34f5082f9e5b admin admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:05.928956 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a24962-f6db-456e-9739-34f5082f9e5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:05.938074 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a24962-f6db-456e-9739-34f5082f9e5b admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:05.985928 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a099d-5353-4d8e-b411-998ab31a7600 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:05.989565 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5018bae-8273-443f-8c30-1dac30b44994 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:05.990211 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5018bae-8273-443f-8c30-1dac30b44994 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:05.990490 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5018bae-8273-443f-8c30-1dac30b44994 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:05.990761 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5018bae-8273-443f-8c30-1dac30b44994 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:06.000868 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5018bae-8273-443f-8c30-1dac30b44994 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:06.002480 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5018bae-8273-443f-8c30-1dac30b44994 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:06.012357 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1006/2025] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:43:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:43:06.032006 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5018bae-8273-443f-8c30-1dac30b44994 service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:06.033371 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-a5018bae-8273-443f-8c30-1dac30b44994 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:06.039073 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1020/2026] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:43:05 2022] POST /identity/v3/users => generated 292 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:43:06.043079 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a24962-f6db-456e-9739-34f5082f9e5b admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:06.048787 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5018bae-8273-443f-8c30-1dac30b44994 service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:06.059576 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a24962-f6db-456e-9739-34f5082f9e5b admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:06.061939 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13d62e-9eb3-4573-936c-965d1d9b534c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:06.062756 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13d62e-9eb3-4573-936c-965d1d9b534c admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:06.063105 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13d62e-9eb3-4573-936c-965d1d9b534c admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:06.063483 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13d62e-9eb3-4573-936c-965d1d9b534c admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:06.064385 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c13d62e-9eb3-4573-936c-965d1d9b534c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:06.064911 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca821c65-e582-442d-b82c-d3e7b5465745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:06.066084 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca821c65-e582-442d-b82c-d3e7b5465745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:06.066406 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca821c65-e582-442d-b82c-d3e7b5465745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:06.066489 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c13d62e-9eb3-4573-936c-965d1d9b534c admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:06.066812 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca821c65-e582-442d-b82c-d3e7b5465745 admin admin] PATH_INFO: `/v3/projects/ce34a4bb65fb415aa5af22f7c2ef9f4a` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:06.068129 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca821c65-e582-442d-b82c-d3e7b5465745 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce34a4bb65fb415aa5af22f7c2ef9f4a)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:06.070254 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca821c65-e582-442d-b82c-d3e7b5465745 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:06.085562 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1021/2027] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:43:06 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:43:06.087915 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13d62e-9eb3-4573-936c-965d1d9b534c admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:06.111746 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13d62e-9eb3-4573-936c-965d1d9b534c admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:06.116921 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9222dd-576b-41ea-bad8-c13cf22a5d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:06.117617 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9222dd-576b-41ea-bad8-c13cf22a5d30 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:06.117901 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9222dd-576b-41ea-bad8-c13cf22a5d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:06.118446 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9222dd-576b-41ea-bad8-c13cf22a5d30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:06.119331 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9222dd-576b-41ea-bad8-c13cf22a5d30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:06.120926 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9222dd-576b-41ea-bad8-c13cf22a5d30 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:06.132701 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1022/2028] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:43:06 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:43:06.136985 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9222dd-576b-41ea-bad8-c13cf22a5d30 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:06.147671 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9222dd-576b-41ea-bad8-c13cf22a5d30 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:06.152960 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac505407-6754-4e48-937c-a21600dad9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:06.153890 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac505407-6754-4e48-937c-a21600dad9d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:06.154173 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac505407-6754-4e48-937c-a21600dad9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:06.154445 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac505407-6754-4e48-937c-a21600dad9d4 admin admin] PATH_INFO: `/v3/projects/96866b11c270423ebc7854aa0dd582fa/users/6cfa3b8e49564b3d9dcdfd5ee0684977/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:06.170287 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac505407-6754-4e48-937c-a21600dad9d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96866b11c270423ebc7854aa0dd582fa, user_id=6cfa3b8e49564b3d9dcdfd5ee0684977, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:06.173006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac505407-6754-4e48-937c-a21600dad9d4 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:06.261939 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1023/2029] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:43:06 2022] PUT /identity/v3/projects/96866b11c270423ebc7854aa0dd582fa/users/6cfa3b8e49564b3d9dcdfd5ee0684977/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:43:06.264873 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612e629-c5b3-4351-8e3b-e57c43c6dcf0 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:06.265151 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612e629-c5b3-4351-8e3b-e57c43c6dcf0 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:06.265957 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612e629-c5b3-4351-8e3b-e57c43c6dcf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:06.288862 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-ca821c65-e582-442d-b82c-d3e7b5465745 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce34a4bb65fb415aa5af22f7c2ef9f4a', 'request_id': 'req-ca821c65-e582-442d-b82c-d3e7b5465745'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:06.297298 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-ca821c65-e582-442d-b82c-d3e7b5465745 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce34a4bb65fb415aa5af22f7c2ef9f4a', 'request_id': 'req-ca821c65-e582-442d-b82c-d3e7b5465745'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:06.310649 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-6612e629-c5b3-4351-8e3b-e57c43c6dcf0 None None] MFA Rules not processed for user `6cfa3b8e49564b3d9dcdfd5ee0684977`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:43:06.312087 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-6612e629-c5b3-4351-8e3b-e57c43c6dcf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:06.312635 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-ca821c65-e582-442d-b82c-d3e7b5465745 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce34a4bb65fb415aa5af22f7c2ef9f4a', 'request_id': 'req-ca821c65-e582-442d-b82c-d3e7b5465745'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:06.399494 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-ca821c65-e582-442d-b82c-d3e7b5465745 admin admin] The token cache is being invalidate because project ce34a4bb65fb415aa5af22f7c2ef9f4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:43:06.399801 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-ca821c65-e582-442d-b82c-d3e7b5465745 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:06.401269 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-ca821c65-e582-442d-b82c-d3e7b5465745 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:06.404560 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1007/2030] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:43:06 2022] DELETE /identity/v3/projects/ce34a4bb65fb415aa5af22f7c2ef9f4a => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:43:06.410901 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca821c65-e582-442d-b82c-d3e7b5465745 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:06.426157 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1024/2031] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:43:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:43:06.426268 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-ca821c65-e582-442d-b82c-d3e7b5465745 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:06.434790 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6612e629-c5b3-4351-8e3b-e57c43c6dcf0 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:06.436876 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-6612e629-c5b3-4351-8e3b-e57c43c6dcf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:06.440138 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:06.527864 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6612e629-c5b3-4351-8e3b-e57c43c6dcf0 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:06.529523 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca821c65-e582-442d-b82c-d3e7b5465745 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:06.532990 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1136ba-cc39-490b-ba6f-f01ab5151262 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:06.533707 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1136ba-cc39-490b-ba6f-f01ab5151262 service cinder] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:06.533997 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1136ba-cc39-490b-ba6f-f01ab5151262 service cinder] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:06.534176 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b416c0-6135-44d3-84d5-d9edc120c090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:06.534288 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1136ba-cc39-490b-ba6f-f01ab5151262 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:06.535214 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b416c0-6135-44d3-84d5-d9edc120c090 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:06.535661 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b416c0-6135-44d3-84d5-d9edc120c090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:06.535945 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b416c0-6135-44d3-84d5-d9edc120c090 admin admin] PATH_INFO: `/v3/users/38dc4a647bbb4c28b8d3f5a05da431d3` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:06.536178 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-0e1136ba-cc39-490b-ba6f-f01ab5151262 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:06.537407 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b416c0-6135-44d3-84d5-d9edc120c090 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38dc4a647bbb4c28b8d3f5a05da431d3)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:06.553381 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b416c0-6135-44d3-84d5-d9edc120c090 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:06.560045 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1136ba-cc39-490b-ba6f-f01ab5151262 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:06.562192 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1136ba-cc39-490b-ba6f-f01ab5151262 service cinder] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:06.577673 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1025/2032] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:43:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:43:06.602937 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1136ba-cc39-490b-ba6f-f01ab5151262 service cinder] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:06.605105 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-0e1136ba-cc39-490b-ba6f-f01ab5151262 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:06.624987 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1136ba-cc39-490b-ba6f-f01ab5151262 service cinder] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:06.629940 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ece39c-2efc-4d61-bd2e-7adf4ade8fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:06.631592 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ece39c-2efc-4d61-bd2e-7adf4ade8fef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:06.631903 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ece39c-2efc-4d61-bd2e-7adf4ade8fef admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:06.632247 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ece39c-2efc-4d61-bd2e-7adf4ade8fef admin admin] PATH_INFO: `/v3/users/6cfa3b8e49564b3d9dcdfd5ee0684977` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:06.633554 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ece39c-2efc-4d61-bd2e-7adf4ade8fef admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cfa3b8e49564b3d9dcdfd5ee0684977)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:06.635837 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ece39c-2efc-4d61-bd2e-7adf4ade8fef admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:06.807203 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-12b416c0-6135-44d3-84d5-d9edc120c090 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38dc4a647bbb4c28b8d3f5a05da431d3'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:06.919592 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-12b416c0-6135-44d3-84d5-d9edc120c090 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38dc4a647bbb4c28b8d3f5a05da431d3'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:06.920373 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-12b416c0-6135-44d3-84d5-d9edc120c090 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38dc4a647bbb4c28b8d3f5a05da431d3'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:06.933940 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-12b416c0-6135-44d3-84d5-d9edc120c090 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38dc4a647bbb4c28b8d3f5a05da431d3'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:06.941266 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-12b416c0-6135-44d3-84d5-d9edc120c090 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38dc4a647bbb4c28b8d3f5a05da431d3'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:06.947380 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1008/2033] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:43:06 2022] DELETE /identity/v3/users/38dc4a647bbb4c28b8d3f5a05da431d3 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:43:06.948199 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b416c0-6135-44d3-84d5-d9edc120c090 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:06.949573 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-12b416c0-6135-44d3-84d5-d9edc120c090 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:06.983779 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-64ece39c-2efc-4d61-bd2e-7adf4ade8fef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cfa3b8e49564b3d9dcdfd5ee0684977'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:07.032009 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b416c0-6135-44d3-84d5-d9edc120c090 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:07.038180 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e0fd1-4a9c-4e99-a1c7-6d472a8029f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:07.039116 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e0fd1-4a9c-4e99-a1c7-6d472a8029f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:07.039401 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e0fd1-4a9c-4e99-a1c7-6d472a8029f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:07.039676 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e0fd1-4a9c-4e99-a1c7-6d472a8029f0 admin admin] PATH_INFO: `/v3/projects/b472b9d596244d00b9beda2a4b39b524` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:07.041073 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979e0fd1-4a9c-4e99-a1c7-6d472a8029f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b472b9d596244d00b9beda2a4b39b524)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:07.043194 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979e0fd1-4a9c-4e99-a1c7-6d472a8029f0 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:07.108246 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-64ece39c-2efc-4d61-bd2e-7adf4ade8fef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cfa3b8e49564b3d9dcdfd5ee0684977'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:07.109021 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-64ece39c-2efc-4d61-bd2e-7adf4ade8fef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cfa3b8e49564b3d9dcdfd5ee0684977'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:07.123291 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-64ece39c-2efc-4d61-bd2e-7adf4ade8fef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cfa3b8e49564b3d9dcdfd5ee0684977'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:07.130967 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-64ece39c-2efc-4d61-bd2e-7adf4ade8fef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cfa3b8e49564b3d9dcdfd5ee0684977'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:07.137298 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1026/2034] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:43:06 2022] DELETE /identity/v3/users/6cfa3b8e49564b3d9dcdfd5ee0684977 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:43:07.139032 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ece39c-2efc-4d61-bd2e-7adf4ade8fef admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:07.140454 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-64ece39c-2efc-4d61-bd2e-7adf4ade8fef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:07.198973 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ece39c-2efc-4d61-bd2e-7adf4ade8fef admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:07.206129 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8145f1-8e5c-4f4c-bde9-97e3c729fb57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:07.207835 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8145f1-8e5c-4f4c-bde9-97e3c729fb57 service cinder] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:07.208525 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8145f1-8e5c-4f4c-bde9-97e3c729fb57 service cinder] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:07.209013 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8145f1-8e5c-4f4c-bde9-97e3c729fb57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:07.212880 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-4e8145f1-8e5c-4f4c-bde9-97e3c729fb57 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:07.224646 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-979e0fd1-4a9c-4e99-a1c7-6d472a8029f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b472b9d596244d00b9beda2a4b39b524', 'request_id': 'req-979e0fd1-4a9c-4e99-a1c7-6d472a8029f0'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:07.231736 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-979e0fd1-4a9c-4e99-a1c7-6d472a8029f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b472b9d596244d00b9beda2a4b39b524', 'request_id': 'req-979e0fd1-4a9c-4e99-a1c7-6d472a8029f0'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:07.239538 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-979e0fd1-4a9c-4e99-a1c7-6d472a8029f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b472b9d596244d00b9beda2a4b39b524', 'request_id': 'req-979e0fd1-4a9c-4e99-a1c7-6d472a8029f0'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:07.295419 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8145f1-8e5c-4f4c-bde9-97e3c729fb57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:07.302910 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8145f1-8e5c-4f4c-bde9-97e3c729fb57 service cinder] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:07.308571 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1027/2035] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:43:07 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:43:07.315442 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3cc39-79fa-4f20-b76c-de3d2fb8c822 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:07.315442 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3cc39-79fa-4f20-b76c-de3d2fb8c822 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:07.315625 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3cc39-79fa-4f20-b76c-de3d2fb8c822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:07.336505 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-4bd3cc39-79fa-4f20-b76c-de3d2fb8c822 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:43:07.337965 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-4bd3cc39-79fa-4f20-b76c-de3d2fb8c822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:07.349491 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-979e0fd1-4a9c-4e99-a1c7-6d472a8029f0 admin admin] The token cache is being invalidate because project b472b9d596244d00b9beda2a4b39b524 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:43:07.349789 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-979e0fd1-4a9c-4e99-a1c7-6d472a8029f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:07.350474 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-979e0fd1-4a9c-4e99-a1c7-6d472a8029f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:07.355699 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1009/2036] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:43:06 2022] DELETE /identity/v3/projects/b472b9d596244d00b9beda2a4b39b524 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:43:07.357198 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec482f-d543-4a14-8ee5-d302c2cd8aae None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:07.358978 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec482f-d543-4a14-8ee5-d302c2cd8aae None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:07.359294 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec482f-d543-4a14-8ee5-d302c2cd8aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:07.393827 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-63ec482f-d543-4a14-8ee5-d302c2cd8aae None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:43:07.421615 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-63ec482f-d543-4a14-8ee5-d302c2cd8aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:07.443885 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1028/2037] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:43:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:43:07.445536 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:07.456010 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd3cc39-79fa-4f20-b76c-de3d2fb8c822 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:07.456010 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-4bd3cc39-79fa-4f20-b76c-de3d2fb8c822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:07.474603 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1010/2038] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:43:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:43:07.483493 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfdd29d-6b51-40b3-ac15-af4326be437b None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:07.484063 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfdd29d-6b51-40b3-ac15-af4326be437b None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:07.484063 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfdd29d-6b51-40b3-ac15-af4326be437b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:07.507714 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-6bfdd29d-6b51-40b3-ac15-af4326be437b None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:43:07.509339 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-6bfdd29d-6b51-40b3-ac15-af4326be437b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:07.521385 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1011/2039] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:43:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:43:07.533390 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfdd29d-6b51-40b3-ac15-af4326be437b None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:07.546431 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfdd29d-6b51-40b3-ac15-af4326be437b None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:07.546913 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd3cc39-79fa-4f20-b76c-de3d2fb8c822 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:07.551542 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d7aea4-e243-4805-93fd-1e072be8f3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:07.552629 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d7aea4-e243-4805-93fd-1e072be8f3dc admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:07.559037 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e40c1-b491-4744-9bdb-e23549540202 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:07.559213 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d7aea4-e243-4805-93fd-1e072be8f3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:07.559213 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d7aea4-e243-4805-93fd-1e072be8f3dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:07.559387 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e40c1-b491-4744-9bdb-e23549540202 service neutron] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:07.559387 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e40c1-b491-4744-9bdb-e23549540202 service neutron] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:07.559518 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d7aea4-e243-4805-93fd-1e072be8f3dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:43:07.559598 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e40c1-b491-4744-9bdb-e23549540202 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:07.559676 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d7aea4-e243-4805-93fd-1e072be8f3dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:07.559676 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d7aea4-e243-4805-93fd-1e072be8f3dc admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:07.566007 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638e40c1-b491-4744-9bdb-e23549540202 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:07.567965 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638e40c1-b491-4744-9bdb-e23549540202 service neutron] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:07.572766 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1012/2040] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 10:43:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:43:07.577396 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d7aea4-e243-4805-93fd-1e072be8f3dc admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:07.582675 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1029/2041] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:43:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:43:07.602964 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d7aea4-e243-4805-93fd-1e072be8f3dc admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:07.613915 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecdb3d3-2fdd-4495-bb6f-641f5e2ae2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:07.613915 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecdb3d3-2fdd-4495-bb6f-641f5e2ae2b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:07.613915 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecdb3d3-2fdd-4495-bb6f-641f5e2ae2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:07.613915 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecdb3d3-2fdd-4495-bb6f-641f5e2ae2b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:07.614572 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecdb3d3-2fdd-4495-bb6f-641f5e2ae2b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:07.615957 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecdb3d3-2fdd-4495-bb6f-641f5e2ae2b5 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:07.617776 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e40c1-b491-4744-9bdb-e23549540202 service neutron] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:07.619256 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-638e40c1-b491-4744-9bdb-e23549540202 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:07.648031 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e40c1-b491-4744-9bdb-e23549540202 service neutron] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:07.659176 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6988643-2e71-4ceb-abf0-d0a3c8f6fd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:07.660264 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6988643-2e71-4ceb-abf0-d0a3c8f6fd45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:07.660633 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6988643-2e71-4ceb-abf0-d0a3c8f6fd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:07.660989 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6988643-2e71-4ceb-abf0-d0a3c8f6fd45 admin admin] PATH_INFO: `/v3/projects/05638887ba3f4506b34cb47c585fbd4c` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:07.662364 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6988643-2e71-4ceb-abf0-d0a3c8f6fd45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05638887ba3f4506b34cb47c585fbd4c)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:07.665026 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6988643-2e71-4ceb-abf0-d0a3c8f6fd45 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:07.730578 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1013/2042] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:43:07 2022] POST /identity/v3/projects => generated 377 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:43:07.734803 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecdb3d3-2fdd-4495-bb6f-641f5e2ae2b5 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:07.809067 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-d6988643-2e71-4ceb-abf0-d0a3c8f6fd45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05638887ba3f4506b34cb47c585fbd4c', 'request_id': 'req-d6988643-2e71-4ceb-abf0-d0a3c8f6fd45'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:07.825439 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecdb3d3-2fdd-4495-bb6f-641f5e2ae2b5 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:07.840175 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-d6988643-2e71-4ceb-abf0-d0a3c8f6fd45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05638887ba3f4506b34cb47c585fbd4c', 'request_id': 'req-d6988643-2e71-4ceb-abf0-d0a3c8f6fd45'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:07.840175 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-d6988643-2e71-4ceb-abf0-d0a3c8f6fd45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05638887ba3f4506b34cb47c585fbd4c', 'request_id': 'req-d6988643-2e71-4ceb-abf0-d0a3c8f6fd45'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:07.886362 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b30a5-bfa9-4067-8777-589b8b766fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:07.887064 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b30a5-bfa9-4067-8777-589b8b766fda admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:07.887344 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b30a5-bfa9-4067-8777-589b8b766fda admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:07.887641 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b30a5-bfa9-4067-8777-589b8b766fda admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:07.889207 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3b30a5-bfa9-4067-8777-589b8b766fda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:07.891524 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3b30a5-bfa9-4067-8777-589b8b766fda admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:07.962824 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-d6988643-2e71-4ceb-abf0-d0a3c8f6fd45 admin admin] The token cache is being invalidate because project 05638887ba3f4506b34cb47c585fbd4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80392) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:43:07.962824 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-d6988643-2e71-4ceb-abf0-d0a3c8f6fd45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:07.962824 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-d6988643-2e71-4ceb-abf0-d0a3c8f6fd45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:07.962824 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1030/2043] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:43:07 2022] DELETE /identity/v3/projects/05638887ba3f4506b34cb47c585fbd4c => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:43:07.967499 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f98b43-fd35-4960-a5fe-b70747220ff0 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:07.967734 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f98b43-fd35-4960-a5fe-b70747220ff0 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:07.968400 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f98b43-fd35-4960-a5fe-b70747220ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:07.989645 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-e1f98b43-fd35-4960-a5fe-b70747220ff0 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:43:07.991673 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-e1f98b43-fd35-4960-a5fe-b70747220ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:07.998011 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1014/2044] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:43:07 2022] POST /identity/v3/users => generated 289 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:43:08.003850 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b30a5-bfa9-4067-8777-589b8b766fda admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:08.007162 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-1c3b30a5-bfa9-4067-8777-589b8b766fda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:08.017640 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1031/2045] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:43:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:43:08.021657 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db81ff6-9050-4dbe-97cd-52721befd7f4 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:08.029877 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db81ff6-9050-4dbe-97cd-52721befd7f4 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:08.029877 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db81ff6-9050-4dbe-97cd-52721befd7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:08.030432 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b30a5-bfa9-4067-8777-589b8b766fda admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:08.035891 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c7850-4377-4ee8-a655-5c3c50f8593c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:08.036587 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c7850-4377-4ee8-a655-5c3c50f8593c admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:08.036867 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c7850-4377-4ee8-a655-5c3c50f8593c admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:08.037842 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c7850-4377-4ee8-a655-5c3c50f8593c admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:08.038561 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1c7850-4377-4ee8-a655-5c3c50f8593c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:08.040174 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1c7850-4377-4ee8-a655-5c3c50f8593c admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:08.047138 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-2db81ff6-9050-4dbe-97cd-52721befd7f4 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:43:08.049079 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-2db81ff6-9050-4dbe-97cd-52721befd7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:08.058663 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1032/2046] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:43:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:43:08.063223 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1015/2047] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:43:07 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:43:08.064262 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db81ff6-9050-4dbe-97cd-52721befd7f4 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:08.068193 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c7850-4377-4ee8-a655-5c3c50f8593c admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:08.077533 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db81ff6-9050-4dbe-97cd-52721befd7f4 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:08.080064 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c7850-4377-4ee8-a655-5c3c50f8593c admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:08.083805 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c1323-351f-4bbe-921d-892df94bf02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:08.084395 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c1323-351f-4bbe-921d-892df94bf02d admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:08.084754 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c1323-351f-4bbe-921d-892df94bf02d admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:08.085446 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c1323-351f-4bbe-921d-892df94bf02d admin admin] PATH_INFO: `/v3/domains` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:08.091757 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c627348b-deb0-40b4-b7b7-f5e6bda98c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:08.091971 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c1323-351f-4bbe-921d-892df94bf02d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:43:08.092198 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c1323-351f-4bbe-921d-892df94bf02d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:08.092459 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627348b-deb0-40b4-b7b7-f5e6bda98c92 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:08.092745 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627348b-deb0-40b4-b7b7-f5e6bda98c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:08.093023 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627348b-deb0-40b4-b7b7-f5e6bda98c92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:08.093791 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c627348b-deb0-40b4-b7b7-f5e6bda98c92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:08.093906 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c1323-351f-4bbe-921d-892df94bf02d admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:08.095380 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c627348b-deb0-40b4-b7b7-f5e6bda98c92 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:08.123574 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1033/2049] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 10:43:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:43:08.123813 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1016/2049] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:43:08 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 10:43:08.123897 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c1323-351f-4bbe-921d-892df94bf02d admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:08.126529 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c627348b-deb0-40b4-b7b7-f5e6bda98c92 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:08.133487 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c1323-351f-4bbe-921d-892df94bf02d admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:08.140423 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf0804-cf08-4d3b-bd6b-c3594f24f2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:08.140918 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c627348b-deb0-40b4-b7b7-f5e6bda98c92 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:08.141373 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf0804-cf08-4d3b-bd6b-c3594f24f2d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:08.141660 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf0804-cf08-4d3b-bd6b-c3594f24f2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:08.141942 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf0804-cf08-4d3b-bd6b-c3594f24f2d3 admin admin] PATH_INFO: `/v3/projects/5a6d3f9a33704c3d9be72ef70cbc017e/users/c30c52a613474262b0081e4850bb8e9f/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:08.147889 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5203abf-9b01-4f91-b99a-19e7084362a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:08.148571 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5203abf-9b01-4f91-b99a-19e7084362a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:08.149222 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5203abf-9b01-4f91-b99a-19e7084362a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:08.149510 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5203abf-9b01-4f91-b99a-19e7084362a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:08.150215 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5203abf-9b01-4f91-b99a-19e7084362a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:08.152204 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5203abf-9b01-4f91-b99a-19e7084362a4 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:08.160253 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bf0804-cf08-4d3b-bd6b-c3594f24f2d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a6d3f9a33704c3d9be72ef70cbc017e, user_id=c30c52a613474262b0081e4850bb8e9f, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:08.164216 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bf0804-cf08-4d3b-bd6b-c3594f24f2d3 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:08.270121 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1034/2050] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:43:08 2022] PUT /identity/v3/projects/5a6d3f9a33704c3d9be72ef70cbc017e/users/c30c52a613474262b0081e4850bb8e9f/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:43:08.273588 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c22812f-72c9-44d3-9ef5-99fcbe6d63ea None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:08.274454 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c22812f-72c9-44d3-9ef5-99fcbe6d63ea None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:08.274949 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c22812f-72c9-44d3-9ef5-99fcbe6d63ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:08.297770 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1017/2051] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:43:08 2022] POST /identity/v3/projects => generated 385 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:43:08.298629 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5203abf-9b01-4f91-b99a-19e7084362a4 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:08.346438 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-0c22812f-72c9-44d3-9ef5-99fcbe6d63ea None None] MFA Rules not processed for user `c30c52a613474262b0081e4850bb8e9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:43:08.346438 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-0c22812f-72c9-44d3-9ef5-99fcbe6d63ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:08.389981 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5203abf-9b01-4f91-b99a-19e7084362a4 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:08.396248 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871bc8ff-9123-4b9f-8a38-b4e003cdf885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:08.396939 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871bc8ff-9123-4b9f-8a38-b4e003cdf885 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:08.397256 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871bc8ff-9123-4b9f-8a38-b4e003cdf885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:08.397577 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871bc8ff-9123-4b9f-8a38-b4e003cdf885 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:08.398335 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871bc8ff-9123-4b9f-8a38-b4e003cdf885 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:08.400424 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871bc8ff-9123-4b9f-8a38-b4e003cdf885 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:08.427983 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1035/2052] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:43:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:43:08.439887 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c22812f-72c9-44d3-9ef5-99fcbe6d63ea None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:08.441313 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-0c22812f-72c9-44d3-9ef5-99fcbe6d63ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:08.541442 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c22812f-72c9-44d3-9ef5-99fcbe6d63ea None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:08.546285 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08481de3-bc7a-4efe-a148-ea59de269a09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:08.547039 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08481de3-bc7a-4efe-a148-ea59de269a09 service cinder] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:08.547335 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08481de3-bc7a-4efe-a148-ea59de269a09 service cinder] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:08.547615 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08481de3-bc7a-4efe-a148-ea59de269a09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:08.562944 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08481de3-bc7a-4efe-a148-ea59de269a09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:08.564706 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08481de3-bc7a-4efe-a148-ea59de269a09 service cinder] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:08.569470 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1018/2053] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:43:08 2022] POST /identity/v3/users => generated 293 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:43:08.570676 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871bc8ff-9123-4b9f-8a38-b4e003cdf885 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:08.572758 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-871bc8ff-9123-4b9f-8a38-b4e003cdf885 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:08.583737 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1036/2054] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:43:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:43:08.584922 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08481de3-bc7a-4efe-a148-ea59de269a09 service cinder] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:08.587442 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871bc8ff-9123-4b9f-8a38-b4e003cdf885 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:08.593277 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e5e42-a381-4c09-82a8-42c840c8761c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:08.594403 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e5e42-a381-4c09-82a8-42c840c8761c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:08.594744 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e5e42-a381-4c09-82a8-42c840c8761c admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:08.598421 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e5e42-a381-4c09-82a8-42c840c8761c admin admin] PATH_INFO: `/v3/projects/96866b11c270423ebc7854aa0dd582fa` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:08.598421 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137e5e42-a381-4c09-82a8-42c840c8761c admin admin] RBAC: Authorizing `identity:delete_project(project_id=96866b11c270423ebc7854aa0dd582fa)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:08.598421 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137e5e42-a381-4c09-82a8-42c840c8761c admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:08.600990 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08481de3-bc7a-4efe-a148-ea59de269a09 service cinder] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:08.606729 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729dcfed-89ff-4121-a4ae-220451bdd228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:08.607184 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729dcfed-89ff-4121-a4ae-220451bdd228 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:08.607475 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729dcfed-89ff-4121-a4ae-220451bdd228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:08.607767 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729dcfed-89ff-4121-a4ae-220451bdd228 admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:08.608976 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729dcfed-89ff-4121-a4ae-220451bdd228 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:08.610262 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729dcfed-89ff-4121-a4ae-220451bdd228 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:08.624381 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1037/2055] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:43:08 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:43:08.628977 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729dcfed-89ff-4121-a4ae-220451bdd228 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:08.641196 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729dcfed-89ff-4121-a4ae-220451bdd228 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:08.645964 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:08.647886 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e077a0-47cd-4f40-b74d-82ca1df1f83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:08.648796 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e077a0-47cd-4f40-b74d-82ca1df1f83b admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:08.649330 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e077a0-47cd-4f40-b74d-82ca1df1f83b admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:08.649594 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e077a0-47cd-4f40-b74d-82ca1df1f83b admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:08.650639 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e077a0-47cd-4f40-b74d-82ca1df1f83b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:08.652895 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e077a0-47cd-4f40-b74d-82ca1df1f83b admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:08.667820 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1038/2056] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:43:08 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:43:08.668791 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e077a0-47cd-4f40-b74d-82ca1df1f83b admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:08.680411 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e077a0-47cd-4f40-b74d-82ca1df1f83b admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:08.690324 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0609839-63ab-4faa-918b-ce5653baa86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:08.691691 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0609839-63ab-4faa-918b-ce5653baa86d admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:08.691691 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0609839-63ab-4faa-918b-ce5653baa86d admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:08.691915 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0609839-63ab-4faa-918b-ce5653baa86d admin admin] PATH_INFO: `/v3/projects/91cbca3cad9e48ac9ed302f603b48cb3/users/4e41129839094219808d9aa189ef977c/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:08.720265 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0609839-63ab-4faa-918b-ce5653baa86d admin admin] RBAC: Authorizing `identity:create_grant(project_id=91cbca3cad9e48ac9ed302f603b48cb3, user_id=4e41129839094219808d9aa189ef977c, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:08.724411 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0609839-63ab-4faa-918b-ce5653baa86d admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:08.737877 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-137e5e42-a381-4c09-82a8-42c840c8761c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96866b11c270423ebc7854aa0dd582fa', 'request_id': 'req-137e5e42-a381-4c09-82a8-42c840c8761c'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:08.758361 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-137e5e42-a381-4c09-82a8-42c840c8761c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96866b11c270423ebc7854aa0dd582fa', 'request_id': 'req-137e5e42-a381-4c09-82a8-42c840c8761c'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:08.785628 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-137e5e42-a381-4c09-82a8-42c840c8761c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96866b11c270423ebc7854aa0dd582fa', 'request_id': 'req-137e5e42-a381-4c09-82a8-42c840c8761c'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:08.842550 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1039/2057] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:43:08 2022] PUT /identity/v3/projects/91cbca3cad9e48ac9ed302f603b48cb3/users/4e41129839094219808d9aa189ef977c/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:43:08.854612 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f29c3-9c45-4eed-996a-0fdd8b9da6ba None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:08.854903 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f29c3-9c45-4eed-996a-0fdd8b9da6ba None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:08.855187 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f29c3-9c45-4eed-996a-0fdd8b9da6ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:08.886894 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-fe9f29c3-9c45-4eed-996a-0fdd8b9da6ba None None] MFA Rules not processed for user `4e41129839094219808d9aa189ef977c`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:43:08.889568 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-fe9f29c3-9c45-4eed-996a-0fdd8b9da6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:08.893141 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-137e5e42-a381-4c09-82a8-42c840c8761c admin admin] The token cache is being invalidate because project 96866b11c270423ebc7854aa0dd582fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:43:08.893459 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-137e5e42-a381-4c09-82a8-42c840c8761c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:08.894217 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-137e5e42-a381-4c09-82a8-42c840c8761c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:08.896618 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1019/2058] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:43:08 2022] DELETE /identity/v3/projects/96866b11c270423ebc7854aa0dd582fa => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:43:08.902375 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7e3c5-b964-4903-b30b-745ac7a15cf1 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:08.905398 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7e3c5-b964-4903-b30b-745ac7a15cf1 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:08.905398 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7e3c5-b964-4903-b30b-745ac7a15cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:08.927742 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-c9b7e3c5-b964-4903-b30b-745ac7a15cf1 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:43:08.929068 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c9b7e3c5-b964-4903-b30b-745ac7a15cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:09.003154 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1040/2059] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:43:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:43:09.019466 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f29c3-9c45-4eed-996a-0fdd8b9da6ba None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:09.021699 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-fe9f29c3-9c45-4eed-996a-0fdd8b9da6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:09.061431 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1020/2060] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:43:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:43:09.063872 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b5555-c34a-4eaf-9e30-de44bcbdd08c None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:09.064167 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b5555-c34a-4eaf-9e30-de44bcbdd08c None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:09.064449 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b5555-c34a-4eaf-9e30-de44bcbdd08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:09.088197 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-5f9b5555-c34a-4eaf-9e30-de44bcbdd08c None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:43:09.089539 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-5f9b5555-c34a-4eaf-9e30-de44bcbdd08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:09.105782 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1021/2061] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:43:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:43:09.110607 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f29c3-9c45-4eed-996a-0fdd8b9da6ba None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:09.114269 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b5555-c34a-4eaf-9e30-de44bcbdd08c None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:09.132634 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c89700-8576-458b-9962-9c0e3ebef426 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:09.133677 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c89700-8576-458b-9962-9c0e3ebef426 service cinder] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:09.134184 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c89700-8576-458b-9962-9c0e3ebef426 service cinder] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:09.134486 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c89700-8576-458b-9962-9c0e3ebef426 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:09.136495 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b5555-c34a-4eaf-9e30-de44bcbdd08c None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:09.143911 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48243c7-5036-4730-9e04-b6b359d5e48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:09.144826 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48243c7-5036-4730-9e04-b6b359d5e48c admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:09.145346 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48243c7-5036-4730-9e04-b6b359d5e48c admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:09.145859 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48243c7-5036-4730-9e04-b6b359d5e48c admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:09.146429 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48243c7-5036-4730-9e04-b6b359d5e48c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:43:09.146742 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48243c7-5036-4730-9e04-b6b359d5e48c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:09.147057 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c89700-8576-458b-9962-9c0e3ebef426 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:09.148871 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48243c7-5036-4730-9e04-b6b359d5e48c admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:09.149688 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c89700-8576-458b-9962-9c0e3ebef426 service cinder] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:09.167286 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1041/2062] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:43:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:43:09.184025 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c89700-8576-458b-9962-9c0e3ebef426 service cinder] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:09.185612 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1022/2063] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 10:43:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:43:09.214991 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c89700-8576-458b-9962-9c0e3ebef426 service cinder] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:09.224995 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff8892d-68c3-4351-b860-5e259e43ab3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:09.225705 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff8892d-68c3-4351-b860-5e259e43ab3a admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:09.225991 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff8892d-68c3-4351-b860-5e259e43ab3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:09.226270 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff8892d-68c3-4351-b860-5e259e43ab3a admin admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:09.226974 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff8892d-68c3-4351-b860-5e259e43ab3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:09.228930 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff8892d-68c3-4351-b860-5e259e43ab3a admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:09.265994 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:09.343015 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1042/2064] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:43:09 2022] POST /identity/v3/projects => generated 373 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:43:09.344174 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48243c7-5036-4730-9e04-b6b359d5e48c admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:09.354381 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48243c7-5036-4730-9e04-b6b359d5e48c admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:09.426507 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f4bdb3-2ee3-4c2c-a561-3057b827e85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:09.427462 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f4bdb3-2ee3-4c2c-a561-3057b827e85f admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:09.427749 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f4bdb3-2ee3-4c2c-a561-3057b827e85f admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:09.428597 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f4bdb3-2ee3-4c2c-a561-3057b827e85f admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:09.429961 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f4bdb3-2ee3-4c2c-a561-3057b827e85f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:09.432188 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f4bdb3-2ee3-4c2c-a561-3057b827e85f admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:09.530859 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1023/2065] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:43:09 2022] POST /identity/v3/users => generated 287 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:43:09.531280 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff8892d-68c3-4351-b860-5e259e43ab3a admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:09.545816 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff8892d-68c3-4351-b860-5e259e43ab3a admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:09.568734 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16451162-35e1-43b2-9cc3-7d34ce98f15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:09.568734 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16451162-35e1-43b2-9cc3-7d34ce98f15b admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:09.568734 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16451162-35e1-43b2-9cc3-7d34ce98f15b admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:09.568734 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16451162-35e1-43b2-9cc3-7d34ce98f15b admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:09.569081 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16451162-35e1-43b2-9cc3-7d34ce98f15b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:09.569081 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16451162-35e1-43b2-9cc3-7d34ce98f15b admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:09.572232 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1043/2066] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:43:09 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:43:09.573363 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f4bdb3-2ee3-4c2c-a561-3057b827e85f admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:09.588011 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f4bdb3-2ee3-4c2c-a561-3057b827e85f admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:09.594789 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de17a8b-9d21-49c6-8068-53b360d40af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:09.595792 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de17a8b-9d21-49c6-8068-53b360d40af7 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:09.596082 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de17a8b-9d21-49c6-8068-53b360d40af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:09.596366 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de17a8b-9d21-49c6-8068-53b360d40af7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:09.597240 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de17a8b-9d21-49c6-8068-53b360d40af7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:09.598930 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de17a8b-9d21-49c6-8068-53b360d40af7 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:09.614053 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1024/2067] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:43:09 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 10:43:09.617983 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16451162-35e1-43b2-9cc3-7d34ce98f15b admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:09.643610 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16451162-35e1-43b2-9cc3-7d34ce98f15b admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:09.652131 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84bf3f4-e2e1-40dd-9f80-f67b7f84abd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:09.653225 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84bf3f4-e2e1-40dd-9f80-f67b7f84abd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:09.654372 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84bf3f4-e2e1-40dd-9f80-f67b7f84abd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:09.655039 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84bf3f4-e2e1-40dd-9f80-f67b7f84abd1 admin admin] PATH_INFO: `/v3/projects/a5483c830b8948d7bd8dd30b6cab33a4/users/bc36fc3c48114667aaa8614c158115a9/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:09.673070 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84bf3f4-e2e1-40dd-9f80-f67b7f84abd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5483c830b8948d7bd8dd30b6cab33a4, user_id=bc36fc3c48114667aaa8614c158115a9, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:09.676124 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84bf3f4-e2e1-40dd-9f80-f67b7f84abd1 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:09.801398 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1044/2068] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:43:09 2022] PUT /identity/v3/projects/a5483c830b8948d7bd8dd30b6cab33a4/users/bc36fc3c48114667aaa8614c158115a9/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:43:09.814642 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4673e27d-2bd5-4e54-b092-0c30fb13c907 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:09.814934 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4673e27d-2bd5-4e54-b092-0c30fb13c907 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:09.815219 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4673e27d-2bd5-4e54-b092-0c30fb13c907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:09.848140 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-4673e27d-2bd5-4e54-b092-0c30fb13c907 None None] MFA Rules not processed for user `bc36fc3c48114667aaa8614c158115a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:43:09.849501 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-4673e27d-2bd5-4e54-b092-0c30fb13c907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:09.972553 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1025/2069] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:43:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:43:09.986313 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84bf3f4-e2e1-40dd-9f80-f67b7f84abd1 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:10.080894 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84bf3f4-e2e1-40dd-9f80-f67b7f84abd1 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:10.087118 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50407d30-92bd-4ac5-bc4a-734ff108261b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:10.087878 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50407d30-92bd-4ac5-bc4a-734ff108261b service cinder] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:10.088233 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50407d30-92bd-4ac5-bc4a-734ff108261b service cinder] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:10.088628 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50407d30-92bd-4ac5-bc4a-734ff108261b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:10.105487 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50407d30-92bd-4ac5-bc4a-734ff108261b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:10.107279 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50407d30-92bd-4ac5-bc4a-734ff108261b service cinder] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:10.123894 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1045/2070] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:43:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:43:10.195635 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:10.481724 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:11.610744 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:12.182041 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:12.215673 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4673e27d-2bd5-4e54-b092-0c30fb13c907 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:12.217234 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-4673e27d-2bd5-4e54-b092-0c30fb13c907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:12.304918 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4673e27d-2bd5-4e54-b092-0c30fb13c907 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:12.311227 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b15a5fc-7789-4319-bcf4-50ed80722bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:12.312164 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15a5fc-7789-4319-bcf4-50ed80722bef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:12.312448 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15a5fc-7789-4319-bcf4-50ed80722bef admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:12.312724 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b15a5fc-7789-4319-bcf4-50ed80722bef admin admin] PATH_INFO: `/v3/users/8f6a43da18834f22b4422623ce0799ac` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:12.314103 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b15a5fc-7789-4319-bcf4-50ed80722bef admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f6a43da18834f22b4422623ce0799ac)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:12.316296 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b15a5fc-7789-4319-bcf4-50ed80722bef admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:12.393898 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:12.544901 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-2b15a5fc-7789-4319-bcf4-50ed80722bef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f6a43da18834f22b4422623ce0799ac'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:12.626866 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-2b15a5fc-7789-4319-bcf4-50ed80722bef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f6a43da18834f22b4422623ce0799ac'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:12.629939 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-2b15a5fc-7789-4319-bcf4-50ed80722bef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f6a43da18834f22b4422623ce0799ac'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:12.649616 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-2b15a5fc-7789-4319-bcf4-50ed80722bef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f6a43da18834f22b4422623ce0799ac'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:12.656421 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-2b15a5fc-7789-4319-bcf4-50ed80722bef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f6a43da18834f22b4422623ce0799ac'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:12.662651 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1026/2071] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:43:12 2022] DELETE /identity/v3/users/8f6a43da18834f22b4422623ce0799ac => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:43:12.954065 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:13.157239 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50407d30-92bd-4ac5-bc4a-734ff108261b service cinder] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:13.170818 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50407d30-92bd-4ac5-bc4a-734ff108261b service cinder] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:13.235794 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fa0808-9c5f-4c1c-8e2b-2aff8394aad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:13.236620 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fa0808-9c5f-4c1c-8e2b-2aff8394aad2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:13.236900 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fa0808-9c5f-4c1c-8e2b-2aff8394aad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:13.237234 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fa0808-9c5f-4c1c-8e2b-2aff8394aad2 admin admin] PATH_INFO: `/v3/projects/816e1fd7377f4931951eccc5fc378571` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:13.238485 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fa0808-9c5f-4c1c-8e2b-2aff8394aad2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=816e1fd7377f4931951eccc5fc378571)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:13.240420 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fa0808-9c5f-4c1c-8e2b-2aff8394aad2 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:13.451993 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-e6fa0808-9c5f-4c1c-8e2b-2aff8394aad2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '816e1fd7377f4931951eccc5fc378571', 'request_id': 'req-e6fa0808-9c5f-4c1c-8e2b-2aff8394aad2'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:13.458110 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-e6fa0808-9c5f-4c1c-8e2b-2aff8394aad2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '816e1fd7377f4931951eccc5fc378571', 'request_id': 'req-e6fa0808-9c5f-4c1c-8e2b-2aff8394aad2'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:13.468500 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-e6fa0808-9c5f-4c1c-8e2b-2aff8394aad2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '816e1fd7377f4931951eccc5fc378571', 'request_id': 'req-e6fa0808-9c5f-4c1c-8e2b-2aff8394aad2'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:13.513600 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:13.630104 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-e6fa0808-9c5f-4c1c-8e2b-2aff8394aad2 admin admin] The token cache is being invalidate because project 816e1fd7377f4931951eccc5fc378571 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80392) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:43:13.630536 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-e6fa0808-9c5f-4c1c-8e2b-2aff8394aad2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:13.631530 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-e6fa0808-9c5f-4c1c-8e2b-2aff8394aad2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:13.633183 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1046/2072] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:43:13 2022] DELETE /identity/v3/projects/816e1fd7377f4931951eccc5fc378571 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:43:13.638705 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9743b-bee1-41a6-9ff9-5f5717ed340f None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:13.639396 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9743b-bee1-41a6-9ff9-5f5717ed340f None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:13.639396 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9743b-bee1-41a6-9ff9-5f5717ed340f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:13.658297 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-24e9743b-bee1-41a6-9ff9-5f5717ed340f None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:43:13.660637 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-24e9743b-bee1-41a6-9ff9-5f5717ed340f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:13.723969 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1027/2073] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:43:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:43:13.734203 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55df2af-be86-4092-937d-7c22c1b58e88 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:13.734843 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55df2af-be86-4092-937d-7c22c1b58e88 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:13.735331 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55df2af-be86-4092-937d-7c22c1b58e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:13.754493 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-d55df2af-be86-4092-937d-7c22c1b58e88 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:43:13.755716 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-d55df2af-be86-4092-937d-7c22c1b58e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:13.764289 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1047/2074] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:43:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:43:13.768828 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e9743b-bee1-41a6-9ff9-5f5717ed340f None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:13.780528 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e9743b-bee1-41a6-9ff9-5f5717ed340f None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:13.786553 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775de1bc-71c4-4614-9f65-c923ebe2589f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:13.786553 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775de1bc-71c4-4614-9f65-c923ebe2589f admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:13.786553 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775de1bc-71c4-4614-9f65-c923ebe2589f admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:13.786840 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775de1bc-71c4-4614-9f65-c923ebe2589f admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:13.787734 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775de1bc-71c4-4614-9f65-c923ebe2589f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:43:13.788032 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775de1bc-71c4-4614-9f65-c923ebe2589f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:13.789650 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775de1bc-71c4-4614-9f65-c923ebe2589f admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:13.803052 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1028/2075] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 10:43:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:43:13.807427 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55df2af-be86-4092-937d-7c22c1b58e88 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:13.817122 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55df2af-be86-4092-937d-7c22c1b58e88 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:13.822130 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3170b1-4823-47d8-8147-a4898f0edb69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:13.822902 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3170b1-4823-47d8-8147-a4898f0edb69 admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:13.823207 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3170b1-4823-47d8-8147-a4898f0edb69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:13.823492 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3170b1-4823-47d8-8147-a4898f0edb69 admin admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:13.824194 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3170b1-4823-47d8-8147-a4898f0edb69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:13.826543 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3170b1-4823-47d8-8147-a4898f0edb69 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:13.951252 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1048/2076] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:43:13 2022] POST /identity/v3/projects => generated 369 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:43:13.955699 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775de1bc-71c4-4614-9f65-c923ebe2589f admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:13.966584 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775de1bc-71c4-4614-9f65-c923ebe2589f admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:14.029984 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35210273-1e18-4d3e-af6e-51e9bb8df2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:14.030782 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35210273-1e18-4d3e-af6e-51e9bb8df2d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:14.031069 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35210273-1e18-4d3e-af6e-51e9bb8df2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:14.031348 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35210273-1e18-4d3e-af6e-51e9bb8df2d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:14.032052 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35210273-1e18-4d3e-af6e-51e9bb8df2d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:14.035320 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35210273-1e18-4d3e-af6e-51e9bb8df2d9 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:14.153619 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1029/2077] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:43:13 2022] POST /identity/v3/users => generated 285 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:43:14.158660 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3170b1-4823-47d8-8147-a4898f0edb69 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:14.170579 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3170b1-4823-47d8-8147-a4898f0edb69 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:14.176232 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d5148-5691-4b15-9224-4502255c5aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:14.177719 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d5148-5691-4b15-9224-4502255c5aaa admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:14.178190 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d5148-5691-4b15-9224-4502255c5aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:14.188336 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d5148-5691-4b15-9224-4502255c5aaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:14.188336 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875d5148-5691-4b15-9224-4502255c5aaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:14.188336 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875d5148-5691-4b15-9224-4502255c5aaa admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:14.198707 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1049/2078] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:43:14.204150 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35210273-1e18-4d3e-af6e-51e9bb8df2d9 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:14.214784 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35210273-1e18-4d3e-af6e-51e9bb8df2d9 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:14.223613 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b860c1-3d82-4f87-82a7-86f89b4555e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:14.224483 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b860c1-3d82-4f87-82a7-86f89b4555e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:14.224709 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b860c1-3d82-4f87-82a7-86f89b4555e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:14.225064 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b860c1-3d82-4f87-82a7-86f89b4555e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:14.225881 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b860c1-3d82-4f87-82a7-86f89b4555e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:14.227686 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b860c1-3d82-4f87-82a7-86f89b4555e1 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:14.239162 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1030/2079] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:43:14.247443 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d5148-5691-4b15-9224-4502255c5aaa admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:14.257766 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d5148-5691-4b15-9224-4502255c5aaa admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:14.262665 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4bdaa8-061f-4730-91dc-7d3660697004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:14.264719 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4bdaa8-061f-4730-91dc-7d3660697004 admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:14.264999 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4bdaa8-061f-4730-91dc-7d3660697004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:14.265481 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4bdaa8-061f-4730-91dc-7d3660697004 admin admin] PATH_INFO: `/v3/projects/75588acc64044e78a175d95996b2daa8/users/ff419427ce554a10bd9c7605a216b27e/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:14.281336 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4bdaa8-061f-4730-91dc-7d3660697004 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75588acc64044e78a175d95996b2daa8, user_id=ff419427ce554a10bd9c7605a216b27e, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:14.284081 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4bdaa8-061f-4730-91dc-7d3660697004 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:14.382157 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1050/2080] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:43:14 2022] PUT /identity/v3/projects/75588acc64044e78a175d95996b2daa8/users/ff419427ce554a10bd9c7605a216b27e/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:43:14.392570 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b157d1b-6c1b-4387-ac67-b2ee8027ed4b None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:14.392861 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b157d1b-6c1b-4387-ac67-b2ee8027ed4b None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:14.393173 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b157d1b-6c1b-4387-ac67-b2ee8027ed4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:14.424419 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-2b157d1b-6c1b-4387-ac67-b2ee8027ed4b None None] MFA Rules not processed for user `ff419427ce554a10bd9c7605a216b27e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:43:14.425713 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-2b157d1b-6c1b-4387-ac67-b2ee8027ed4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:14.498914 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1031/2081] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:43:14 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:43:14.503458 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4bdaa8-061f-4730-91dc-7d3660697004 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:14.569937 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4bdaa8-061f-4730-91dc-7d3660697004 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:14.574747 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b6acd-4e2a-4e87-a08c-154cb37bc0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:14.575436 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b6acd-4e2a-4e87-a08c-154cb37bc0d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:14.575714 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b6acd-4e2a-4e87-a08c-154cb37bc0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:14.576055 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b6acd-4e2a-4e87-a08c-154cb37bc0d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:14.576842 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2b6acd-4e2a-4e87-a08c-154cb37bc0d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:14.578881 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2b6acd-4e2a-4e87-a08c-154cb37bc0d3 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:14.598749 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:14.665083 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1051/2082] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:43:14 2022] POST /identity/v3/projects => generated 373 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:43:14.667433 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b157d1b-6c1b-4387-ac67-b2ee8027ed4b None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:14.680231 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b157d1b-6c1b-4387-ac67-b2ee8027ed4b None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:14.737293 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f180cba-7e04-4417-ac19-b053a424f5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:14.737839 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f180cba-7e04-4417-ac19-b053a424f5b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:14.738006 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f180cba-7e04-4417-ac19-b053a424f5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:14.738309 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f180cba-7e04-4417-ac19-b053a424f5b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:14.738973 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f180cba-7e04-4417-ac19-b053a424f5b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:14.740901 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f180cba-7e04-4417-ac19-b053a424f5b1 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:14.886041 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1032/2083] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:43:14 2022] POST /identity/v3/users => generated 293 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:43:14.898745 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b6acd-4e2a-4e87-a08c-154cb37bc0d3 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:14.909702 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b6acd-4e2a-4e87-a08c-154cb37bc0d3 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:14.914277 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de001c-6191-4806-8606-d6dd20e1131a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:14.914933 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de001c-6191-4806-8606-d6dd20e1131a admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:14.915218 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de001c-6191-4806-8606-d6dd20e1131a admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:14.915492 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de001c-6191-4806-8606-d6dd20e1131a admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:14.916214 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32de001c-6191-4806-8606-d6dd20e1131a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:14.917877 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32de001c-6191-4806-8606-d6dd20e1131a admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:14.929626 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1052/2084] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 10:43:14.933981 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f180cba-7e04-4417-ac19-b053a424f5b1 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:14.944541 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f180cba-7e04-4417-ac19-b053a424f5b1 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:14.950322 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50f85c9-2cab-458c-8824-bc6787f532a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:14.951376 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50f85c9-2cab-458c-8824-bc6787f532a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:14.951652 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50f85c9-2cab-458c-8824-bc6787f532a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:14.951924 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50f85c9-2cab-458c-8824-bc6787f532a1 admin admin] PATH_INFO: `/v3/projects/6e3e1604eb304e1aa152bd774a77d4ab/users/a4d86c357ff3415b8cc0437fb4af6163/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:14.966912 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50f85c9-2cab-458c-8824-bc6787f532a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e3e1604eb304e1aa152bd774a77d4ab, user_id=a4d86c357ff3415b8cc0437fb4af6163, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:14.969575 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50f85c9-2cab-458c-8824-bc6787f532a1 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:14.982108 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:15.008987 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de001c-6191-4806-8606-d6dd20e1131a admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:15.011249 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-32de001c-6191-4806-8606-d6dd20e1131a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:15.026219 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de001c-6191-4806-8606-d6dd20e1131a admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:15.032419 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17815e02-930d-46c9-8434-fdd8130cfe86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:15.033352 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17815e02-930d-46c9-8434-fdd8130cfe86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:15.033638 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17815e02-930d-46c9-8434-fdd8130cfe86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:15.033920 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17815e02-930d-46c9-8434-fdd8130cfe86 admin admin] PATH_INFO: `/v3/users/bc36fc3c48114667aaa8614c158115a9` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:15.035413 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17815e02-930d-46c9-8434-fdd8130cfe86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc36fc3c48114667aaa8614c158115a9)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:15.037407 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17815e02-930d-46c9-8434-fdd8130cfe86 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:15.073083 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1033/2085] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:43:14 2022] PUT /identity/v3/projects/6e3e1604eb304e1aa152bd774a77d4ab/users/a4d86c357ff3415b8cc0437fb4af6163/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:43:15.077225 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50f85c9-2cab-458c-8824-bc6787f532a1 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:15.145140 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50f85c9-2cab-458c-8824-bc6787f532a1 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:15.152212 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150e02ca-8642-4cba-8495-46dee72a6503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:15.154137 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e02ca-8642-4cba-8495-46dee72a6503 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:15.154432 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e02ca-8642-4cba-8495-46dee72a6503 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:15.155400 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150e02ca-8642-4cba-8495-46dee72a6503 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:15.157496 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150e02ca-8642-4cba-8495-46dee72a6503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:15.160875 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150e02ca-8642-4cba-8495-46dee72a6503 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:15.173278 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1034/2086] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:43:15 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:43:15.177719 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150e02ca-8642-4cba-8495-46dee72a6503 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:15.189137 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150e02ca-8642-4cba-8495-46dee72a6503 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:15.194048 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f3b35-1eab-4b37-a8c8-f2e5f3252049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:15.195487 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f3b35-1eab-4b37-a8c8-f2e5f3252049 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:15.195487 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f3b35-1eab-4b37-a8c8-f2e5f3252049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:15.195487 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f3b35-1eab-4b37-a8c8-f2e5f3252049 admin admin] PATH_INFO: `/v3/projects/6e3e1604eb304e1aa152bd774a77d4ab/users/a4d86c357ff3415b8cc0437fb4af6163/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:15.197610 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08f3b35-1eab-4b37-a8c8-f2e5f3252049 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e3e1604eb304e1aa152bd774a77d4ab, user_id=a4d86c357ff3415b8cc0437fb4af6163, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:15.200309 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08f3b35-1eab-4b37-a8c8-f2e5f3252049 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:15.210975 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1035/2087] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:43:15 2022] PUT /identity/v3/projects/6e3e1604eb304e1aa152bd774a77d4ab/users/a4d86c357ff3415b8cc0437fb4af6163/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:43:15.221315 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2020b38e-0fc7-4957-82b2-aa39959968f1 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:15.221609 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2020b38e-0fc7-4957-82b2-aa39959968f1 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:15.221884 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2020b38e-0fc7-4957-82b2-aa39959968f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:15.252053 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-2020b38e-0fc7-4957-82b2-aa39959968f1 None None] MFA Rules not processed for user `a4d86c357ff3415b8cc0437fb4af6163`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:43:15.253301 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-2020b38e-0fc7-4957-82b2-aa39959968f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:15.273853 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-17815e02-930d-46c9-8434-fdd8130cfe86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc36fc3c48114667aaa8614c158115a9'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:15.339155 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1036/2088] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:43:15 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:43:15.351271 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2020b38e-0fc7-4957-82b2-aa39959968f1 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:15.352963 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-2020b38e-0fc7-4957-82b2-aa39959968f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:15.418067 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2020b38e-0fc7-4957-82b2-aa39959968f1 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:15.421832 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-17815e02-930d-46c9-8434-fdd8130cfe86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc36fc3c48114667aaa8614c158115a9'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:15.422512 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-17815e02-930d-46c9-8434-fdd8130cfe86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc36fc3c48114667aaa8614c158115a9'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:15.422778 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc134542-b07e-48f1-abac-abf923693224 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:15.423447 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc134542-b07e-48f1-abac-abf923693224 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:15.423736 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc134542-b07e-48f1-abac-abf923693224 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:15.424019 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc134542-b07e-48f1-abac-abf923693224 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:15.425902 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-cc134542-b07e-48f1-abac-abf923693224 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:15.438157 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-17815e02-930d-46c9-8434-fdd8130cfe86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc36fc3c48114667aaa8614c158115a9'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:15.438773 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc134542-b07e-48f1-abac-abf923693224 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:15.440290 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc134542-b07e-48f1-abac-abf923693224 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:15.450474 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-17815e02-930d-46c9-8434-fdd8130cfe86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc36fc3c48114667aaa8614c158115a9'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:15.451321 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1037/2089] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:43:15 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:43:15.457629 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1053/2090] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:43:15 2022] DELETE /identity/v3/users/bc36fc3c48114667aaa8614c158115a9 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:43:15.462550 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff2f4b-f952-42fa-8110-8e5c5c03aad9 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:15.462912 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff2f4b-f952-42fa-8110-8e5c5c03aad9 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:15.463208 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff2f4b-f952-42fa-8110-8e5c5c03aad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:15.486521 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-b1ff2f4b-f952-42fa-8110-8e5c5c03aad9 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:43:15.488088 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-b1ff2f4b-f952-42fa-8110-8e5c5c03aad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:15.565955 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1038/2091] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:43:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:43:15.576314 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17815e02-930d-46c9-8434-fdd8130cfe86 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:15.577952 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-17815e02-930d-46c9-8434-fdd8130cfe86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:15.646114 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17815e02-930d-46c9-8434-fdd8130cfe86 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:15.651043 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1064d094-1300-444e-889d-aa924e26a71e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:15.651043 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064d094-1300-444e-889d-aa924e26a71e service neutron] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:15.655453 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064d094-1300-444e-889d-aa924e26a71e service neutron] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:15.655453 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064d094-1300-444e-889d-aa924e26a71e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:15.662490 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1064d094-1300-444e-889d-aa924e26a71e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:15.664172 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1064d094-1300-444e-889d-aa924e26a71e service neutron] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:15.675079 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1054/2092] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:43:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:43:15.780427 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff2f4b-f952-42fa-8110-8e5c5c03aad9 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:15.782039 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-b1ff2f4b-f952-42fa-8110-8e5c5c03aad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:15.877384 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff2f4b-f952-42fa-8110-8e5c5c03aad9 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:15.881347 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e3050-968a-4cf5-ab39-39908f59a864 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:15.882060 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e3050-968a-4cf5-ab39-39908f59a864 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:15.882349 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e3050-968a-4cf5-ab39-39908f59a864 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:15.882622 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e3050-968a-4cf5-ab39-39908f59a864 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:15.884400 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-651e3050-968a-4cf5-ab39-39908f59a864 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:15.965057 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651e3050-968a-4cf5-ab39-39908f59a864 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:15.967474 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651e3050-968a-4cf5-ab39-39908f59a864 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:15.982858 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1039/2093] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:43:15 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:43:16.078974 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:16.237580 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1064d094-1300-444e-889d-aa924e26a71e service neutron] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:16.241115 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-1064d094-1300-444e-889d-aa924e26a71e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:16.260770 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1064d094-1300-444e-889d-aa924e26a71e service neutron] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:16.267357 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d25061d-cd41-44a0-b698-113f4564c3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:16.268241 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25061d-cd41-44a0-b698-113f4564c3ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:16.268590 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25061d-cd41-44a0-b698-113f4564c3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:16.268871 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25061d-cd41-44a0-b698-113f4564c3ca admin admin] PATH_INFO: `/v3/projects/a5483c830b8948d7bd8dd30b6cab33a4` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:16.270081 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d25061d-cd41-44a0-b698-113f4564c3ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5483c830b8948d7bd8dd30b6cab33a4)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:16.272156 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d25061d-cd41-44a0-b698-113f4564c3ca admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:16.324936 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:16.383021 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-8d25061d-cd41-44a0-b698-113f4564c3ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5483c830b8948d7bd8dd30b6cab33a4', 'request_id': 'req-8d25061d-cd41-44a0-b698-113f4564c3ca'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:16.391018 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-8d25061d-cd41-44a0-b698-113f4564c3ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5483c830b8948d7bd8dd30b6cab33a4', 'request_id': 'req-8d25061d-cd41-44a0-b698-113f4564c3ca'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:16.398854 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-8d25061d-cd41-44a0-b698-113f4564c3ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5483c830b8948d7bd8dd30b6cab33a4', 'request_id': 'req-8d25061d-cd41-44a0-b698-113f4564c3ca'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:16.543470 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-8d25061d-cd41-44a0-b698-113f4564c3ca admin admin] The token cache is being invalidate because project a5483c830b8948d7bd8dd30b6cab33a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80392) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:43:16.543766 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-8d25061d-cd41-44a0-b698-113f4564c3ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:16.544699 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-8d25061d-cd41-44a0-b698-113f4564c3ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:16.546753 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1055/2094] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:43:16 2022] DELETE /identity/v3/projects/a5483c830b8948d7bd8dd30b6cab33a4 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:43:16.552275 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f9015-b4db-4b0e-b1bf-7d77969e4f23 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:16.552573 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f9015-b4db-4b0e-b1bf-7d77969e4f23 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:16.552875 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f9015-b4db-4b0e-b1bf-7d77969e4f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:16.574567 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-450f9015-b4db-4b0e-b1bf-7d77969e4f23 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:43:16.576407 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-450f9015-b4db-4b0e-b1bf-7d77969e4f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:16.663597 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1040/2095] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:43:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:43:16.671988 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60123c9a-0ab4-49e9-839a-30acd223fdc2 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:16.672286 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60123c9a-0ab4-49e9-839a-30acd223fdc2 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:16.672631 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60123c9a-0ab4-49e9-839a-30acd223fdc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:16.702478 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-60123c9a-0ab4-49e9-839a-30acd223fdc2 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:43:16.703779 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-60123c9a-0ab4-49e9-839a-30acd223fdc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:16.715300 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1056/2096] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:43:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:43:16.721977 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450f9015-b4db-4b0e-b1bf-7d77969e4f23 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:16.733311 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450f9015-b4db-4b0e-b1bf-7d77969e4f23 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:16.738326 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcc6a05-aeb8-4b59-827a-b92e8dc13d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:16.739014 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc6a05-aeb8-4b59-827a-b92e8dc13d6d admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:16.739304 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc6a05-aeb8-4b59-827a-b92e8dc13d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:16.739634 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc6a05-aeb8-4b59-827a-b92e8dc13d6d admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:16.740940 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcc6a05-aeb8-4b59-827a-b92e8dc13d6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:43:16.741297 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcc6a05-aeb8-4b59-827a-b92e8dc13d6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:16.743006 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcc6a05-aeb8-4b59-827a-b92e8dc13d6d admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:16.757743 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1041/2097] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 10:43:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:43:16.761768 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60123c9a-0ab4-49e9-839a-30acd223fdc2 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:16.774255 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60123c9a-0ab4-49e9-839a-30acd223fdc2 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:16.780693 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711836d-a03f-42e7-864e-6178129aab0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:16.781402 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711836d-a03f-42e7-864e-6178129aab0f admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:16.781689 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711836d-a03f-42e7-864e-6178129aab0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:16.781979 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711836d-a03f-42e7-864e-6178129aab0f admin admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:16.782673 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8711836d-a03f-42e7-864e-6178129aab0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:16.784876 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8711836d-a03f-42e7-864e-6178129aab0f admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:16.886401 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1057/2098] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:43:16 2022] POST /identity/v3/projects => generated 385 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:43:16.891073 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcc6a05-aeb8-4b59-827a-b92e8dc13d6d admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:16.901656 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcc6a05-aeb8-4b59-827a-b92e8dc13d6d admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:16.967134 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f62f6-5c4d-4f43-b696-613176e4b02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:16.967917 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f62f6-5c4d-4f43-b696-613176e4b02b admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:16.968203 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f62f6-5c4d-4f43-b696-613176e4b02b admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:16.968495 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f62f6-5c4d-4f43-b696-613176e4b02b admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:16.969232 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4f62f6-5c4d-4f43-b696-613176e4b02b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:16.971174 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4f62f6-5c4d-4f43-b696-613176e4b02b admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:17.068074 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1042/2099] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:43:16 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:43:17.078556 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711836d-a03f-42e7-864e-6178129aab0f admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:17.095423 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711836d-a03f-42e7-864e-6178129aab0f admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:17.100899 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c4e43-13ef-48ec-8c7b-0339c334d4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:17.101648 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c4e43-13ef-48ec-8c7b-0339c334d4cd admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:17.101939 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c4e43-13ef-48ec-8c7b-0339c334d4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:17.102238 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c4e43-13ef-48ec-8c7b-0339c334d4cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:17.102978 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403c4e43-13ef-48ec-8c7b-0339c334d4cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:17.104600 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403c4e43-13ef-48ec-8c7b-0339c334d4cd admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:17.117704 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1058/2100] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:43:17 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:43:17.118825 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:17.121166 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f62f6-5c4d-4f43-b696-613176e4b02b admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:17.134067 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f62f6-5c4d-4f43-b696-613176e4b02b admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:17.140406 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f96e593-eaaa-4ae7-b93f-11db1af427f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:17.141139 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96e593-eaaa-4ae7-b93f-11db1af427f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:17.141426 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96e593-eaaa-4ae7-b93f-11db1af427f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:17.141705 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96e593-eaaa-4ae7-b93f-11db1af427f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:17.142444 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f96e593-eaaa-4ae7-b93f-11db1af427f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:17.144049 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f96e593-eaaa-4ae7-b93f-11db1af427f7 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:17.155821 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1043/2101] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:43:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 10:43:17.160137 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c4e43-13ef-48ec-8c7b-0339c334d4cd admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:17.171135 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c4e43-13ef-48ec-8c7b-0339c334d4cd admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:17.176371 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf1662-a5a6-4cd3-9b9d-5d2b1552acf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:17.178107 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf1662-a5a6-4cd3-9b9d-5d2b1552acf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:17.178627 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf1662-a5a6-4cd3-9b9d-5d2b1552acf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:17.179088 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf1662-a5a6-4cd3-9b9d-5d2b1552acf1 admin admin] PATH_INFO: `/v3/projects/26b288c5c5d648d2a08429d8a2c584e6/users/bc66a0ea5f544637b2c3af5144352fb9/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:17.194805 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf1662-a5a6-4cd3-9b9d-5d2b1552acf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26b288c5c5d648d2a08429d8a2c584e6, user_id=bc66a0ea5f544637b2c3af5144352fb9, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:17.197592 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf1662-a5a6-4cd3-9b9d-5d2b1552acf1 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:17.291418 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1059/2102] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:43:17 2022] PUT /identity/v3/projects/26b288c5c5d648d2a08429d8a2c584e6/users/bc66a0ea5f544637b2c3af5144352fb9/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:43:17.303571 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48fa15-863b-4347-b6a9-75b7ef870f4e None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:17.303781 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48fa15-863b-4347-b6a9-75b7ef870f4e None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:17.304065 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48fa15-863b-4347-b6a9-75b7ef870f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:17.318409 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:17.348385 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-db48fa15-863b-4347-b6a9-75b7ef870f4e None None] MFA Rules not processed for user `bc66a0ea5f544637b2c3af5144352fb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:43:17.350491 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-db48fa15-863b-4347-b6a9-75b7ef870f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:17.441811 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1044/2103] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:43:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:43:17.450014 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf1662-a5a6-4cd3-9b9d-5d2b1552acf1 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:17.452688 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-61cf1662-a5a6-4cd3-9b9d-5d2b1552acf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:17.513556 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf1662-a5a6-4cd3-9b9d-5d2b1552acf1 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:17.517504 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa28253-cd3a-4645-af39-5e2edc78cf93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:17.519571 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa28253-cd3a-4645-af39-5e2edc78cf93 service cinder] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:17.519571 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa28253-cd3a-4645-af39-5e2edc78cf93 service cinder] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:17.519571 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa28253-cd3a-4645-af39-5e2edc78cf93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:17.528014 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa28253-cd3a-4645-af39-5e2edc78cf93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:17.530243 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa28253-cd3a-4645-af39-5e2edc78cf93 service cinder] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:17.541177 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1060/2104] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:43:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:43:17.748314 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:17.826077 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:18.440397 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:18.484527 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db48fa15-863b-4347-b6a9-75b7ef870f4e None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:18.486467 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-db48fa15-863b-4347-b6a9-75b7ef870f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:18.580211 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db48fa15-863b-4347-b6a9-75b7ef870f4e None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:18.590738 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd20e0-b745-49a8-adbf-95a5a05231e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:18.591769 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd20e0-b745-49a8-adbf-95a5a05231e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:18.592055 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd20e0-b745-49a8-adbf-95a5a05231e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:18.592372 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd20e0-b745-49a8-adbf-95a5a05231e9 admin admin] PATH_INFO: `/v3/users/4e41129839094219808d9aa189ef977c` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:18.593759 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fd20e0-b745-49a8-adbf-95a5a05231e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e41129839094219808d9aa189ef977c)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:18.596026 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fd20e0-b745-49a8-adbf-95a5a05231e9 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:18.600376 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:18.939229 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-86fd20e0-b745-49a8-adbf-95a5a05231e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e41129839094219808d9aa189ef977c'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:19.032820 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-86fd20e0-b745-49a8-adbf-95a5a05231e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e41129839094219808d9aa189ef977c'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:19.033520 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-86fd20e0-b745-49a8-adbf-95a5a05231e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e41129839094219808d9aa189ef977c'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:19.052235 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-86fd20e0-b745-49a8-adbf-95a5a05231e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e41129839094219808d9aa189ef977c'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:19.061025 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-86fd20e0-b745-49a8-adbf-95a5a05231e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e41129839094219808d9aa189ef977c'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:19.069910 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1045/2105] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:43:18 2022] DELETE /identity/v3/users/4e41129839094219808d9aa189ef977c => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:43:19.074759 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133913b-bbd1-41e6-bfb0-85e8cb33aa1c None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:19.075081 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133913b-bbd1-41e6-bfb0-85e8cb33aa1c None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:19.075406 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133913b-bbd1-41e6-bfb0-85e8cb33aa1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:19.094210 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-c133913b-bbd1-41e6-bfb0-85e8cb33aa1c None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:43:19.095448 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-c133913b-bbd1-41e6-bfb0-85e8cb33aa1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:19.176435 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1061/2106] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:43:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:43:19.191761 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd20e0-b745-49a8-adbf-95a5a05231e9 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:19.197774 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-86fd20e0-b745-49a8-adbf-95a5a05231e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:19.283948 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd20e0-b745-49a8-adbf-95a5a05231e9 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:19.288714 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ab98b-6f95-4953-8309-bc74835dff2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:19.289548 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ab98b-6f95-4953-8309-bc74835dff2d service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:19.289837 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ab98b-6f95-4953-8309-bc74835dff2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:19.290148 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ab98b-6f95-4953-8309-bc74835dff2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:19.302441 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675ab98b-6f95-4953-8309-bc74835dff2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:19.303870 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675ab98b-6f95-4953-8309-bc74835dff2d service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:19.319026 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1046/2107] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:43:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:43:19.804442 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:19.833128 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:19.955216 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c133913b-bbd1-41e6-bfb0-85e8cb33aa1c None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:19.956681 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-c133913b-bbd1-41e6-bfb0-85e8cb33aa1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:19.971474 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c133913b-bbd1-41e6-bfb0-85e8cb33aa1c None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:19.976370 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19666162-e875-4a3c-bb9e-a8543e407c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:19.977281 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19666162-e875-4a3c-bb9e-a8543e407c7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:19.977563 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19666162-e875-4a3c-bb9e-a8543e407c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:19.977834 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19666162-e875-4a3c-bb9e-a8543e407c7e admin admin] PATH_INFO: `/v3/projects/91cbca3cad9e48ac9ed302f603b48cb3` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:19.979060 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19666162-e875-4a3c-bb9e-a8543e407c7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=91cbca3cad9e48ac9ed302f603b48cb3)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:19.981018 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19666162-e875-4a3c-bb9e-a8543e407c7e admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:20.125571 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-19666162-e875-4a3c-bb9e-a8543e407c7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91cbca3cad9e48ac9ed302f603b48cb3', 'request_id': 'req-19666162-e875-4a3c-bb9e-a8543e407c7e'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:20.131253 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-19666162-e875-4a3c-bb9e-a8543e407c7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91cbca3cad9e48ac9ed302f603b48cb3', 'request_id': 'req-19666162-e875-4a3c-bb9e-a8543e407c7e'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:20.140120 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-19666162-e875-4a3c-bb9e-a8543e407c7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91cbca3cad9e48ac9ed302f603b48cb3', 'request_id': 'req-19666162-e875-4a3c-bb9e-a8543e407c7e'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:20.278006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-19666162-e875-4a3c-bb9e-a8543e407c7e admin admin] The token cache is being invalidate because project 91cbca3cad9e48ac9ed302f603b48cb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80392) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:43:20.279450 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-19666162-e875-4a3c-bb9e-a8543e407c7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:20.280127 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-19666162-e875-4a3c-bb9e-a8543e407c7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:20.285557 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1062/2108] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:43:19 2022] DELETE /identity/v3/projects/91cbca3cad9e48ac9ed302f603b48cb3 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:43:20.287192 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e72b1c3-7965-4bca-ad75-ce07ebe07352 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:20.287541 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e72b1c3-7965-4bca-ad75-ce07ebe07352 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:20.287830 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e72b1c3-7965-4bca-ad75-ce07ebe07352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:20.308484 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-2e72b1c3-7965-4bca-ad75-ce07ebe07352 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:43:20.310077 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-2e72b1c3-7965-4bca-ad75-ce07ebe07352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:20.382576 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1047/2109] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:43:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:43:20.395110 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6abd2e-ce41-436d-8e76-e1cd5fa16230 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:20.395401 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6abd2e-ce41-436d-8e76-e1cd5fa16230 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:20.395682 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6abd2e-ce41-436d-8e76-e1cd5fa16230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:20.414263 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-9b6abd2e-ce41-436d-8e76-e1cd5fa16230 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:43:20.415486 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-9b6abd2e-ce41-436d-8e76-e1cd5fa16230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:20.424450 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1063/2110] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:43:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:43:20.429542 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e72b1c3-7965-4bca-ad75-ce07ebe07352 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:20.439982 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e72b1c3-7965-4bca-ad75-ce07ebe07352 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:20.444762 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6264cc-bf96-4716-bce4-4977cc5d4d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:20.445445 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6264cc-bf96-4716-bce4-4977cc5d4d3f admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:20.445767 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6264cc-bf96-4716-bce4-4977cc5d4d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:20.446083 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6264cc-bf96-4716-bce4-4977cc5d4d3f admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:20.446804 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6264cc-bf96-4716-bce4-4977cc5d4d3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:43:20.447109 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6264cc-bf96-4716-bce4-4977cc5d4d3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:20.448744 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6264cc-bf96-4716-bce4-4977cc5d4d3f admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:20.460983 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1048/2111] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 10:43:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:43:20.465533 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6abd2e-ce41-436d-8e76-e1cd5fa16230 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:20.475153 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6abd2e-ce41-436d-8e76-e1cd5fa16230 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:20.479827 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f1c56f-f100-4221-a719-9bf574e155be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:20.480475 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1c56f-f100-4221-a719-9bf574e155be admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:20.480755 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1c56f-f100-4221-a719-9bf574e155be admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:20.481026 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1c56f-f100-4221-a719-9bf574e155be admin admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:20.482625 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f1c56f-f100-4221-a719-9bf574e155be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:20.484325 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f1c56f-f100-4221-a719-9bf574e155be admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:20.614469 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1064/2112] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:43:20 2022] POST /identity/v3/projects => generated 377 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:43:20.617900 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6264cc-bf96-4716-bce4-4977cc5d4d3f admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:20.628892 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6264cc-bf96-4716-bce4-4977cc5d4d3f admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:20.698107 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f4417-d56c-4025-9f40-a8a82387289d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:20.698781 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f4417-d56c-4025-9f40-a8a82387289d admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:20.699064 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f4417-d56c-4025-9f40-a8a82387289d admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:20.699341 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f4417-d56c-4025-9f40-a8a82387289d admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:20.700078 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4f4417-d56c-4025-9f40-a8a82387289d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:20.702022 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4f4417-d56c-4025-9f40-a8a82387289d admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:20.742034 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:20.833148 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1049/2113] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:43:20 2022] POST /identity/v3/users => generated 289 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:43:20.837481 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f1c56f-f100-4221-a719-9bf574e155be admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:20.848829 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f1c56f-f100-4221-a719-9bf574e155be admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:20.853944 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c338fb9b-c3ea-47dd-891c-ffc9c9665376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:20.854627 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338fb9b-c3ea-47dd-891c-ffc9c9665376 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:20.854912 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338fb9b-c3ea-47dd-891c-ffc9c9665376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:20.855205 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c338fb9b-c3ea-47dd-891c-ffc9c9665376 admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:20.857080 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:20.857248 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c338fb9b-c3ea-47dd-891c-ffc9c9665376 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:20.858219 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c338fb9b-c3ea-47dd-891c-ffc9c9665376 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:20.871772 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1065/2114] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:43:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:43:20.873270 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f4417-d56c-4025-9f40-a8a82387289d admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:20.883515 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f4417-d56c-4025-9f40-a8a82387289d admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:20.889749 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dfacbc-2065-4736-960f-5dde916626fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:20.894005 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dfacbc-2065-4736-960f-5dde916626fc admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:20.894005 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dfacbc-2065-4736-960f-5dde916626fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:20.894005 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dfacbc-2065-4736-960f-5dde916626fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:20.894005 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dfacbc-2065-4736-960f-5dde916626fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:20.894005 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dfacbc-2065-4736-960f-5dde916626fc admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:20.905074 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1050/2115] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:43:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:43:20.916997 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c338fb9b-c3ea-47dd-891c-ffc9c9665376 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:20.923084 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c338fb9b-c3ea-47dd-891c-ffc9c9665376 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:20.927959 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c515042-b874-4eb0-9021-a9fd34f42bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:20.928881 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c515042-b874-4eb0-9021-a9fd34f42bae admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:20.929197 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c515042-b874-4eb0-9021-a9fd34f42bae admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:20.929474 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c515042-b874-4eb0-9021-a9fd34f42bae admin admin] PATH_INFO: `/v3/projects/223eae9cb5b143c4be2e8f4c805cbb73/users/48b4ca71a760408181320979ecb308d9/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:20.944744 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c515042-b874-4eb0-9021-a9fd34f42bae admin admin] RBAC: Authorizing `identity:create_grant(project_id=223eae9cb5b143c4be2e8f4c805cbb73, user_id=48b4ca71a760408181320979ecb308d9, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:20.947538 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c515042-b874-4eb0-9021-a9fd34f42bae admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:21.010233 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:21.051399 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1066/2116] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:43:20 2022] PUT /identity/v3/projects/223eae9cb5b143c4be2e8f4c805cbb73/users/48b4ca71a760408181320979ecb308d9/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:43:21.061896 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0a2a8-684e-4972-82ae-f67f0051833c None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:21.062189 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0a2a8-684e-4972-82ae-f67f0051833c None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:21.062467 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e0a2a8-684e-4972-82ae-f67f0051833c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:21.094048 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-25e0a2a8-684e-4972-82ae-f67f0051833c None None] MFA Rules not processed for user `48b4ca71a760408181320979ecb308d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:43:21.095618 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-25e0a2a8-684e-4972-82ae-f67f0051833c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:21.164224 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1051/2117] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:43:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:43:21.168924 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c515042-b874-4eb0-9021-a9fd34f42bae admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:21.235541 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c515042-b874-4eb0-9021-a9fd34f42bae admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:21.240390 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd521a1-c70a-4c01-a7ea-71e65f8adb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:21.241093 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd521a1-c70a-4c01-a7ea-71e65f8adb94 admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:21.241432 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd521a1-c70a-4c01-a7ea-71e65f8adb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:21.241703 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd521a1-c70a-4c01-a7ea-71e65f8adb94 admin admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:21.242571 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd521a1-c70a-4c01-a7ea-71e65f8adb94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:21.244495 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd521a1-c70a-4c01-a7ea-71e65f8adb94 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:21.368596 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1067/2118] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:43:21 2022] POST /identity/v3/projects => generated 375 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:43:21.373763 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e0a2a8-684e-4972-82ae-f67f0051833c None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:21.386760 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e0a2a8-684e-4972-82ae-f67f0051833c None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:21.454765 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b720e9-e181-431f-a6fa-be78ea6bc9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:21.454765 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b720e9-e181-431f-a6fa-be78ea6bc9e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:21.454765 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b720e9-e181-431f-a6fa-be78ea6bc9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:21.454765 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b720e9-e181-431f-a6fa-be78ea6bc9e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:21.455101 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b720e9-e181-431f-a6fa-be78ea6bc9e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:21.455755 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b720e9-e181-431f-a6fa-be78ea6bc9e4 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:21.472667 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:21.554036 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1052/2119] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:43:21 2022] POST /identity/v3/users => generated 288 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:43:21.558190 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd521a1-c70a-4c01-a7ea-71e65f8adb94 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:21.570569 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd521a1-c70a-4c01-a7ea-71e65f8adb94 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:21.576585 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5929504-1d34-4376-8407-168d1c0ec696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:21.577307 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5929504-1d34-4376-8407-168d1c0ec696 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:21.577593 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5929504-1d34-4376-8407-168d1c0ec696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:21.577871 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5929504-1d34-4376-8407-168d1c0ec696 admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:21.578667 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5929504-1d34-4376-8407-168d1c0ec696 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:21.580333 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5929504-1d34-4376-8407-168d1c0ec696 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:21.593279 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1068/2120] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:43:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:43:21.597542 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b720e9-e181-431f-a6fa-be78ea6bc9e4 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:21.608400 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b720e9-e181-431f-a6fa-be78ea6bc9e4 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:21.613225 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7007bc30-36ef-4db4-8ec7-c1ad61a6b077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:21.614272 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007bc30-36ef-4db4-8ec7-c1ad61a6b077 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:21.615062 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007bc30-36ef-4db4-8ec7-c1ad61a6b077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:21.615384 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007bc30-36ef-4db4-8ec7-c1ad61a6b077 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:21.616128 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7007bc30-36ef-4db4-8ec7-c1ad61a6b077 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:21.617925 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7007bc30-36ef-4db4-8ec7-c1ad61a6b077 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:21.630469 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1053/2121] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:43:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:43:21.634906 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5929504-1d34-4376-8407-168d1c0ec696 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:21.648289 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5929504-1d34-4376-8407-168d1c0ec696 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:21.655454 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d4ab6-d151-4af5-8aac-1f4bdca9d6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:21.656358 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d4ab6-d151-4af5-8aac-1f4bdca9d6aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:21.656638 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d4ab6-d151-4af5-8aac-1f4bdca9d6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:21.656910 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d4ab6-d151-4af5-8aac-1f4bdca9d6aa admin admin] PATH_INFO: `/v3/projects/4b065fbd117b4c659e3493b3cf66cc5a/users/32090bb7fff94208b33500566298fe30/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:21.672887 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00d4ab6-d151-4af5-8aac-1f4bdca9d6aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b065fbd117b4c659e3493b3cf66cc5a, user_id=32090bb7fff94208b33500566298fe30, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:21.675630 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00d4ab6-d151-4af5-8aac-1f4bdca9d6aa admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:21.821662 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1069/2122] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:43:21 2022] PUT /identity/v3/projects/4b065fbd117b4c659e3493b3cf66cc5a/users/32090bb7fff94208b33500566298fe30/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:43:21.833542 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc847ce-5c63-4c9c-aa74-b5f410e95df1 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:21.834036 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc847ce-5c63-4c9c-aa74-b5f410e95df1 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:21.834127 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc847ce-5c63-4c9c-aa74-b5f410e95df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:21.869287 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-4bc847ce-5c63-4c9c-aa74-b5f410e95df1 None None] MFA Rules not processed for user `32090bb7fff94208b33500566298fe30`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:43:21.870631 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-4bc847ce-5c63-4c9c-aa74-b5f410e95df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:21.947713 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1054/2123] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:43:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:43:21.952404 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d4ab6-d151-4af5-8aac-1f4bdca9d6aa admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:22.018786 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d4ab6-d151-4af5-8aac-1f4bdca9d6aa admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:22.023566 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5666b02c-9fe6-48bd-acb7-b42aefaa8e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:22.024220 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5666b02c-9fe6-48bd-acb7-b42aefaa8e72 admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:22.024501 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5666b02c-9fe6-48bd-acb7-b42aefaa8e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:22.024776 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5666b02c-9fe6-48bd-acb7-b42aefaa8e72 admin admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:22.025512 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5666b02c-9fe6-48bd-acb7-b42aefaa8e72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:22.027404 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5666b02c-9fe6-48bd-acb7-b42aefaa8e72 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:22.078655 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc847ce-5c63-4c9c-aa74-b5f410e95df1 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:22.080677 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-4bc847ce-5c63-4c9c-aa74-b5f410e95df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:22.097133 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc847ce-5c63-4c9c-aa74-b5f410e95df1 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:22.104172 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c2e8b-00c0-4315-b260-fcfab83ef098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:22.105542 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c2e8b-00c0-4315-b260-fcfab83ef098 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:22.106114 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c2e8b-00c0-4315-b260-fcfab83ef098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:22.107213 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c2e8b-00c0-4315-b260-fcfab83ef098 admin admin] PATH_INFO: `/v3/users/bc66a0ea5f544637b2c3af5144352fb9` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:22.109868 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2c2e8b-00c0-4315-b260-fcfab83ef098 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc66a0ea5f544637b2c3af5144352fb9)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:22.111827 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2c2e8b-00c0-4315-b260-fcfab83ef098 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:22.153929 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1070/2124] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:43:21 2022] POST /identity/v3/projects => generated 373 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:43:22.156616 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5666b02c-9fe6-48bd-acb7-b42aefaa8e72 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:22.242938 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5666b02c-9fe6-48bd-acb7-b42aefaa8e72 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:22.251587 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d3e615-d5a5-4c4d-a3c3-8ab60163dad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:22.252284 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3e615-d5a5-4c4d-a3c3-8ab60163dad3 admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:22.252599 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3e615-d5a5-4c4d-a3c3-8ab60163dad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:22.253408 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3e615-d5a5-4c4d-a3c3-8ab60163dad3 admin admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:22.254119 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d3e615-d5a5-4c4d-a3c3-8ab60163dad3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:22.256300 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d3e615-d5a5-4c4d-a3c3-8ab60163dad3 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:22.355269 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-4d2c2e8b-00c0-4315-b260-fcfab83ef098 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc66a0ea5f544637b2c3af5144352fb9'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:22.381146 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1071/2125] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:43:22 2022] POST /identity/v3/users => generated 293 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:43:22.388791 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d3e615-d5a5-4c4d-a3c3-8ab60163dad3 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:22.399881 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d3e615-d5a5-4c4d-a3c3-8ab60163dad3 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:22.405627 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9924fd6-e14c-4034-b4d2-24ae595efe0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:22.406337 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9924fd6-e14c-4034-b4d2-24ae595efe0d admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:22.406648 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9924fd6-e14c-4034-b4d2-24ae595efe0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:22.406993 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9924fd6-e14c-4034-b4d2-24ae595efe0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:22.407746 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9924fd6-e14c-4034-b4d2-24ae595efe0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:22.409509 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9924fd6-e14c-4034-b4d2-24ae595efe0d admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:22.421697 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1072/2126] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:43:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 10:43:22.425781 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9924fd6-e14c-4034-b4d2-24ae595efe0d admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:22.437529 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9924fd6-e14c-4034-b4d2-24ae595efe0d admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:22.442281 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7078b7e-e9f4-472f-b50f-3aee1d71df2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:22.443361 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7078b7e-e9f4-472f-b50f-3aee1d71df2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:22.443655 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7078b7e-e9f4-472f-b50f-3aee1d71df2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:22.443931 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7078b7e-e9f4-472f-b50f-3aee1d71df2c admin admin] PATH_INFO: `/v3/projects/7af4387da29145358474bfff2173cc8d/users/434f4e6961514c3b8c70d063a7a12ded/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:22.460073 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7078b7e-e9f4-472f-b50f-3aee1d71df2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7af4387da29145358474bfff2173cc8d, user_id=434f4e6961514c3b8c70d063a7a12ded, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:22.462859 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7078b7e-e9f4-472f-b50f-3aee1d71df2c admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:22.513118 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:22.513284 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-4d2c2e8b-00c0-4315-b260-fcfab83ef098 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc66a0ea5f544637b2c3af5144352fb9'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:22.514050 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-4d2c2e8b-00c0-4315-b260-fcfab83ef098 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc66a0ea5f544637b2c3af5144352fb9'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:22.527305 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-4d2c2e8b-00c0-4315-b260-fcfab83ef098 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc66a0ea5f544637b2c3af5144352fb9'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:22.534353 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-4d2c2e8b-00c0-4315-b260-fcfab83ef098 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc66a0ea5f544637b2c3af5144352fb9'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:22.540364 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1055/2127] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:43:22 2022] DELETE /identity/v3/users/bc66a0ea5f544637b2c3af5144352fb9 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:43:22.545650 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac073acb-f094-4f71-b7ee-75411c4a979c None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:22.545938 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac073acb-f094-4f71-b7ee-75411c4a979c None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:22.546231 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac073acb-f094-4f71-b7ee-75411c4a979c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:22.553449 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1073/2128] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:43:22 2022] PUT /identity/v3/projects/7af4387da29145358474bfff2173cc8d/users/434f4e6961514c3b8c70d063a7a12ded/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:43:22.558934 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7078b7e-e9f4-472f-b50f-3aee1d71df2c admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:22.562212 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-e7078b7e-e9f4-472f-b50f-3aee1d71df2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:22.568601 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-ac073acb-f094-4f71-b7ee-75411c4a979c None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:43:22.569851 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-ac073acb-f094-4f71-b7ee-75411c4a979c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:22.632163 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7078b7e-e9f4-472f-b50f-3aee1d71df2c admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:22.635628 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1056/2129] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:43:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:43:22.636877 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff44de0-3e78-4142-8dbe-8efa01de5cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:22.638731 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff44de0-3e78-4142-8dbe-8efa01de5cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:22.639021 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff44de0-3e78-4142-8dbe-8efa01de5cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:22.639304 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff44de0-3e78-4142-8dbe-8efa01de5cb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:22.640152 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff44de0-3e78-4142-8dbe-8efa01de5cb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:22.641808 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff44de0-3e78-4142-8dbe-8efa01de5cb6 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:22.647480 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac073acb-f094-4f71-b7ee-75411c4a979c None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:22.648890 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-ac073acb-f094-4f71-b7ee-75411c4a979c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:22.655933 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1074/2130] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:43:22 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:43:22.656982 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff44de0-3e78-4142-8dbe-8efa01de5cb6 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:22.666848 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff44de0-3e78-4142-8dbe-8efa01de5cb6 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:22.672405 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef572ba-397b-412f-8941-812979f6b0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:22.674506 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef572ba-397b-412f-8941-812979f6b0d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:22.674506 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef572ba-397b-412f-8941-812979f6b0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:22.674827 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef572ba-397b-412f-8941-812979f6b0d4 admin admin] PATH_INFO: `/v3/projects/7af4387da29145358474bfff2173cc8d/users/434f4e6961514c3b8c70d063a7a12ded/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:22.677160 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef572ba-397b-412f-8941-812979f6b0d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7af4387da29145358474bfff2173cc8d, user_id=434f4e6961514c3b8c70d063a7a12ded, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:22.679833 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef572ba-397b-412f-8941-812979f6b0d4 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:22.691419 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1075/2131] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:43:22 2022] PUT /identity/v3/projects/7af4387da29145358474bfff2173cc8d/users/434f4e6961514c3b8c70d063a7a12ded/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:43:22.701645 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36090a-36d9-4fc2-94b4-284cee5e41fd None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:22.708578 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36090a-36d9-4fc2-94b4-284cee5e41fd None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:22.708578 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36090a-36d9-4fc2-94b4-284cee5e41fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:22.712279 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac073acb-f094-4f71-b7ee-75411c4a979c None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:22.729257 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-af36090a-36d9-4fc2-94b4-284cee5e41fd None None] MFA Rules not processed for user `434f4e6961514c3b8c70d063a7a12ded`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:43:22.730505 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-af36090a-36d9-4fc2-94b4-284cee5e41fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:22.764822 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4278669-3ae5-47db-a9f8-5ebaa82c1759 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:22.765530 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4278669-3ae5-47db-a9f8-5ebaa82c1759 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:22.765815 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4278669-3ae5-47db-a9f8-5ebaa82c1759 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:22.766106 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4278669-3ae5-47db-a9f8-5ebaa82c1759 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:22.804672 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1076/2132] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:43:22 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:43:22.816305 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af36090a-36d9-4fc2-94b4-284cee5e41fd None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:22.817747 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-af36090a-36d9-4fc2-94b4-284cee5e41fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:22.835760 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4278669-3ae5-47db-a9f8-5ebaa82c1759 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:22.836709 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4278669-3ae5-47db-a9f8-5ebaa82c1759 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:22.848217 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1057/2133] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:43:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:43:22.892932 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af36090a-36d9-4fc2-94b4-284cee5e41fd None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:22.896640 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb93881-dc86-4e32-86a0-f4752dc61a75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:22.897438 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb93881-dc86-4e32-86a0-f4752dc61a75 service cinder] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:22.897719 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb93881-dc86-4e32-86a0-f4752dc61a75 service cinder] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:22.897993 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb93881-dc86-4e32-86a0-f4752dc61a75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:22.900021 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-2fb93881-dc86-4e32-86a0-f4752dc61a75 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:22.961476 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb93881-dc86-4e32-86a0-f4752dc61a75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:22.963296 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb93881-dc86-4e32-86a0-f4752dc61a75 service cinder] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:22.974283 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1077/2134] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:43:22 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:43:23.318672 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:23.395148 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4278669-3ae5-47db-a9f8-5ebaa82c1759 service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:23.396653 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-d4278669-3ae5-47db-a9f8-5ebaa82c1759 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:23.410399 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4278669-3ae5-47db-a9f8-5ebaa82c1759 service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:23.415250 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5faa22-824e-43f6-a0b2-46de5aa8ccfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:23.416216 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5faa22-824e-43f6-a0b2-46de5aa8ccfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:23.416520 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5faa22-824e-43f6-a0b2-46de5aa8ccfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:23.416791 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5faa22-824e-43f6-a0b2-46de5aa8ccfe admin admin] PATH_INFO: `/v3/projects/26b288c5c5d648d2a08429d8a2c584e6` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:23.418095 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5faa22-824e-43f6-a0b2-46de5aa8ccfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=26b288c5c5d648d2a08429d8a2c584e6)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:23.420450 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5faa22-824e-43f6-a0b2-46de5aa8ccfe admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:23.518825 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:23.582054 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7a5faa22-824e-43f6-a0b2-46de5aa8ccfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26b288c5c5d648d2a08429d8a2c584e6', 'request_id': 'req-7a5faa22-824e-43f6-a0b2-46de5aa8ccfe'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:23.590501 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7a5faa22-824e-43f6-a0b2-46de5aa8ccfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26b288c5c5d648d2a08429d8a2c584e6', 'request_id': 'req-7a5faa22-824e-43f6-a0b2-46de5aa8ccfe'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:23.596395 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7a5faa22-824e-43f6-a0b2-46de5aa8ccfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26b288c5c5d648d2a08429d8a2c584e6', 'request_id': 'req-7a5faa22-824e-43f6-a0b2-46de5aa8ccfe'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:23.738231 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7a5faa22-824e-43f6-a0b2-46de5aa8ccfe admin admin] The token cache is being invalidate because project 26b288c5c5d648d2a08429d8a2c584e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:43:23.738549 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7a5faa22-824e-43f6-a0b2-46de5aa8ccfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:23.739334 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7a5faa22-824e-43f6-a0b2-46de5aa8ccfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:23.741312 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1058/2135] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:43:23 2022] DELETE /identity/v3/projects/26b288c5c5d648d2a08429d8a2c584e6 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:43:25.205306 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb93881-dc86-4e32-86a0-f4752dc61a75 service cinder] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:25.205306 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-2fb93881-dc86-4e32-86a0-f4752dc61a75 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:25.215965 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb93881-dc86-4e32-86a0-f4752dc61a75 service cinder] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:25.270947 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c567a234-c27f-4244-a495-ae22141188a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:25.271600 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567a234-c27f-4244-a495-ae22141188a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:25.271889 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567a234-c27f-4244-a495-ae22141188a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:25.272169 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567a234-c27f-4244-a495-ae22141188a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:25.273978 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-c567a234-c27f-4244-a495-ae22141188a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:25.333916 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c567a234-c27f-4244-a495-ae22141188a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:25.335367 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c567a234-c27f-4244-a495-ae22141188a2 service cinder] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:25.345792 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1078/2136] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:43:25 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:43:25.443835 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:25.736337 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:27.033616 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:27.055416 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5faa22-824e-43f6-a0b2-46de5aa8ccfe admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:27.055416 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-7a5faa22-824e-43f6-a0b2-46de5aa8ccfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:27.067466 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5faa22-824e-43f6-a0b2-46de5aa8ccfe admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:27.071291 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e91e25-126b-44de-8c57-ab0e8a88b57e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:27.071810 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e91e25-126b-44de-8c57-ab0e8a88b57e service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:27.072081 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e91e25-126b-44de-8c57-ab0e8a88b57e service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:27.072364 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e91e25-126b-44de-8c57-ab0e8a88b57e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:27.074234 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-f7e91e25-126b-44de-8c57-ab0e8a88b57e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:27.143456 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e91e25-126b-44de-8c57-ab0e8a88b57e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:27.144902 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e91e25-126b-44de-8c57-ab0e8a88b57e service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:27.156283 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1059/2137] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:43:27 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:43:27.318107 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:28.187805 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:28.198947 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c567a234-c27f-4244-a495-ae22141188a2 service cinder] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:28.200895 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-c567a234-c27f-4244-a495-ae22141188a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:28.273447 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c567a234-c27f-4244-a495-ae22141188a2 service cinder] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:28.282593 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2c1682-5fa2-4603-a514-c8b211fc6a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:28.287516 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c1682-5fa2-4603-a514-c8b211fc6a97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:28.287516 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c1682-5fa2-4603-a514-c8b211fc6a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:28.287516 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c1682-5fa2-4603-a514-c8b211fc6a97 admin admin] PATH_INFO: `/v3/users/c30c52a613474262b0081e4850bb8e9f` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:28.287516 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2c1682-5fa2-4603-a514-c8b211fc6a97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c30c52a613474262b0081e4850bb8e9f)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:28.289419 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2c1682-5fa2-4603-a514-c8b211fc6a97 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:28.510286 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-5c2c1682-5fa2-4603-a514-c8b211fc6a97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c30c52a613474262b0081e4850bb8e9f'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:28.660627 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-5c2c1682-5fa2-4603-a514-c8b211fc6a97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c30c52a613474262b0081e4850bb8e9f'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:28.661292 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-5c2c1682-5fa2-4603-a514-c8b211fc6a97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c30c52a613474262b0081e4850bb8e9f'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:28.674499 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-5c2c1682-5fa2-4603-a514-c8b211fc6a97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c30c52a613474262b0081e4850bb8e9f'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:28.682846 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-5c2c1682-5fa2-4603-a514-c8b211fc6a97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c30c52a613474262b0081e4850bb8e9f'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:28.689607 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1079/2138] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:43:28 2022] DELETE /identity/v3/users/c30c52a613474262b0081e4850bb8e9f => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:43:28.694356 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a8bca-160c-438c-b52f-e7925529bb70 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:28.694649 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a8bca-160c-438c-b52f-e7925529bb70 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:28.694933 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a8bca-160c-438c-b52f-e7925529bb70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:28.713637 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-3c8a8bca-160c-438c-b52f-e7925529bb70 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:43:28.714852 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-3c8a8bca-160c-438c-b52f-e7925529bb70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:28.775628 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1060/2139] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:43:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:43:28.786333 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2c1682-5fa2-4603-a514-c8b211fc6a97 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:28.787734 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-5c2c1682-5fa2-4603-a514-c8b211fc6a97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:28.798002 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:28.852743 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2c1682-5fa2-4603-a514-c8b211fc6a97 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:28.856846 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26585294-1875-4e36-adf4-e63f700a1eba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:28.857517 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26585294-1875-4e36-adf4-e63f700a1eba service neutron] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:28.857800 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26585294-1875-4e36-adf4-e63f700a1eba service neutron] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:28.858076 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26585294-1875-4e36-adf4-e63f700a1eba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:28.870805 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26585294-1875-4e36-adf4-e63f700a1eba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:28.872986 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26585294-1875-4e36-adf4-e63f700a1eba service neutron] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:28.885282 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1080/2140] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:43:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:43:29.021394 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:29.414872 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8a8bca-160c-438c-b52f-e7925529bb70 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:29.415830 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-3c8a8bca-160c-438c-b52f-e7925529bb70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:29.452354 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8a8bca-160c-438c-b52f-e7925529bb70 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:29.459101 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad4ab0-1972-4038-89ad-19639fc6f6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:29.460166 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad4ab0-1972-4038-89ad-19639fc6f6ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:29.460654 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad4ab0-1972-4038-89ad-19639fc6f6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:29.460958 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad4ab0-1972-4038-89ad-19639fc6f6ff admin admin] PATH_INFO: `/v3/projects/5a6d3f9a33704c3d9be72ef70cbc017e` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:29.462684 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ad4ab0-1972-4038-89ad-19639fc6f6ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a6d3f9a33704c3d9be72ef70cbc017e)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:29.464914 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ad4ab0-1972-4038-89ad-19639fc6f6ff admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:29.644509 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-b1ad4ab0-1972-4038-89ad-19639fc6f6ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a6d3f9a33704c3d9be72ef70cbc017e', 'request_id': 'req-b1ad4ab0-1972-4038-89ad-19639fc6f6ff'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:29.651621 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-b1ad4ab0-1972-4038-89ad-19639fc6f6ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a6d3f9a33704c3d9be72ef70cbc017e', 'request_id': 'req-b1ad4ab0-1972-4038-89ad-19639fc6f6ff'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:29.660075 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-b1ad4ab0-1972-4038-89ad-19639fc6f6ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a6d3f9a33704c3d9be72ef70cbc017e', 'request_id': 'req-b1ad4ab0-1972-4038-89ad-19639fc6f6ff'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:29.806882 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-b1ad4ab0-1972-4038-89ad-19639fc6f6ff admin admin] The token cache is being invalidate because project 5a6d3f9a33704c3d9be72ef70cbc017e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:43:29.813018 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-b1ad4ab0-1972-4038-89ad-19639fc6f6ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:29.813018 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-b1ad4ab0-1972-4038-89ad-19639fc6f6ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:29.813018 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1061/2141] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:43:29 2022] DELETE /identity/v3/projects/5a6d3f9a33704c3d9be72ef70cbc017e => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:43:29.816654 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f03df7c-a7e4-404d-a7fa-3f4ec83a29b4 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:29.817346 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f03df7c-a7e4-404d-a7fa-3f4ec83a29b4 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:29.817346 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f03df7c-a7e4-404d-a7fa-3f4ec83a29b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:29.837654 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-7f03df7c-a7e4-404d-a7fa-3f4ec83a29b4 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:43:29.838886 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-7f03df7c-a7e4-404d-a7fa-3f4ec83a29b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:29.912552 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1081/2142] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:43:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:43:29.922937 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb9756-2a52-413d-84b9-7ec4c64d3f7a None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:29.923396 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb9756-2a52-413d-84b9-7ec4c64d3f7a None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:29.923957 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb9756-2a52-413d-84b9-7ec4c64d3f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:29.944532 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-0dbb9756-2a52-413d-84b9-7ec4c64d3f7a None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:43:29.945767 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-0dbb9756-2a52-413d-84b9-7ec4c64d3f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:29.956583 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1062/2143] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:43:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:43:29.964005 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f03df7c-a7e4-404d-a7fa-3f4ec83a29b4 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:29.976725 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f03df7c-a7e4-404d-a7fa-3f4ec83a29b4 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:29.982333 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6952ddf1-ab99-4542-8cec-6821bf4cd4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:29.983017 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952ddf1-ab99-4542-8cec-6821bf4cd4c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:29.983299 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952ddf1-ab99-4542-8cec-6821bf4cd4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:29.983575 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952ddf1-ab99-4542-8cec-6821bf4cd4c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:29.984333 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6952ddf1-ab99-4542-8cec-6821bf4cd4c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:43:29.984641 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6952ddf1-ab99-4542-8cec-6821bf4cd4c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:29.986292 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6952ddf1-ab99-4542-8cec-6821bf4cd4c7 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:29.999318 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1082/2144] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 10:43:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:43:30.007093 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb9756-2a52-413d-84b9-7ec4c64d3f7a None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:30.017301 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb9756-2a52-413d-84b9-7ec4c64d3f7a None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:30.022250 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c147eb-77be-4d2b-8926-d0d7b6676c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:30.023066 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c147eb-77be-4d2b-8926-d0d7b6676c13 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:30.023356 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c147eb-77be-4d2b-8926-d0d7b6676c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:30.023637 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c147eb-77be-4d2b-8926-d0d7b6676c13 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:30.024403 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c147eb-77be-4d2b-8926-d0d7b6676c13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:30.026357 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c147eb-77be-4d2b-8926-d0d7b6676c13 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:30.039156 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:30.134190 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1063/2145] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:43:30 2022] POST /identity/v3/projects => generated 385 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:43:30.139321 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6952ddf1-ab99-4542-8cec-6821bf4cd4c7 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:30.153689 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6952ddf1-ab99-4542-8cec-6821bf4cd4c7 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:30.239647 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12076e4-d48f-4e83-97a4-b6543a7111d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:30.240915 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12076e4-d48f-4e83-97a4-b6543a7111d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:30.241472 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12076e4-d48f-4e83-97a4-b6543a7111d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:30.241910 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12076e4-d48f-4e83-97a4-b6543a7111d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:30.242642 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12076e4-d48f-4e83-97a4-b6543a7111d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:30.244701 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12076e4-d48f-4e83-97a4-b6543a7111d5 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:30.341524 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1083/2146] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:43:30 2022] POST /identity/v3/users => generated 293 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:43:30.346206 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c147eb-77be-4d2b-8926-d0d7b6676c13 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:30.358728 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c147eb-77be-4d2b-8926-d0d7b6676c13 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:30.364486 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3495341a-afac-43a6-9bc8-0c010616a926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:30.365236 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3495341a-afac-43a6-9bc8-0c010616a926 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:30.365587 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3495341a-afac-43a6-9bc8-0c010616a926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:30.365825 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3495341a-afac-43a6-9bc8-0c010616a926 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:30.366612 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3495341a-afac-43a6-9bc8-0c010616a926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:30.368384 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3495341a-afac-43a6-9bc8-0c010616a926 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:30.384616 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1064/2147] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:43:30 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:43:30.389489 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12076e4-d48f-4e83-97a4-b6543a7111d5 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:30.400494 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12076e4-d48f-4e83-97a4-b6543a7111d5 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:30.406467 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db82216-d49e-42e8-a3ae-a3f4a25ab394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:30.407148 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db82216-d49e-42e8-a3ae-a3f4a25ab394 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:30.407426 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db82216-d49e-42e8-a3ae-a3f4a25ab394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:30.407706 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db82216-d49e-42e8-a3ae-a3f4a25ab394 admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:30.410117 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db82216-d49e-42e8-a3ae-a3f4a25ab394 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:30.410117 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db82216-d49e-42e8-a3ae-a3f4a25ab394 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:30.421844 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1084/2148] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:43:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:43:30.427799 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3495341a-afac-43a6-9bc8-0c010616a926 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:30.440258 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3495341a-afac-43a6-9bc8-0c010616a926 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:30.444890 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f5016b-4aa2-494a-80c7-9f3f97d0c2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:30.445916 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5016b-4aa2-494a-80c7-9f3f97d0c2a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:30.446200 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5016b-4aa2-494a-80c7-9f3f97d0c2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:30.446473 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f5016b-4aa2-494a-80c7-9f3f97d0c2a3 admin admin] PATH_INFO: `/v3/projects/65cc2bb256fa4176ba3b9a26615b3975/users/af51de992161480d8d05e6a2c7ff6f8d/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:30.462753 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f5016b-4aa2-494a-80c7-9f3f97d0c2a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65cc2bb256fa4176ba3b9a26615b3975, user_id=af51de992161480d8d05e6a2c7ff6f8d, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:30.465577 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f5016b-4aa2-494a-80c7-9f3f97d0c2a3 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:30.552768 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1065/2149] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:43:30 2022] PUT /identity/v3/projects/65cc2bb256fa4176ba3b9a26615b3975/users/af51de992161480d8d05e6a2c7ff6f8d/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:43:30.574952 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790acd1b-0ec6-4ff4-9cc5-417d834817c2 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:30.575296 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790acd1b-0ec6-4ff4-9cc5-417d834817c2 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:30.575661 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790acd1b-0ec6-4ff4-9cc5-417d834817c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:30.603702 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-790acd1b-0ec6-4ff4-9cc5-417d834817c2 None None] MFA Rules not processed for user `af51de992161480d8d05e6a2c7ff6f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:43:30.604976 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-790acd1b-0ec6-4ff4-9cc5-417d834817c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:30.639544 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:30.682849 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1085/2150] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:43:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:43:30.685270 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f5016b-4aa2-494a-80c7-9f3f97d0c2a3 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:30.752470 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f5016b-4aa2-494a-80c7-9f3f97d0c2a3 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:30.757726 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ff3e70-d0b5-4b55-93af-a01535a485df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:30.758571 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff3e70-d0b5-4b55-93af-a01535a485df admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:30.759223 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff3e70-d0b5-4b55-93af-a01535a485df admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:30.759644 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff3e70-d0b5-4b55-93af-a01535a485df admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:30.760690 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ff3e70-d0b5-4b55-93af-a01535a485df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:30.765559 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ff3e70-d0b5-4b55-93af-a01535a485df admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:30.891640 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1066/2151] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:43:30 2022] POST /identity/v3/projects => generated 383 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:43:30.894697 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790acd1b-0ec6-4ff4-9cc5-417d834817c2 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:30.905342 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790acd1b-0ec6-4ff4-9cc5-417d834817c2 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:30.961322 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7269c5-f401-47dd-86af-a1bb1d87b72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:30.962019 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7269c5-f401-47dd-86af-a1bb1d87b72b admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:30.962302 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7269c5-f401-47dd-86af-a1bb1d87b72b admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:30.962575 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7269c5-f401-47dd-86af-a1bb1d87b72b admin admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:30.963269 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7269c5-f401-47dd-86af-a1bb1d87b72b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:30.965457 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7269c5-f401-47dd-86af-a1bb1d87b72b admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:31.055837 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1086/2152] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:43:30 2022] POST /identity/v3/users => generated 292 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:43:31.061613 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ff3e70-d0b5-4b55-93af-a01535a485df admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:31.072484 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ff3e70-d0b5-4b55-93af-a01535a485df admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:31.077459 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed04c3-5e80-4313-b623-846659f540af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:31.078139 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed04c3-5e80-4313-b623-846659f540af admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:31.078423 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed04c3-5e80-4313-b623-846659f540af admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:31.078704 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed04c3-5e80-4313-b623-846659f540af admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:31.079441 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed04c3-5e80-4313-b623-846659f540af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:31.081081 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed04c3-5e80-4313-b623-846659f540af admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:31.097027 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1067/2153] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:43:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 10:43:31.098581 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7269c5-f401-47dd-86af-a1bb1d87b72b admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:31.110900 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7269c5-f401-47dd-86af-a1bb1d87b72b admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:31.115676 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64551918-f6ce-4337-9066-5fac60482763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:31.116379 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64551918-f6ce-4337-9066-5fac60482763 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:31.116663 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64551918-f6ce-4337-9066-5fac60482763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:31.116937 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64551918-f6ce-4337-9066-5fac60482763 admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:31.117723 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64551918-f6ce-4337-9066-5fac60482763 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:31.119327 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64551918-f6ce-4337-9066-5fac60482763 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:31.132714 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1087/2154] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:43:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:43:31.143506 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed04c3-5e80-4313-b623-846659f540af admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:31.154426 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed04c3-5e80-4313-b623-846659f540af admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:31.159369 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7900c4a2-82aa-47d3-8977-11ef8ad5ddf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:31.160250 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7900c4a2-82aa-47d3-8977-11ef8ad5ddf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:31.160527 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7900c4a2-82aa-47d3-8977-11ef8ad5ddf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:31.160798 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7900c4a2-82aa-47d3-8977-11ef8ad5ddf5 admin admin] PATH_INFO: `/v3/projects/5bbbd4a4a33f4e47bbdedac9461fcc66/users/ff6b4207146d4e038870b91a3143dedf/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:31.182217 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7900c4a2-82aa-47d3-8977-11ef8ad5ddf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bbbd4a4a33f4e47bbdedac9461fcc66, user_id=ff6b4207146d4e038870b91a3143dedf, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:31.185639 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7900c4a2-82aa-47d3-8977-11ef8ad5ddf5 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:31.216329 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:31.254244 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1068/2155] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:43:31 2022] PUT /identity/v3/projects/5bbbd4a4a33f4e47bbdedac9461fcc66/users/ff6b4207146d4e038870b91a3143dedf/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:43:31.266458 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f8c63-80cb-4259-8fbc-4bbb0b32ded1 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:31.266715 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f8c63-80cb-4259-8fbc-4bbb0b32ded1 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:31.266925 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f8c63-80cb-4259-8fbc-4bbb0b32ded1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:31.299679 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-894f8c63-80cb-4259-8fbc-4bbb0b32ded1 None None] MFA Rules not processed for user `ff6b4207146d4e038870b91a3143dedf`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:43:31.302971 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:31.303824 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-894f8c63-80cb-4259-8fbc-4bbb0b32ded1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:31.377764 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1088/2156] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:43:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:43:31.382820 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7900c4a2-82aa-47d3-8977-11ef8ad5ddf5 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:31.454195 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7900c4a2-82aa-47d3-8977-11ef8ad5ddf5 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:31.459063 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fcfcc1-172f-4dbc-90ab-4955876509c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:31.459734 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fcfcc1-172f-4dbc-90ab-4955876509c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:31.460027 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fcfcc1-172f-4dbc-90ab-4955876509c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:31.460304 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fcfcc1-172f-4dbc-90ab-4955876509c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:31.461020 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fcfcc1-172f-4dbc-90ab-4955876509c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:31.463132 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fcfcc1-172f-4dbc-90ab-4955876509c1 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:31.469320 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:31.501120 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:31.566798 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1069/2157] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:43:31 2022] POST /identity/v3/projects => generated 385 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:43:31.572257 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f8c63-80cb-4259-8fbc-4bbb0b32ded1 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:31.584723 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f8c63-80cb-4259-8fbc-4bbb0b32ded1 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:31.639484 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:31.655101 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569a244c-9173-451d-9b00-f5e6e37e1e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:31.656055 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a244c-9173-451d-9b00-f5e6e37e1e14 admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:31.656340 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a244c-9173-451d-9b00-f5e6e37e1e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:31.656616 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569a244c-9173-451d-9b00-f5e6e37e1e14 admin admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:31.657367 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569a244c-9173-451d-9b00-f5e6e37e1e14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:31.659450 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569a244c-9173-451d-9b00-f5e6e37e1e14 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:31.666955 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:31.773640 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1089/2158] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:43:31 2022] POST /identity/v3/users => generated 299 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:43:31.783887 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fcfcc1-172f-4dbc-90ab-4955876509c1 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:31.797074 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fcfcc1-172f-4dbc-90ab-4955876509c1 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:31.803665 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3209f9c-f7e3-4767-b0e9-dd57a118369f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:31.804352 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3209f9c-f7e3-4767-b0e9-dd57a118369f admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:31.804633 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3209f9c-f7e3-4767-b0e9-dd57a118369f admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:31.804904 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3209f9c-f7e3-4767-b0e9-dd57a118369f admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:31.805692 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3209f9c-f7e3-4767-b0e9-dd57a118369f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:31.813275 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3209f9c-f7e3-4767-b0e9-dd57a118369f admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:31.829522 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1070/2159] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:43:31 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:43:31.830467 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569a244c-9173-451d-9b00-f5e6e37e1e14 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:31.852957 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569a244c-9173-451d-9b00-f5e6e37e1e14 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:31.859398 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af4a92f-abd1-4e9d-b60b-2eb944e75e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:31.860823 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4a92f-abd1-4e9d-b60b-2eb944e75e72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:31.861386 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4a92f-abd1-4e9d-b60b-2eb944e75e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:31.861844 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4a92f-abd1-4e9d-b60b-2eb944e75e72 admin admin] PATH_INFO: `/v3/projects/b4ca0cafc4c946c3aa465922f5864ab9/users/0071cea5a779419eb04a7b332cfba674/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:31.882642 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af4a92f-abd1-4e9d-b60b-2eb944e75e72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4ca0cafc4c946c3aa465922f5864ab9, user_id=0071cea5a779419eb04a7b332cfba674, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:31.885897 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af4a92f-abd1-4e9d-b60b-2eb944e75e72 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:31.950207 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1090/2160] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:43:31 2022] PUT /identity/v3/projects/b4ca0cafc4c946c3aa465922f5864ab9/users/0071cea5a779419eb04a7b332cfba674/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:43:31.954465 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3209f9c-f7e3-4767-b0e9-dd57a118369f admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:31.966956 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3209f9c-f7e3-4767-b0e9-dd57a118369f admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:32.028866 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c6129-c67b-4794-8ff4-5c56c88a3270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:32.029733 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c6129-c67b-4794-8ff4-5c56c88a3270 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:32.030162 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c6129-c67b-4794-8ff4-5c56c88a3270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:32.030394 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c6129-c67b-4794-8ff4-5c56c88a3270 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:32.031145 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8c6129-c67b-4794-8ff4-5c56c88a3270 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:32.032797 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8c6129-c67b-4794-8ff4-5c56c88a3270 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:32.045755 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1071/2161] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:43:31 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:43:32.049440 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:32.050762 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af4a92f-abd1-4e9d-b60b-2eb944e75e72 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:32.066590 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af4a92f-abd1-4e9d-b60b-2eb944e75e72 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:32.073712 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5324ce5d-4feb-482b-92bf-631acbe9aee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:32.079470 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324ce5d-4feb-482b-92bf-631acbe9aee9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:32.079714 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324ce5d-4feb-482b-92bf-631acbe9aee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:32.079993 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324ce5d-4feb-482b-92bf-631acbe9aee9 admin admin] PATH_INFO: `/v3/projects/b4ca0cafc4c946c3aa465922f5864ab9/users/0071cea5a779419eb04a7b332cfba674/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:32.083989 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5324ce5d-4feb-482b-92bf-631acbe9aee9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4ca0cafc4c946c3aa465922f5864ab9, user_id=0071cea5a779419eb04a7b332cfba674, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:32.093679 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5324ce5d-4feb-482b-92bf-631acbe9aee9 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:32.096342 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:32.112484 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1091/2162] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:43:32 2022] PUT /identity/v3/projects/b4ca0cafc4c946c3aa465922f5864ab9/users/0071cea5a779419eb04a7b332cfba674/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:43:32.123724 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee9b5d-2806-4da4-960c-7f746f0048d6 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:32.124014 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee9b5d-2806-4da4-960c-7f746f0048d6 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:32.124248 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee9b5d-2806-4da4-960c-7f746f0048d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:32.154004 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-5bee9b5d-2806-4da4-960c-7f746f0048d6 None None] MFA Rules not processed for user `0071cea5a779419eb04a7b332cfba674`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:43:32.155551 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-5bee9b5d-2806-4da4-960c-7f746f0048d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:32.243277 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1072/2163] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:43:32 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:43:32.372568 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5324ce5d-4feb-482b-92bf-631acbe9aee9 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:32.374366 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-5324ce5d-4feb-482b-92bf-631acbe9aee9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:32.434448 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5324ce5d-4feb-482b-92bf-631acbe9aee9 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:32.439249 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40fcda-3d56-439a-9b67-9134e4f69665 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:32.439910 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40fcda-3d56-439a-9b67-9134e4f69665 service cinder] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:32.440199 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40fcda-3d56-439a-9b67-9134e4f69665 service cinder] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:32.440475 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40fcda-3d56-439a-9b67-9134e4f69665 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:32.500720 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb40fcda-3d56-439a-9b67-9134e4f69665 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:32.502243 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb40fcda-3d56-439a-9b67-9134e4f69665 service cinder] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:32.511367 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1092/2164] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:43:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:43:32.919042 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:33.524837 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:33.793385 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee9b5d-2806-4da4-960c-7f746f0048d6 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:33.795956 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-5bee9b5d-2806-4da4-960c-7f746f0048d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:33.869111 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee9b5d-2806-4da4-960c-7f746f0048d6 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:33.881302 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f25dca-a5ab-4b4b-b091-4bcccf998705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:33.882786 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f25dca-a5ab-4b4b-b091-4bcccf998705 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:33.882786 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f25dca-a5ab-4b4b-b091-4bcccf998705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:33.882958 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f25dca-a5ab-4b4b-b091-4bcccf998705 admin admin] PATH_INFO: `/v3/users/48b4ca71a760408181320979ecb308d9` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:33.884267 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f25dca-a5ab-4b4b-b091-4bcccf998705 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48b4ca71a760408181320979ecb308d9)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:33.886288 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f25dca-a5ab-4b4b-b091-4bcccf998705 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:34.068561 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-20f25dca-a5ab-4b4b-b091-4bcccf998705 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48b4ca71a760408181320979ecb308d9'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:34.169813 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-20f25dca-a5ab-4b4b-b091-4bcccf998705 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48b4ca71a760408181320979ecb308d9'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:34.170391 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-20f25dca-a5ab-4b4b-b091-4bcccf998705 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48b4ca71a760408181320979ecb308d9'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:34.183352 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-20f25dca-a5ab-4b4b-b091-4bcccf998705 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48b4ca71a760408181320979ecb308d9'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:34.191642 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-20f25dca-a5ab-4b4b-b091-4bcccf998705 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48b4ca71a760408181320979ecb308d9'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:34.197863 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1073/2165] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:43:33 2022] DELETE /identity/v3/users/48b4ca71a760408181320979ecb308d9 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:43:34.203120 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9cfe0-156d-4668-a456-737fc3618cd1 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:34.203638 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9cfe0-156d-4668-a456-737fc3618cd1 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:34.203743 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9cfe0-156d-4668-a456-737fc3618cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:34.222605 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-20b9cfe0-156d-4668-a456-737fc3618cd1 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:43:34.223841 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-20b9cfe0-156d-4668-a456-737fc3618cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:34.306731 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1093/2166] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:43:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:43:34.318382 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f25dca-a5ab-4b4b-b091-4bcccf998705 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:34.319831 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-20f25dca-a5ab-4b4b-b091-4bcccf998705 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:34.348461 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:34.401463 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f25dca-a5ab-4b4b-b091-4bcccf998705 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:34.405568 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29430924-78d6-4cd2-a298-94b26b2ca98e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:34.406242 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29430924-78d6-4cd2-a298-94b26b2ca98e service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:34.406521 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29430924-78d6-4cd2-a298-94b26b2ca98e service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:34.406793 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29430924-78d6-4cd2-a298-94b26b2ca98e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:34.426442 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29430924-78d6-4cd2-a298-94b26b2ca98e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:34.426442 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29430924-78d6-4cd2-a298-94b26b2ca98e service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:34.436852 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1074/2167] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:43:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:43:35.166099 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b9cfe0-156d-4668-a456-737fc3618cd1 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:35.168355 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-20b9cfe0-156d-4668-a456-737fc3618cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:35.184962 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b9cfe0-156d-4668-a456-737fc3618cd1 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:35.191457 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a4a6c5-7763-4278-bf52-7e1c151c046c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:35.192881 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4a6c5-7763-4278-bf52-7e1c151c046c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:35.193316 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4a6c5-7763-4278-bf52-7e1c151c046c admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:35.193532 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4a6c5-7763-4278-bf52-7e1c151c046c admin admin] PATH_INFO: `/v3/projects/223eae9cb5b143c4be2e8f4c805cbb73` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:35.194851 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a4a6c5-7763-4278-bf52-7e1c151c046c admin admin] RBAC: Authorizing `identity:delete_project(project_id=223eae9cb5b143c4be2e8f4c805cbb73)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:35.197268 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a4a6c5-7763-4278-bf52-7e1c151c046c admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:35.217214 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:35.272181 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:35.286098 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29430924-78d6-4cd2-a298-94b26b2ca98e service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:35.289620 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-29430924-78d6-4cd2-a298-94b26b2ca98e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:35.356593 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-68a4a6c5-7763-4278-bf52-7e1c151c046c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '223eae9cb5b143c4be2e8f4c805cbb73', 'request_id': 'req-68a4a6c5-7763-4278-bf52-7e1c151c046c'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:35.368800 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-68a4a6c5-7763-4278-bf52-7e1c151c046c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '223eae9cb5b143c4be2e8f4c805cbb73', 'request_id': 'req-68a4a6c5-7763-4278-bf52-7e1c151c046c'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:35.368937 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29430924-78d6-4cd2-a298-94b26b2ca98e service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:35.369026 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-68a4a6c5-7763-4278-bf52-7e1c151c046c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '223eae9cb5b143c4be2e8f4c805cbb73', 'request_id': 'req-68a4a6c5-7763-4278-bf52-7e1c151c046c'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:35.420507 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd8d73-990b-4146-bef7-202279e23b92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:35.421214 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd8d73-990b-4146-bef7-202279e23b92 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:35.421506 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd8d73-990b-4146-bef7-202279e23b92 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:35.421830 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd8d73-990b-4146-bef7-202279e23b92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:35.423716 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-2edd8d73-990b-4146-bef7-202279e23b92 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:35.478142 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-68a4a6c5-7763-4278-bf52-7e1c151c046c admin admin] The token cache is being invalidate because project 223eae9cb5b143c4be2e8f4c805cbb73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80392) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:43:35.478716 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-68a4a6c5-7763-4278-bf52-7e1c151c046c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:35.479387 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-68a4a6c5-7763-4278-bf52-7e1c151c046c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:35.481073 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1094/2168] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:43:35 2022] DELETE /identity/v3/projects/223eae9cb5b143c4be2e8f4c805cbb73 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:43:35.485245 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a4a6c5-7763-4278-bf52-7e1c151c046c admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:35.486768 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-68a4a6c5-7763-4278-bf52-7e1c151c046c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:35.497811 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edd8d73-990b-4146-bef7-202279e23b92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:35.499891 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edd8d73-990b-4146-bef7-202279e23b92 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:35.510589 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1075/2169] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:43:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:43:35.566691 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a4a6c5-7763-4278-bf52-7e1c151c046c admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:35.572086 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f3eef-bbb9-4205-82a3-3d18daf98cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:35.573253 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f3eef-bbb9-4205-82a3-3d18daf98cb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:35.573544 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f3eef-bbb9-4205-82a3-3d18daf98cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:35.573824 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f3eef-bbb9-4205-82a3-3d18daf98cb9 admin admin] PATH_INFO: `/v3/users/32090bb7fff94208b33500566298fe30` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:35.575846 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288f3eef-bbb9-4205-82a3-3d18daf98cb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32090bb7fff94208b33500566298fe30)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:35.577934 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288f3eef-bbb9-4205-82a3-3d18daf98cb9 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:35.811088 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-288f3eef-bbb9-4205-82a3-3d18daf98cb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32090bb7fff94208b33500566298fe30'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:35.895011 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-288f3eef-bbb9-4205-82a3-3d18daf98cb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32090bb7fff94208b33500566298fe30'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:35.895885 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-288f3eef-bbb9-4205-82a3-3d18daf98cb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32090bb7fff94208b33500566298fe30'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:35.913238 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-288f3eef-bbb9-4205-82a3-3d18daf98cb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32090bb7fff94208b33500566298fe30'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:35.921027 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-288f3eef-bbb9-4205-82a3-3d18daf98cb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32090bb7fff94208b33500566298fe30'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:35.923914 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:35.928231 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1095/2170] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:43:35 2022] DELETE /identity/v3/users/32090bb7fff94208b33500566298fe30 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:43:36.400516 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd8d73-990b-4146-bef7-202279e23b92 service cinder] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:36.419389 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd8d73-990b-4146-bef7-202279e23b92 service cinder] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:36.492704 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc6790a-141d-472f-a372-c504b2c70a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:36.493617 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6790a-141d-472f-a372-c504b2c70a5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:36.493902 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6790a-141d-472f-a372-c504b2c70a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:36.494180 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc6790a-141d-472f-a372-c504b2c70a5b admin admin] PATH_INFO: `/v3/projects/4b065fbd117b4c659e3493b3cf66cc5a` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:36.495403 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc6790a-141d-472f-a372-c504b2c70a5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b065fbd117b4c659e3493b3cf66cc5a)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:36.497626 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc6790a-141d-472f-a372-c504b2c70a5b admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:36.659065 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-5fc6790a-141d-472f-a372-c504b2c70a5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b065fbd117b4c659e3493b3cf66cc5a', 'request_id': 'req-5fc6790a-141d-472f-a372-c504b2c70a5b'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:36.665060 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-5fc6790a-141d-472f-a372-c504b2c70a5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b065fbd117b4c659e3493b3cf66cc5a', 'request_id': 'req-5fc6790a-141d-472f-a372-c504b2c70a5b'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:36.673131 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-5fc6790a-141d-472f-a372-c504b2c70a5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b065fbd117b4c659e3493b3cf66cc5a', 'request_id': 'req-5fc6790a-141d-472f-a372-c504b2c70a5b'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:36.772523 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-5fc6790a-141d-472f-a372-c504b2c70a5b admin admin] The token cache is being invalidate because project 4b065fbd117b4c659e3493b3cf66cc5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:43:36.773267 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-5fc6790a-141d-472f-a372-c504b2c70a5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:36.773763 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-5fc6790a-141d-472f-a372-c504b2c70a5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:36.781264 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f3eef-bbb9-4205-82a3-3d18daf98cb9 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:36.784152 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-288f3eef-bbb9-4205-82a3-3d18daf98cb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:36.785592 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1076/2171] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:43:36 2022] DELETE /identity/v3/projects/4b065fbd117b4c659e3493b3cf66cc5a => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:43:36.804967 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f3eef-bbb9-4205-82a3-3d18daf98cb9 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:36.825724 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:36.881241 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c65e7-ae7d-4c05-a2e0-6eb501c797b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:36.883082 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c65e7-ae7d-4c05-a2e0-6eb501c797b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:36.883962 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c65e7-ae7d-4c05-a2e0-6eb501c797b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:36.884453 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c65e7-ae7d-4c05-a2e0-6eb501c797b4 admin admin] PATH_INFO: `/v3/users/434f4e6961514c3b8c70d063a7a12ded` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:36.885830 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770c65e7-ae7d-4c05-a2e0-6eb501c797b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=434f4e6961514c3b8c70d063a7a12ded)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:36.888847 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770c65e7-ae7d-4c05-a2e0-6eb501c797b4 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:37.131828 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-770c65e7-ae7d-4c05-a2e0-6eb501c797b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '434f4e6961514c3b8c70d063a7a12ded'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:37.221426 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-770c65e7-ae7d-4c05-a2e0-6eb501c797b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '434f4e6961514c3b8c70d063a7a12ded'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:37.222882 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-770c65e7-ae7d-4c05-a2e0-6eb501c797b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '434f4e6961514c3b8c70d063a7a12ded'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:37.237208 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-770c65e7-ae7d-4c05-a2e0-6eb501c797b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '434f4e6961514c3b8c70d063a7a12ded'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:37.244841 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-770c65e7-ae7d-4c05-a2e0-6eb501c797b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '434f4e6961514c3b8c70d063a7a12ded'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:37.252212 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1096/2172] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:43:36 2022] DELETE /identity/v3/users/434f4e6961514c3b8c70d063a7a12ded => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:43:37.483043 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc6790a-141d-472f-a372-c504b2c70a5b admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:37.484445 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-5fc6790a-141d-472f-a372-c504b2c70a5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:37.554350 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc6790a-141d-472f-a372-c504b2c70a5b admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:37.612182 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:37.635903 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e475955f-ca72-4f0e-b842-957279caabb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:37.637717 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475955f-ca72-4f0e-b842-957279caabb0 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:37.638071 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475955f-ca72-4f0e-b842-957279caabb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:37.638414 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e475955f-ca72-4f0e-b842-957279caabb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:37.640275 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-e475955f-ca72-4f0e-b842-957279caabb0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:37.750209 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e475955f-ca72-4f0e-b842-957279caabb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:37.752917 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e475955f-ca72-4f0e-b842-957279caabb0 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:37.769125 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1077/2173] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:43:37 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:43:37.948281 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c65e7-ae7d-4c05-a2e0-6eb501c797b4 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:37.950599 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-770c65e7-ae7d-4c05-a2e0-6eb501c797b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:38.103667 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c65e7-ae7d-4c05-a2e0-6eb501c797b4 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:38.125846 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276179b1-0655-4af8-bab3-488ced1f0a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:38.127603 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276179b1-0655-4af8-bab3-488ced1f0a0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:38.128170 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276179b1-0655-4af8-bab3-488ced1f0a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:38.128507 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276179b1-0655-4af8-bab3-488ced1f0a0e admin admin] PATH_INFO: `/v3/projects/7af4387da29145358474bfff2173cc8d` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:38.132893 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276179b1-0655-4af8-bab3-488ced1f0a0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7af4387da29145358474bfff2173cc8d)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:38.136861 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276179b1-0655-4af8-bab3-488ced1f0a0e admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:38.315363 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:38.330964 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-276179b1-0655-4af8-bab3-488ced1f0a0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7af4387da29145358474bfff2173cc8d', 'request_id': 'req-276179b1-0655-4af8-bab3-488ced1f0a0e'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:38.342203 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-276179b1-0655-4af8-bab3-488ced1f0a0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7af4387da29145358474bfff2173cc8d', 'request_id': 'req-276179b1-0655-4af8-bab3-488ced1f0a0e'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:38.348393 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-276179b1-0655-4af8-bab3-488ced1f0a0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7af4387da29145358474bfff2173cc8d', 'request_id': 'req-276179b1-0655-4af8-bab3-488ced1f0a0e'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:38.443979 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-276179b1-0655-4af8-bab3-488ced1f0a0e admin admin] The token cache is being invalidate because project 7af4387da29145358474bfff2173cc8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80392) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:43:38.444171 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-276179b1-0655-4af8-bab3-488ced1f0a0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:38.444942 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-276179b1-0655-4af8-bab3-488ced1f0a0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:38.446996 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1097/2174] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:43:37 2022] DELETE /identity/v3/projects/7af4387da29145358474bfff2173cc8d => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:43:38.457120 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97dcdb4-6531-4c09-a3c7-0ead28b90851 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:38.457817 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97dcdb4-6531-4c09-a3c7-0ead28b90851 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:38.458120 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97dcdb4-6531-4c09-a3c7-0ead28b90851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:38.497423 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-d97dcdb4-6531-4c09-a3c7-0ead28b90851 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:43:38.498761 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-d97dcdb4-6531-4c09-a3c7-0ead28b90851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:38.564050 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1078/2175] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:43:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:43:38.572241 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b68c44b-9493-439b-a3d3-255610fa1f0a None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:38.572612 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b68c44b-9493-439b-a3d3-255610fa1f0a None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:38.572830 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b68c44b-9493-439b-a3d3-255610fa1f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:38.592834 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-2b68c44b-9493-439b-a3d3-255610fa1f0a None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:43:38.594149 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-2b68c44b-9493-439b-a3d3-255610fa1f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:38.613117 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1098/2176] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:43:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:43:38.613682 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97dcdb4-6531-4c09-a3c7-0ead28b90851 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:38.628400 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97dcdb4-6531-4c09-a3c7-0ead28b90851 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:38.633791 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b39908-6497-4e86-868b-f2412c3f86ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:38.634478 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b39908-6497-4e86-868b-f2412c3f86ae admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:38.634765 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b39908-6497-4e86-868b-f2412c3f86ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:38.635117 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b39908-6497-4e86-868b-f2412c3f86ae admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:38.635770 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b39908-6497-4e86-868b-f2412c3f86ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:43:38.636078 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b39908-6497-4e86-868b-f2412c3f86ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:38.638716 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b39908-6497-4e86-868b-f2412c3f86ae admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:38.654108 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1079/2177] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 10:43:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:43:38.658256 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b68c44b-9493-439b-a3d3-255610fa1f0a None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:38.668051 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b68c44b-9493-439b-a3d3-255610fa1f0a None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:38.673969 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44790b4d-0410-4cd2-8bf6-be1a2c4c23ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:38.674634 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44790b4d-0410-4cd2-8bf6-be1a2c4c23ea admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:38.674634 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44790b4d-0410-4cd2-8bf6-be1a2c4c23ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:38.674822 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44790b4d-0410-4cd2-8bf6-be1a2c4c23ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:38.675994 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44790b4d-0410-4cd2-8bf6-be1a2c4c23ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:38.678097 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44790b4d-0410-4cd2-8bf6-be1a2c4c23ea admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:38.773095 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1099/2178] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:43:38 2022] POST /identity/v3/projects => generated 373 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:43:38.776680 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b39908-6497-4e86-868b-f2412c3f86ae admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:38.790137 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b39908-6497-4e86-868b-f2412c3f86ae admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:38.893996 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6afd3e-4caf-4e6b-aa88-4bd6fac895e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:38.895243 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6afd3e-4caf-4e6b-aa88-4bd6fac895e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:38.896045 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6afd3e-4caf-4e6b-aa88-4bd6fac895e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:38.896384 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6afd3e-4caf-4e6b-aa88-4bd6fac895e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:38.897142 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6afd3e-4caf-4e6b-aa88-4bd6fac895e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:38.902661 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6afd3e-4caf-4e6b-aa88-4bd6fac895e0 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:38.954696 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44790b4d-0410-4cd2-8bf6-be1a2c4c23ea admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:38.957313 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-44790b4d-0410-4cd2-8bf6-be1a2c4c23ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:38.975060 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44790b4d-0410-4cd2-8bf6-be1a2c4c23ea admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:38.980964 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b6f7a6-52ba-4381-a28d-f91ca1fa44e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:38.981939 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6f7a6-52ba-4381-a28d-f91ca1fa44e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:38.982226 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6f7a6-52ba-4381-a28d-f91ca1fa44e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:38.982645 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b6f7a6-52ba-4381-a28d-f91ca1fa44e5 admin admin] PATH_INFO: `/v3/users/8b8c227ea8e64dc19038a37f78e6faa2` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:38.984004 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b6f7a6-52ba-4381-a28d-f91ca1fa44e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b8c227ea8e64dc19038a37f78e6faa2)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:38.986022 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b6f7a6-52ba-4381-a28d-f91ca1fa44e5 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:38.997938 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1080/2179] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:43:38 2022] POST /identity/v3/users => generated 287 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:43:39.002111 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6afd3e-4caf-4e6b-aa88-4bd6fac895e0 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:39.016357 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6afd3e-4caf-4e6b-aa88-4bd6fac895e0 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:39.024011 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35906647-7fbf-4575-887f-924ef1658a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:39.024883 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35906647-7fbf-4575-887f-924ef1658a77 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:39.025310 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35906647-7fbf-4575-887f-924ef1658a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:39.025717 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35906647-7fbf-4575-887f-924ef1658a77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:39.026841 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35906647-7fbf-4575-887f-924ef1658a77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:39.029405 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35906647-7fbf-4575-887f-924ef1658a77 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:39.032080 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:39.045921 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1081/2180] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:43:39 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:43:39.049944 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35906647-7fbf-4575-887f-924ef1658a77 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:39.066900 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35906647-7fbf-4575-887f-924ef1658a77 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:39.072657 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1bb7aa-113d-4ea1-aabb-1aab7eb90f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:39.073370 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1bb7aa-113d-4ea1-aabb-1aab7eb90f2a admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:39.073811 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1bb7aa-113d-4ea1-aabb-1aab7eb90f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:39.074067 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1bb7aa-113d-4ea1-aabb-1aab7eb90f2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:39.074851 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1bb7aa-113d-4ea1-aabb-1aab7eb90f2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:39.076467 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1bb7aa-113d-4ea1-aabb-1aab7eb90f2a admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:39.093919 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1082/2181] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:43:39 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:43:39.093919 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1bb7aa-113d-4ea1-aabb-1aab7eb90f2a admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:39.103063 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1bb7aa-113d-4ea1-aabb-1aab7eb90f2a admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:39.108749 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97365b39-864c-4a33-9d64-a912717726ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:39.109744 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97365b39-864c-4a33-9d64-a912717726ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:39.110150 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97365b39-864c-4a33-9d64-a912717726ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:39.110440 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97365b39-864c-4a33-9d64-a912717726ae admin admin] PATH_INFO: `/v3/projects/f31ee2e47e7f402e9557a27066b5652f/users/1e377caaec0c4198afbdfb84f3215249/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:39.127538 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97365b39-864c-4a33-9d64-a912717726ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=f31ee2e47e7f402e9557a27066b5652f, user_id=1e377caaec0c4198afbdfb84f3215249, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:39.130337 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97365b39-864c-4a33-9d64-a912717726ae admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:39.233160 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1083/2182] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:43:39 2022] PUT /identity/v3/projects/f31ee2e47e7f402e9557a27066b5652f/users/1e377caaec0c4198afbdfb84f3215249/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:43:39.238494 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fedf471-3887-4db7-926b-b9951adae6e8 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:39.238787 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fedf471-3887-4db7-926b-b9951adae6e8 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:39.239053 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fedf471-3887-4db7-926b-b9951adae6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:39.249223 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-42b6f7a6-52ba-4381-a28d-f91ca1fa44e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b8c227ea8e64dc19038a37f78e6faa2'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:39.258378 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-2fedf471-3887-4db7-926b-b9951adae6e8 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:43:39.259737 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-2fedf471-3887-4db7-926b-b9951adae6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:39.311993 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-42b6f7a6-52ba-4381-a28d-f91ca1fa44e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b8c227ea8e64dc19038a37f78e6faa2'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:39.312779 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-42b6f7a6-52ba-4381-a28d-f91ca1fa44e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b8c227ea8e64dc19038a37f78e6faa2'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:39.322785 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1084/2183] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:43:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:43:39.336388 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-42b6f7a6-52ba-4381-a28d-f91ca1fa44e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b8c227ea8e64dc19038a37f78e6faa2'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:39.337140 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fedf471-3887-4db7-926b-b9951adae6e8 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:39.337236 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-42b6f7a6-52ba-4381-a28d-f91ca1fa44e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b8c227ea8e64dc19038a37f78e6faa2'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:39.340380 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-2fedf471-3887-4db7-926b-b9951adae6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:39.346428 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1100/2184] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:43:38 2022] DELETE /identity/v3/users/8b8c227ea8e64dc19038a37f78e6faa2 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:43:39.406802 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fedf471-3887-4db7-926b-b9951adae6e8 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:39.465625 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205ab013-7c48-4b02-8d78-8e4bab856666 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:39.466227 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ab013-7c48-4b02-8d78-8e4bab856666 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:39.466498 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ab013-7c48-4b02-8d78-8e4bab856666 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:39.466777 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ab013-7c48-4b02-8d78-8e4bab856666 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:39.563672 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205ab013-7c48-4b02-8d78-8e4bab856666 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:39.565148 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205ab013-7c48-4b02-8d78-8e4bab856666 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:39.575970 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1085/2185] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:43:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:43:39.622585 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b6f7a6-52ba-4381-a28d-f91ca1fa44e5 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:39.624103 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-42b6f7a6-52ba-4381-a28d-f91ca1fa44e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:39.641065 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b6f7a6-52ba-4381-a28d-f91ca1fa44e5 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:39.647993 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6795a61b-7111-4f94-a8ee-e9459b0ab6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:39.649098 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795a61b-7111-4f94-a8ee-e9459b0ab6bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:39.649428 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795a61b-7111-4f94-a8ee-e9459b0ab6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:39.649950 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795a61b-7111-4f94-a8ee-e9459b0ab6bc admin admin] PATH_INFO: `/v3/projects/0be7e80587e44837b04cbf664a5cef93` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:39.651669 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6795a61b-7111-4f94-a8ee-e9459b0ab6bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=0be7e80587e44837b04cbf664a5cef93)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:39.654554 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6795a61b-7111-4f94-a8ee-e9459b0ab6bc admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:39.782398 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-6795a61b-7111-4f94-a8ee-e9459b0ab6bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0be7e80587e44837b04cbf664a5cef93', 'request_id': 'req-6795a61b-7111-4f94-a8ee-e9459b0ab6bc'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:39.788528 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-6795a61b-7111-4f94-a8ee-e9459b0ab6bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0be7e80587e44837b04cbf664a5cef93', 'request_id': 'req-6795a61b-7111-4f94-a8ee-e9459b0ab6bc'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:39.795314 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-6795a61b-7111-4f94-a8ee-e9459b0ab6bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0be7e80587e44837b04cbf664a5cef93', 'request_id': 'req-6795a61b-7111-4f94-a8ee-e9459b0ab6bc'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:39.797208 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=77,keystone:DELETE=20,keystone:INSERT=3 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:39.854254 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-6795a61b-7111-4f94-a8ee-e9459b0ab6bc admin admin] The token cache is being invalidate because project 0be7e80587e44837b04cbf664a5cef93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80392) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:43:39.854557 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-6795a61b-7111-4f94-a8ee-e9459b0ab6bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:39.855835 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-6795a61b-7111-4f94-a8ee-e9459b0ab6bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:39.857457 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1101/2186] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:43:39 2022] DELETE /identity/v3/projects/0be7e80587e44837b04cbf664a5cef93 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:43:39.862059 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205ab013-7c48-4b02-8d78-8e4bab856666 service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:39.872815 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205ab013-7c48-4b02-8d78-8e4bab856666 service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:39.874598 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:39.935745 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd24cdc-8cd8-44f5-8d4e-2c9c457ee8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:39.936632 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd24cdc-8cd8-44f5-8d4e-2c9c457ee8a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:39.936917 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd24cdc-8cd8-44f5-8d4e-2c9c457ee8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:39.937228 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd24cdc-8cd8-44f5-8d4e-2c9c457ee8a5 admin admin] PATH_INFO: `/v3/users/cdd5469c53254381ac438139cb3655d2` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:39.938437 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd24cdc-8cd8-44f5-8d4e-2c9c457ee8a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdd5469c53254381ac438139cb3655d2)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:39.940424 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd24cdc-8cd8-44f5-8d4e-2c9c457ee8a5 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:40.104650 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-ccd24cdc-8cd8-44f5-8d4e-2c9c457ee8a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdd5469c53254381ac438139cb3655d2'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:40.195647 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-ccd24cdc-8cd8-44f5-8d4e-2c9c457ee8a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdd5469c53254381ac438139cb3655d2'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:40.196328 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-ccd24cdc-8cd8-44f5-8d4e-2c9c457ee8a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdd5469c53254381ac438139cb3655d2'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:40.212724 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-ccd24cdc-8cd8-44f5-8d4e-2c9c457ee8a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdd5469c53254381ac438139cb3655d2'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:40.221531 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-ccd24cdc-8cd8-44f5-8d4e-2c9c457ee8a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdd5469c53254381ac438139cb3655d2'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:40.228019 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1086/2187] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:43:39 2022] DELETE /identity/v3/users/cdd5469c53254381ac438139cb3655d2 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:43:40.608425 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6795a61b-7111-4f94-a8ee-e9459b0ab6bc admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:40.610798 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-6795a61b-7111-4f94-a8ee-e9459b0ab6bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:40.626134 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6795a61b-7111-4f94-a8ee-e9459b0ab6bc admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:40.707032 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1e09ad-e1c2-431e-ba96-a9f767293f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:40.707917 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e09ad-e1c2-431e-ba96-a9f767293f02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:40.708203 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e09ad-e1c2-431e-ba96-a9f767293f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:40.708468 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e09ad-e1c2-431e-ba96-a9f767293f02 admin admin] PATH_INFO: `/v3/projects/4b06eb4656fa4ca18f6a72e3b434a20f` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:40.709740 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1e09ad-e1c2-431e-ba96-a9f767293f02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b06eb4656fa4ca18f6a72e3b434a20f)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:40.711953 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1e09ad-e1c2-431e-ba96-a9f767293f02 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:40.845599 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-8a1e09ad-e1c2-431e-ba96-a9f767293f02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b06eb4656fa4ca18f6a72e3b434a20f', 'request_id': 'req-8a1e09ad-e1c2-431e-ba96-a9f767293f02'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:40.856150 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-8a1e09ad-e1c2-431e-ba96-a9f767293f02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b06eb4656fa4ca18f6a72e3b434a20f', 'request_id': 'req-8a1e09ad-e1c2-431e-ba96-a9f767293f02'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:40.866044 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-8a1e09ad-e1c2-431e-ba96-a9f767293f02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b06eb4656fa4ca18f6a72e3b434a20f', 'request_id': 'req-8a1e09ad-e1c2-431e-ba96-a9f767293f02'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:40.969192 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-8a1e09ad-e1c2-431e-ba96-a9f767293f02 admin admin] The token cache is being invalidate because project 4b06eb4656fa4ca18f6a72e3b434a20f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80392) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:43:40.969483 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-8a1e09ad-e1c2-431e-ba96-a9f767293f02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:40.970138 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-8a1e09ad-e1c2-431e-ba96-a9f767293f02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:40.971694 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1102/2188] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:43:40 2022] DELETE /identity/v3/projects/4b06eb4656fa4ca18f6a72e3b434a20f => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:43:40.976835 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5412499-bac0-420f-bc59-38cbe8f50536 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:40.977367 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5412499-bac0-420f-bc59-38cbe8f50536 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:40.979164 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5412499-bac0-420f-bc59-38cbe8f50536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:40.997455 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-c5412499-bac0-420f-bc59-38cbe8f50536 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:43:40.998681 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c5412499-bac0-420f-bc59-38cbe8f50536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:41.046665 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:41.068448 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1087/2189] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:43:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:43:41.086187 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ab14f-fb21-449b-bbf8-42663311709e None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:41.086661 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ab14f-fb21-449b-bbf8-42663311709e None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:41.087187 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ab14f-fb21-449b-bbf8-42663311709e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:41.109416 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-0b1ab14f-fb21-449b-bbf8-42663311709e None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:43:41.110599 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-0b1ab14f-fb21-449b-bbf8-42663311709e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:41.119659 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1103/2190] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:43:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:43:41.125896 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5412499-bac0-420f-bc59-38cbe8f50536 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:41.149427 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5412499-bac0-420f-bc59-38cbe8f50536 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:41.156703 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743948ca-f65f-46fc-8cef-3ed48e30ffbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:41.157915 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743948ca-f65f-46fc-8cef-3ed48e30ffbe admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:41.158407 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743948ca-f65f-46fc-8cef-3ed48e30ffbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:41.158911 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743948ca-f65f-46fc-8cef-3ed48e30ffbe admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:41.160614 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743948ca-f65f-46fc-8cef-3ed48e30ffbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:43:41.162295 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743948ca-f65f-46fc-8cef-3ed48e30ffbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:41.165004 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743948ca-f65f-46fc-8cef-3ed48e30ffbe admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:41.220348 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1088/2191] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 10:43:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:43:41.226923 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1ab14f-fb21-449b-bbf8-42663311709e None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:41.267018 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1ab14f-fb21-449b-bbf8-42663311709e None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:41.285837 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c77152-8d99-472a-8f7e-7f3729b0ea09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:41.288011 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c77152-8d99-472a-8f7e-7f3729b0ea09 admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:41.291422 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c77152-8d99-472a-8f7e-7f3729b0ea09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:41.291969 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c77152-8d99-472a-8f7e-7f3729b0ea09 admin admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:41.297975 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c77152-8d99-472a-8f7e-7f3729b0ea09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:41.307323 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c77152-8d99-472a-8f7e-7f3729b0ea09 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:41.411469 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1104/2192] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:43:41 2022] POST /identity/v3/projects => generated 375 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:43:41.424201 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743948ca-f65f-46fc-8cef-3ed48e30ffbe admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:41.442263 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743948ca-f65f-46fc-8cef-3ed48e30ffbe admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:41.534215 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de743db0-d76d-492d-bec9-b2f1cbcbede1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:41.535441 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de743db0-d76d-492d-bec9-b2f1cbcbede1 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:41.536012 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de743db0-d76d-492d-bec9-b2f1cbcbede1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:41.536578 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de743db0-d76d-492d-bec9-b2f1cbcbede1 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:41.537962 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de743db0-d76d-492d-bec9-b2f1cbcbede1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:41.541693 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de743db0-d76d-492d-bec9-b2f1cbcbede1 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:41.697345 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1089/2193] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:43:41 2022] POST /identity/v3/users => generated 288 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:43:41.702187 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c77152-8d99-472a-8f7e-7f3729b0ea09 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:41.714372 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c77152-8d99-472a-8f7e-7f3729b0ea09 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:41.720882 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0599fe-f2bb-47bb-abf3-dae1aebca1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:41.729935 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0599fe-f2bb-47bb-abf3-dae1aebca1d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:41.729935 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0599fe-f2bb-47bb-abf3-dae1aebca1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:41.729935 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0599fe-f2bb-47bb-abf3-dae1aebca1d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:41.729935 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0599fe-f2bb-47bb-abf3-dae1aebca1d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:41.729935 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0599fe-f2bb-47bb-abf3-dae1aebca1d2 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:41.739699 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1105/2194] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:43:41.744152 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de743db0-d76d-492d-bec9-b2f1cbcbede1 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:41.755599 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de743db0-d76d-492d-bec9-b2f1cbcbede1 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:41.760747 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7bdaa4-c1a9-4d80-a3d8-18ebad53efa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:41.762537 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7bdaa4-c1a9-4d80-a3d8-18ebad53efa0 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:41.762837 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7bdaa4-c1a9-4d80-a3d8-18ebad53efa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:41.763120 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7bdaa4-c1a9-4d80-a3d8-18ebad53efa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:41.763866 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7bdaa4-c1a9-4d80-a3d8-18ebad53efa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:41.765656 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7bdaa4-c1a9-4d80-a3d8-18ebad53efa0 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:41.776760 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1090/2195] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:43:41.781281 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0599fe-f2bb-47bb-abf3-dae1aebca1d2 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:41.792036 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0599fe-f2bb-47bb-abf3-dae1aebca1d2 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:41.798130 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff629ca-6771-4287-9e22-de6e38612b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:41.799289 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff629ca-6771-4287-9e22-de6e38612b14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:41.799785 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff629ca-6771-4287-9e22-de6e38612b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:41.800096 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff629ca-6771-4287-9e22-de6e38612b14 admin admin] PATH_INFO: `/v3/projects/6d688558112b4d75be86cce92a1b8404/users/5749e2db53664bc9a10c4adc897194c2/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:41.818301 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff629ca-6771-4287-9e22-de6e38612b14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d688558112b4d75be86cce92a1b8404, user_id=5749e2db53664bc9a10c4adc897194c2, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:41.820961 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff629ca-6771-4287-9e22-de6e38612b14 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:41.913725 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1106/2196] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:43:41 2022] PUT /identity/v3/projects/6d688558112b4d75be86cce92a1b8404/users/5749e2db53664bc9a10c4adc897194c2/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:43:41.923719 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb04d9-abe6-46d1-a467-60dbccb33461 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:41.924019 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb04d9-abe6-46d1-a467-60dbccb33461 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:41.924305 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb04d9-abe6-46d1-a467-60dbccb33461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:41.965766 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-f9eb04d9-abe6-46d1-a467-60dbccb33461 None None] MFA Rules not processed for user `5749e2db53664bc9a10c4adc897194c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:43:41.967715 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-f9eb04d9-abe6-46d1-a467-60dbccb33461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:42.089584 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1091/2197] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:43:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:43:42.114656 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff629ca-6771-4287-9e22-de6e38612b14 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:42.116825 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-dff629ca-6771-4287-9e22-de6e38612b14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:42.152152 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:INSERT=4,keystone:DELETE=8,keystone:SELECT=88 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:42.238402 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff629ca-6771-4287-9e22-de6e38612b14 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:42.243378 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1e668d-edc1-483f-831a-e59031faf7f8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d1f7d0286745a396905aee50c9410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:42.247460 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e668d-edc1-483f-831a-e59031faf7f8 service glance] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:42.247460 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e668d-edc1-483f-831a-e59031faf7f8 service glance] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:42.247460 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e668d-edc1-483f-831a-e59031faf7f8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:42.256124 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1e668d-edc1-483f-831a-e59031faf7f8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:42.257672 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1e668d-edc1-483f-831a-e59031faf7f8 service glance] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:42.270562 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1107/2198] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:43:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:43:43.929480 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eb04d9-abe6-46d1-a467-60dbccb33461 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:43.938307 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-f9eb04d9-abe6-46d1-a467-60dbccb33461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:44.049410 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:44.085478 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eb04d9-abe6-46d1-a467-60dbccb33461 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:44.103284 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960cb49b-4228-4b33-964f-e14a331dceda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:44.108609 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960cb49b-4228-4b33-964f-e14a331dceda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:44.108609 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960cb49b-4228-4b33-964f-e14a331dceda admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:44.108801 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960cb49b-4228-4b33-964f-e14a331dceda admin admin] PATH_INFO: `/v3/users/af51de992161480d8d05e6a2c7ff6f8d` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:44.110802 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960cb49b-4228-4b33-964f-e14a331dceda admin admin] RBAC: Authorizing `identity:delete_user(user_id=af51de992161480d8d05e6a2c7ff6f8d)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:44.112760 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960cb49b-4228-4b33-964f-e14a331dceda admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:44.425671 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-960cb49b-4228-4b33-964f-e14a331dceda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af51de992161480d8d05e6a2c7ff6f8d'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:44.500235 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-960cb49b-4228-4b33-964f-e14a331dceda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af51de992161480d8d05e6a2c7ff6f8d'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:44.501278 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-960cb49b-4228-4b33-964f-e14a331dceda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af51de992161480d8d05e6a2c7ff6f8d'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:44.517296 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-960cb49b-4228-4b33-964f-e14a331dceda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af51de992161480d8d05e6a2c7ff6f8d'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:44.525628 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-960cb49b-4228-4b33-964f-e14a331dceda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af51de992161480d8d05e6a2c7ff6f8d'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:44.534078 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1092/2199] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:43:43 2022] DELETE /identity/v3/users/af51de992161480d8d05e6a2c7ff6f8d => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:43:44.538600 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f31021-d56b-4dce-96d2-22b27ebbfc5f None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:44.539065 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f31021-d56b-4dce-96d2-22b27ebbfc5f None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:44.539571 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f31021-d56b-4dce-96d2-22b27ebbfc5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:44.561498 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-43f31021-d56b-4dce-96d2-22b27ebbfc5f None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:43:44.563892 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-43f31021-d56b-4dce-96d2-22b27ebbfc5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:44.641794 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1108/2200] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:43:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:43:44.651969 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960cb49b-4228-4b33-964f-e14a331dceda admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:44.654105 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-960cb49b-4228-4b33-964f-e14a331dceda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:44.829911 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960cb49b-4228-4b33-964f-e14a331dceda admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:44.848126 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1056b6f-d14f-4017-88c0-f0881c756b7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:44.849717 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1056b6f-d14f-4017-88c0-f0881c756b7a service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:44.850434 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1056b6f-d14f-4017-88c0-f0881c756b7a service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:44.850922 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1056b6f-d14f-4017-88c0-f0881c756b7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:44.866418 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1056b6f-d14f-4017-88c0-f0881c756b7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:44.871073 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1056b6f-d14f-4017-88c0-f0881c756b7a service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:44.886113 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1093/2201] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:43:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:43:45.976327 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f31021-d56b-4dce-96d2-22b27ebbfc5f None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:45.978294 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-43f31021-d56b-4dce-96d2-22b27ebbfc5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:46.015533 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f31021-d56b-4dce-96d2-22b27ebbfc5f None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:46.031235 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa682ab-0acb-4406-bcc8-afeffe31ef7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:46.032610 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa682ab-0acb-4406-bcc8-afeffe31ef7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:46.032962 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa682ab-0acb-4406-bcc8-afeffe31ef7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:46.035926 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa682ab-0acb-4406-bcc8-afeffe31ef7a admin admin] PATH_INFO: `/v3/projects/65cc2bb256fa4176ba3b9a26615b3975` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:46.035926 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa682ab-0acb-4406-bcc8-afeffe31ef7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=65cc2bb256fa4176ba3b9a26615b3975)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:46.040061 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa682ab-0acb-4406-bcc8-afeffe31ef7a admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:46.214981 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-daa682ab-0acb-4406-bcc8-afeffe31ef7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65cc2bb256fa4176ba3b9a26615b3975', 'request_id': 'req-daa682ab-0acb-4406-bcc8-afeffe31ef7a'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:46.233741 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-daa682ab-0acb-4406-bcc8-afeffe31ef7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65cc2bb256fa4176ba3b9a26615b3975', 'request_id': 'req-daa682ab-0acb-4406-bcc8-afeffe31ef7a'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:46.243960 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-daa682ab-0acb-4406-bcc8-afeffe31ef7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65cc2bb256fa4176ba3b9a26615b3975', 'request_id': 'req-daa682ab-0acb-4406-bcc8-afeffe31ef7a'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:46.313133 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-daa682ab-0acb-4406-bcc8-afeffe31ef7a admin admin] The token cache is being invalidate because project 65cc2bb256fa4176ba3b9a26615b3975 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80392) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:43:46.314620 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-daa682ab-0acb-4406-bcc8-afeffe31ef7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:46.315334 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-daa682ab-0acb-4406-bcc8-afeffe31ef7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:46.316959 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1109/2202] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:43:45 2022] DELETE /identity/v3/projects/65cc2bb256fa4176ba3b9a26615b3975 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:43:46.321348 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1056b6f-d14f-4017-88c0-f0881c756b7a service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:46.332719 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1056b6f-d14f-4017-88c0-f0881c756b7a service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:46.399805 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057d7124-6eaa-4252-bc49-4bed5cbfcbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:46.402128 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057d7124-6eaa-4252-bc49-4bed5cbfcbf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:46.402888 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057d7124-6eaa-4252-bc49-4bed5cbfcbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:46.405066 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057d7124-6eaa-4252-bc49-4bed5cbfcbf3 admin admin] PATH_INFO: `/v3/users/ff6b4207146d4e038870b91a3143dedf` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:46.406863 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057d7124-6eaa-4252-bc49-4bed5cbfcbf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff6b4207146d4e038870b91a3143dedf)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:46.409894 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057d7124-6eaa-4252-bc49-4bed5cbfcbf3 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:46.420651 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:46.749118 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-057d7124-6eaa-4252-bc49-4bed5cbfcbf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff6b4207146d4e038870b91a3143dedf'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:46.860556 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-057d7124-6eaa-4252-bc49-4bed5cbfcbf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff6b4207146d4e038870b91a3143dedf'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:46.861755 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-057d7124-6eaa-4252-bc49-4bed5cbfcbf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff6b4207146d4e038870b91a3143dedf'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:46.922242 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-057d7124-6eaa-4252-bc49-4bed5cbfcbf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff6b4207146d4e038870b91a3143dedf'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:46.955783 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-057d7124-6eaa-4252-bc49-4bed5cbfcbf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff6b4207146d4e038870b91a3143dedf'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:46.972077 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1094/2203] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:43:46 2022] DELETE /identity/v3/users/ff6b4207146d4e038870b91a3143dedf => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:43:47.257415 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6932b5-596e-445c-b752-22360812a1ec None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:47.258381 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6932b5-596e-445c-b752-22360812a1ec None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:47.258856 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6932b5-596e-445c-b752-22360812a1ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:47.314976 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-4b6932b5-596e-445c-b752-22360812a1ec None None] MFA Rules not processed for user `1e377caaec0c4198afbdfb84f3215249`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:43:47.316532 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-4b6932b5-596e-445c-b752-22360812a1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:47.372884 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:47.411692 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1110/2204] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:43:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:43:47.417694 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057d7124-6eaa-4252-bc49-4bed5cbfcbf3 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:47.419541 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-057d7124-6eaa-4252-bc49-4bed5cbfcbf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:47.588829 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057d7124-6eaa-4252-bc49-4bed5cbfcbf3 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:47.597161 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902347c8-b31a-4940-85a5-37ab0a0a8d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:47.597833 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902347c8-b31a-4940-85a5-37ab0a0a8d17 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:47.598113 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902347c8-b31a-4940-85a5-37ab0a0a8d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:47.598387 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902347c8-b31a-4940-85a5-37ab0a0a8d17 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:47.599085 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902347c8-b31a-4940-85a5-37ab0a0a8d17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:47.601090 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902347c8-b31a-4940-85a5-37ab0a0a8d17 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:47.762529 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1095/2205] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:43:47 2022] POST /identity/v3/projects => generated 371 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:43:47.765809 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6932b5-596e-445c-b752-22360812a1ec None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:47.778756 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6932b5-596e-445c-b752-22360812a1ec None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:47.815048 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902347c8-b31a-4940-85a5-37ab0a0a8d17 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:47.817636 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-902347c8-b31a-4940-85a5-37ab0a0a8d17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:47.874229 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf6e5c-8f59-4992-8279-1722b721f19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:47.875157 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf6e5c-8f59-4992-8279-1722b721f19a admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:47.875682 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf6e5c-8f59-4992-8279-1722b721f19a admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:47.876112 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf6e5c-8f59-4992-8279-1722b721f19a admin admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:47.877180 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaf6e5c-8f59-4992-8279-1722b721f19a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:47.879416 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaf6e5c-8f59-4992-8279-1722b721f19a admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:47.917710 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902347c8-b31a-4940-85a5-37ab0a0a8d17 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:47.924101 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078973ae-02cc-4fb4-9001-d1c9f3577073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:47.925430 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078973ae-02cc-4fb4-9001-d1c9f3577073 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:47.925721 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078973ae-02cc-4fb4-9001-d1c9f3577073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:47.926000 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078973ae-02cc-4fb4-9001-d1c9f3577073 admin admin] PATH_INFO: `/v3/projects/5bbbd4a4a33f4e47bbdedac9461fcc66` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:47.927300 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078973ae-02cc-4fb4-9001-d1c9f3577073 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bbbd4a4a33f4e47bbdedac9461fcc66)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:47.929268 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078973ae-02cc-4fb4-9001-d1c9f3577073 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:47.946523 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:47.991392 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1111/2206] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:43:47 2022] POST /identity/v3/users => generated 292 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:43:47.996409 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf6e5c-8f59-4992-8279-1722b721f19a admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:48.008313 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf6e5c-8f59-4992-8279-1722b721f19a admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:48.016637 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf429690-adf5-40f4-a06b-cb3891f6c182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:48.018036 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf429690-adf5-40f4-a06b-cb3891f6c182 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:48.018354 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf429690-adf5-40f4-a06b-cb3891f6c182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:48.018656 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf429690-adf5-40f4-a06b-cb3891f6c182 admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:48.019591 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf429690-adf5-40f4-a06b-cb3891f6c182 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:48.021876 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf429690-adf5-40f4-a06b-cb3891f6c182 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:48.038220 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1112/2207] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:43:47 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:43:48.039341 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf429690-adf5-40f4-a06b-cb3891f6c182 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:48.050494 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf429690-adf5-40f4-a06b-cb3891f6c182 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:48.066638 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-078973ae-02cc-4fb4-9001-d1c9f3577073 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bbbd4a4a33f4e47bbdedac9461fcc66', 'request_id': 'req-078973ae-02cc-4fb4-9001-d1c9f3577073'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:48.076256 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-078973ae-02cc-4fb4-9001-d1c9f3577073 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bbbd4a4a33f4e47bbdedac9461fcc66', 'request_id': 'req-078973ae-02cc-4fb4-9001-d1c9f3577073'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:48.095155 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-078973ae-02cc-4fb4-9001-d1c9f3577073 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bbbd4a4a33f4e47bbdedac9461fcc66', 'request_id': 'req-078973ae-02cc-4fb4-9001-d1c9f3577073'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:48.166542 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ba5f07-3070-4c60-93dc-87157647251a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:48.168796 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba5f07-3070-4c60-93dc-87157647251a admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:48.168796 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba5f07-3070-4c60-93dc-87157647251a admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:48.169241 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba5f07-3070-4c60-93dc-87157647251a admin admin] PATH_INFO: `/v3/projects/b17c3cd090fa4b1c897f99169cd19a54/users/06bf1b42960a450ea0076a0d1a953b62/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:48.197789 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ba5f07-3070-4c60-93dc-87157647251a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b17c3cd090fa4b1c897f99169cd19a54, user_id=06bf1b42960a450ea0076a0d1a953b62, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:48.204182 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ba5f07-3070-4c60-93dc-87157647251a admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:48.226587 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-078973ae-02cc-4fb4-9001-d1c9f3577073 admin admin] The token cache is being invalidate because project 5bbbd4a4a33f4e47bbdedac9461fcc66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:43:48.227075 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-078973ae-02cc-4fb4-9001-d1c9f3577073 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:48.227848 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-078973ae-02cc-4fb4-9001-d1c9f3577073 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:48.229763 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1096/2208] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:43:47 2022] DELETE /identity/v3/projects/5bbbd4a4a33f4e47bbdedac9461fcc66 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:43:48.233888 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078973ae-02cc-4fb4-9001-d1c9f3577073 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:48.235394 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-078973ae-02cc-4fb4-9001-d1c9f3577073 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:48.252581 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078973ae-02cc-4fb4-9001-d1c9f3577073 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:48.265408 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab501c8-d485-4b41-90b6-7db0bcb766c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:48.265408 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab501c8-d485-4b41-90b6-7db0bcb766c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:48.265408 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab501c8-d485-4b41-90b6-7db0bcb766c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:48.266560 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab501c8-d485-4b41-90b6-7db0bcb766c8 admin admin] PATH_INFO: `/v3/users/0071cea5a779419eb04a7b332cfba674` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:48.267748 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab501c8-d485-4b41-90b6-7db0bcb766c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0071cea5a779419eb04a7b332cfba674)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:48.270112 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab501c8-d485-4b41-90b6-7db0bcb766c8 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:48.346979 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1113/2209] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:43:48 2022] PUT /identity/v3/projects/b17c3cd090fa4b1c897f99169cd19a54/users/06bf1b42960a450ea0076a0d1a953b62/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:43:48.353403 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ba5f07-3070-4c60-93dc-87157647251a admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:48.356821 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-11ba5f07-3070-4c60-93dc-87157647251a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:48.486348 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ba5f07-3070-4c60-93dc-87157647251a admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:48.491220 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78afb98-cc6b-4bf5-b5e1-9fd76009688d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:48.491920 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78afb98-cc6b-4bf5-b5e1-9fd76009688d admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:48.492253 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78afb98-cc6b-4bf5-b5e1-9fd76009688d admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:48.492539 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78afb98-cc6b-4bf5-b5e1-9fd76009688d admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:48.493314 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78afb98-cc6b-4bf5-b5e1-9fd76009688d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:48.498745 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78afb98-cc6b-4bf5-b5e1-9fd76009688d admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:48.514989 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1114/2210] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:43:48 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:43:48.519083 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78afb98-cc6b-4bf5-b5e1-9fd76009688d admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:48.541160 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-0ab501c8-d485-4b41-90b6-7db0bcb766c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0071cea5a779419eb04a7b332cfba674'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:48.541665 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78afb98-cc6b-4bf5-b5e1-9fd76009688d admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:48.554144 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e38e8-d0d2-4a69-8fc7-57865d698829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:48.555567 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e38e8-d0d2-4a69-8fc7-57865d698829 admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:48.555990 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e38e8-d0d2-4a69-8fc7-57865d698829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:48.556426 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e38e8-d0d2-4a69-8fc7-57865d698829 admin admin] PATH_INFO: `/v3/projects/b17c3cd090fa4b1c897f99169cd19a54/users/06bf1b42960a450ea0076a0d1a953b62/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:48.560525 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577e38e8-d0d2-4a69-8fc7-57865d698829 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b17c3cd090fa4b1c897f99169cd19a54, user_id=06bf1b42960a450ea0076a0d1a953b62, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:48.565719 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577e38e8-d0d2-4a69-8fc7-57865d698829 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:48.586093 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1115/2211] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:43:48 2022] PUT /identity/v3/projects/b17c3cd090fa4b1c897f99169cd19a54/users/06bf1b42960a450ea0076a0d1a953b62/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:43:48.638739 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-0ab501c8-d485-4b41-90b6-7db0bcb766c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0071cea5a779419eb04a7b332cfba674'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:48.642282 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-0ab501c8-d485-4b41-90b6-7db0bcb766c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0071cea5a779419eb04a7b332cfba674'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:48.644183 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:48.654517 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-0ab501c8-d485-4b41-90b6-7db0bcb766c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0071cea5a779419eb04a7b332cfba674'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:48.662033 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-0ab501c8-d485-4b41-90b6-7db0bcb766c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0071cea5a779419eb04a7b332cfba674'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:48.669311 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1097/2212] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:43:48 2022] DELETE /identity/v3/users/0071cea5a779419eb04a7b332cfba674 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:43:49.322774 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e38e8-d0d2-4a69-8fc7-57865d698829 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:49.325344 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-577e38e8-d0d2-4a69-8fc7-57865d698829 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:49.468884 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e38e8-d0d2-4a69-8fc7-57865d698829 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:49.679122 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93c02d-59ab-4f8d-8bb0-ec649028adfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:49.680545 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93c02d-59ab-4f8d-8bb0-ec649028adfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:49.682824 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93c02d-59ab-4f8d-8bb0-ec649028adfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:49.683360 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93c02d-59ab-4f8d-8bb0-ec649028adfe admin admin] PATH_INFO: `/v3/projects/b4ca0cafc4c946c3aa465922f5864ab9` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:49.687893 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf93c02d-59ab-4f8d-8bb0-ec649028adfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4ca0cafc4c946c3aa465922f5864ab9)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:49.695596 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf93c02d-59ab-4f8d-8bb0-ec649028adfe admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:49.874285 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-cf93c02d-59ab-4f8d-8bb0-ec649028adfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4ca0cafc4c946c3aa465922f5864ab9', 'request_id': 'req-cf93c02d-59ab-4f8d-8bb0-ec649028adfe'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:49.885382 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-cf93c02d-59ab-4f8d-8bb0-ec649028adfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4ca0cafc4c946c3aa465922f5864ab9', 'request_id': 'req-cf93c02d-59ab-4f8d-8bb0-ec649028adfe'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:49.908530 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-cf93c02d-59ab-4f8d-8bb0-ec649028adfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4ca0cafc4c946c3aa465922f5864ab9', 'request_id': 'req-cf93c02d-59ab-4f8d-8bb0-ec649028adfe'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:49.913888 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:50.019080 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-cf93c02d-59ab-4f8d-8bb0-ec649028adfe admin admin] The token cache is being invalidate because project b4ca0cafc4c946c3aa465922f5864ab9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80392) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:43:50.019515 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-cf93c02d-59ab-4f8d-8bb0-ec649028adfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:50.020468 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-cf93c02d-59ab-4f8d-8bb0-ec649028adfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:43:50.023285 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1116/2213] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:43:49 2022] DELETE /identity/v3/projects/b4ca0cafc4c946c3aa465922f5864ab9 => generated 0 bytes in 701 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:43:50.032377 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bdbda5-5a9e-4c5d-9fb9-e2ef2d10fc28 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:50.034215 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bdbda5-5a9e-4c5d-9fb9-e2ef2d10fc28 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:50.035197 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bdbda5-5a9e-4c5d-9fb9-e2ef2d10fc28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:50.069676 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-68bdbda5-5a9e-4c5d-9fb9-e2ef2d10fc28 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:43:50.071239 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-68bdbda5-5a9e-4c5d-9fb9-e2ef2d10fc28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:50.219319 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1098/2214] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:43:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:43:50.238163 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24528e-6541-4831-9482-ecba2df1df4b None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:50.238962 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24528e-6541-4831-9482-ecba2df1df4b None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:50.239810 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24528e-6541-4831-9482-ecba2df1df4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:50.344514 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-0e24528e-6541-4831-9482-ecba2df1df4b None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:43:50.346690 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-0e24528e-6541-4831-9482-ecba2df1df4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:50.398695 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1117/2215] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:43:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:43:50.416446 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bdbda5-5a9e-4c5d-9fb9-e2ef2d10fc28 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:50.450161 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bdbda5-5a9e-4c5d-9fb9-e2ef2d10fc28 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:50.460156 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa2493-d838-41b1-8ddc-e2c832f79b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:50.460908 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa2493-d838-41b1-8ddc-e2c832f79b7e admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:50.461234 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa2493-d838-41b1-8ddc-e2c832f79b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:50.461516 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa2493-d838-41b1-8ddc-e2c832f79b7e admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:50.462267 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aa2493-d838-41b1-8ddc-e2c832f79b7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:43:50.462577 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aa2493-d838-41b1-8ddc-e2c832f79b7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:50.465411 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aa2493-d838-41b1-8ddc-e2c832f79b7e admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:50.473720 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:50.488029 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1099/2216] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 10:43:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:43:50.489208 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e24528e-6541-4831-9482-ecba2df1df4b None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:50.499624 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e24528e-6541-4831-9482-ecba2df1df4b None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:50.504900 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3929d420-7059-4f0c-b66d-cef6231c2f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:50.505605 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929d420-7059-4f0c-b66d-cef6231c2f3f admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:50.505929 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929d420-7059-4f0c-b66d-cef6231c2f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:50.506215 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929d420-7059-4f0c-b66d-cef6231c2f3f admin admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:50.506909 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3929d420-7059-4f0c-b66d-cef6231c2f3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:50.509012 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3929d420-7059-4f0c-b66d-cef6231c2f3f admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:50.642339 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1118/2217] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:43:50 2022] POST /identity/v3/projects => generated 371 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:43:50.643772 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa2493-d838-41b1-8ddc-e2c832f79b7e admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:50.662424 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa2493-d838-41b1-8ddc-e2c832f79b7e admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:50.769218 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1d7e3-9a02-4979-a7ef-b5880ab9586e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:50.777839 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1d7e3-9a02-4979-a7ef-b5880ab9586e admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:50.777839 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1d7e3-9a02-4979-a7ef-b5880ab9586e admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:50.777839 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1d7e3-9a02-4979-a7ef-b5880ab9586e admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:50.777839 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d1d7e3-9a02-4979-a7ef-b5880ab9586e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:50.777839 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d1d7e3-9a02-4979-a7ef-b5880ab9586e admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:50.888950 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3929d420-7059-4f0c-b66d-cef6231c2f3f admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:50.890279 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1100/2218] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:43:50 2022] POST /identity/v3/users => generated 286 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:43:50.913891 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3929d420-7059-4f0c-b66d-cef6231c2f3f admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:50.926556 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d597e2b-01f9-4e37-b743-57eec65f4d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:50.928595 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d597e2b-01f9-4e37-b743-57eec65f4d25 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:50.929424 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d597e2b-01f9-4e37-b743-57eec65f4d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:50.930158 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d597e2b-01f9-4e37-b743-57eec65f4d25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:50.932368 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d597e2b-01f9-4e37-b743-57eec65f4d25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:50.936314 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d597e2b-01f9-4e37-b743-57eec65f4d25 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:50.962525 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1119/2219] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:43:50 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:43:50.967469 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1d7e3-9a02-4979-a7ef-b5880ab9586e admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:50.980155 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1d7e3-9a02-4979-a7ef-b5880ab9586e admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:50.986850 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78303610-8993-4c9e-9bb2-9f4b10f16d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:50.987757 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78303610-8993-4c9e-9bb2-9f4b10f16d38 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:50.988193 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78303610-8993-4c9e-9bb2-9f4b10f16d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:50.988776 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78303610-8993-4c9e-9bb2-9f4b10f16d38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:51.002334 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78303610-8993-4c9e-9bb2-9f4b10f16d38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:51.004661 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78303610-8993-4c9e-9bb2-9f4b10f16d38 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:51.025389 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1101/2220] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:43:50 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:43:51.031014 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d597e2b-01f9-4e37-b743-57eec65f4d25 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:51.066096 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d597e2b-01f9-4e37-b743-57eec65f4d25 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:51.078918 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcecdd6-3b87-4dd1-97ab-ef4a9cde5f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:51.078918 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcecdd6-3b87-4dd1-97ab-ef4a9cde5f27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:51.078918 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcecdd6-3b87-4dd1-97ab-ef4a9cde5f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:51.078918 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcecdd6-3b87-4dd1-97ab-ef4a9cde5f27 admin admin] PATH_INFO: `/v3/projects/a12c028b8bc04f108ddc4ab0ef8e790b/users/577081e487104746a91052400adb2831/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:51.102507 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcecdd6-3b87-4dd1-97ab-ef4a9cde5f27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a12c028b8bc04f108ddc4ab0ef8e790b, user_id=577081e487104746a91052400adb2831, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:51.109238 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcecdd6-3b87-4dd1-97ab-ef4a9cde5f27 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:51.191477 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1120/2221] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:43:51 2022] PUT /identity/v3/projects/a12c028b8bc04f108ddc4ab0ef8e790b/users/577081e487104746a91052400adb2831/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:43:51.205515 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650abb8b-da92-4270-a5b7-90ac9e3fa92f None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:51.206089 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650abb8b-da92-4270-a5b7-90ac9e3fa92f None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:51.206089 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650abb8b-da92-4270-a5b7-90ac9e3fa92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:51.283050 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-650abb8b-da92-4270-a5b7-90ac9e3fa92f None None] MFA Rules not processed for user `577081e487104746a91052400adb2831`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:43:51.290311 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-650abb8b-da92-4270-a5b7-90ac9e3fa92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:51.498848 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1102/2222] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:43:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:43:51.524949 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcecdd6-3b87-4dd1-97ab-ef4a9cde5f27 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:51.528112 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-7fcecdd6-3b87-4dd1-97ab-ef4a9cde5f27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:51.675557 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcecdd6-3b87-4dd1-97ab-ef4a9cde5f27 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:51.680617 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0248e37-d5f4-4bf5-8899-6e4ff2fa1eba service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d1f7d0286745a396905aee50c9410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:51.682876 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0248e37-d5f4-4bf5-8899-6e4ff2fa1eba service glance] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:51.683901 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0248e37-d5f4-4bf5-8899-6e4ff2fa1eba service glance] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:51.684571 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0248e37-d5f4-4bf5-8899-6e4ff2fa1eba service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:51.703565 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0248e37-d5f4-4bf5-8899-6e4ff2fa1eba service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:51.706830 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0248e37-d5f4-4bf5-8899-6e4ff2fa1eba service glance] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:51.734282 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1121/2223] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:43:51 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:43:58.178208 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b9409-ec31-4662-8a02-c474ec79754e None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:58.179275 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b9409-ec31-4662-8a02-c474ec79754e None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:58.179744 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b9409-ec31-4662-8a02-c474ec79754e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:58.235011 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-530b9409-ec31-4662-8a02-c474ec79754e None None] MFA Rules not processed for user `06bf1b42960a450ea0076a0d1a953b62`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:43:58.235011 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-530b9409-ec31-4662-8a02-c474ec79754e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:58.336599 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:58.369735 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1103/2224] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:43:58 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:43:58.385986 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0248e37-d5f4-4bf5-8899-6e4ff2fa1eba service glance] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:43:58.388072 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-b0248e37-d5f4-4bf5-8899-6e4ff2fa1eba service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:58.514903 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0248e37-d5f4-4bf5-8899-6e4ff2fa1eba service glance] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:43:58.521566 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9330ac-3869-4ab5-973f-8e219004b1c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bbebf16219943879df84bdc9a900516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:43:58.522325 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9330ac-3869-4ab5-973f-8e219004b1c8 service nova] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:43:58.522680 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9330ac-3869-4ab5-973f-8e219004b1c8 service nova] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:43:58.523025 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9330ac-3869-4ab5-973f-8e219004b1c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:43:58.525020 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-3f9330ac-3869-4ab5-973f-8e219004b1c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:43:58.572961 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:58.623591 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9330ac-3869-4ab5-973f-8e219004b1c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:43:58.625204 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9330ac-3869-4ab5-973f-8e219004b1c8 service nova] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:43:58.634680 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1122/2225] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:43:58 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:44:02.968430 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26891ba-b292-4a72-91da-292b182d1b8b None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:02.969022 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26891ba-b292-4a72-91da-292b182d1b8b None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:02.969022 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26891ba-b292-4a72-91da-292b182d1b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:02.996075 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-b26891ba-b292-4a72-91da-292b182d1b8b None None] MFA Rules not processed for user `1e377caaec0c4198afbdfb84f3215249`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:44:02.998031 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-b26891ba-b292-4a72-91da-292b182d1b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:03.006277 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1104/2226] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:44:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:44:03.983084 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9330ac-3869-4ab5-973f-8e219004b1c8 service nova] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:03.984578 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-3f9330ac-3869-4ab5-973f-8e219004b1c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:04.091106 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9330ac-3869-4ab5-973f-8e219004b1c8 service nova] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:04.114202 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6b5c3a-a1f5-4d70-aeb7-676026e0477a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:04.115118 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b5c3a-a1f5-4d70-aeb7-676026e0477a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:04.115408 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b5c3a-a1f5-4d70-aeb7-676026e0477a admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:04.117274 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b5c3a-a1f5-4d70-aeb7-676026e0477a admin admin] PATH_INFO: `/v3/users/5749e2db53664bc9a10c4adc897194c2` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:04.127921 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6b5c3a-a1f5-4d70-aeb7-676026e0477a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5749e2db53664bc9a10c4adc897194c2)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:04.138770 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6b5c3a-a1f5-4d70-aeb7-676026e0477a admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:04.372857 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-8f6b5c3a-a1f5-4d70-aeb7-676026e0477a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5749e2db53664bc9a10c4adc897194c2'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:04.562316 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-8f6b5c3a-a1f5-4d70-aeb7-676026e0477a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5749e2db53664bc9a10c4adc897194c2'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:04.562969 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-8f6b5c3a-a1f5-4d70-aeb7-676026e0477a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5749e2db53664bc9a10c4adc897194c2'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:04.589987 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-8f6b5c3a-a1f5-4d70-aeb7-676026e0477a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5749e2db53664bc9a10c4adc897194c2'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:04.593479 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e92b41-f316-448e-b9db-84f4b93b897e None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:04.593950 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e92b41-f316-448e-b9db-84f4b93b897e None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:04.594050 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e92b41-f316-448e-b9db-84f4b93b897e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:04.599237 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-8f6b5c3a-a1f5-4d70-aeb7-676026e0477a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5749e2db53664bc9a10c4adc897194c2'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:04.609101 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1123/2227] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:44:03 2022] DELETE /identity/v3/users/5749e2db53664bc9a10c4adc897194c2 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:44:04.615653 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423d31e-4e99-4c8c-92d6-94e93f70fbf1 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:04.615953 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423d31e-4e99-4c8c-92d6-94e93f70fbf1 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:04.616286 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423d31e-4e99-4c8c-92d6-94e93f70fbf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:04.620621 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-95e92b41-f316-448e-b9db-84f4b93b897e None None] MFA Rules not processed for user `88ad60446c5447a8bbd0096fa2133efb`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:44:04.622155 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-95e92b41-f316-448e-b9db-84f4b93b897e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:04.639868 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-4423d31e-4e99-4c8c-92d6-94e93f70fbf1 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:44:04.641211 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-4423d31e-4e99-4c8c-92d6-94e93f70fbf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:04.703485 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1105/2228] 10.222.0.39 () {58 vars in 1009 bytes} [Mon Jul 18 10:44:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:44:04.716286 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:44:04.743423 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1124/2229] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:44:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:44:04.757549 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e92b41-f316-448e-b9db-84f4b93b897e None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:04.759040 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423d31e-4e99-4c8c-92d6-94e93f70fbf1 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:04.760680 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-95e92b41-f316-448e-b9db-84f4b93b897e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:04.761853 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-4423d31e-4e99-4c8c-92d6-94e93f70fbf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:04.852215 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e92b41-f316-448e-b9db-84f4b93b897e None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:04.858564 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d9524b-865f-4f15-906d-2331c4a5c3d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:04.859555 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9524b-865f-4f15-906d-2331c4a5c3d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:04.860089 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9524b-865f-4f15-906d-2331c4a5c3d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:04.860585 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9524b-865f-4f15-906d-2331c4a5c3d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:04.875110 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423d31e-4e99-4c8c-92d6-94e93f70fbf1 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:04.877510 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d9524b-865f-4f15-906d-2331c4a5c3d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:04.879704 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d9524b-865f-4f15-906d-2331c4a5c3d7 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:04.881676 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a5743-67eb-4a06-9fae-697d23766122 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c548474a8d94591ba58dd40e40a28d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:04.882611 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a5743-67eb-4a06-9fae-697d23766122 service swift] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:04.889059 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a5743-67eb-4a06-9fae-697d23766122 service swift] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:04.889059 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a5743-67eb-4a06-9fae-697d23766122 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:04.893012 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368a5743-67eb-4a06-9fae-697d23766122 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:04.894887 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368a5743-67eb-4a06-9fae-697d23766122 service swift] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:04.898360 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1106/2230] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:44:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:44:04.904961 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1125/2231] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Jul 18 10:44:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 18 10:44:05.854325 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d9524b-865f-4f15-906d-2331c4a5c3d7 service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:05.854929 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-73d9524b-865f-4f15-906d-2331c4a5c3d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:05.920065 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d9524b-865f-4f15-906d-2331c4a5c3d7 service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:05.932137 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a454296-d7f4-4927-be29-9f039417928b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:05.933710 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a454296-d7f4-4927-be29-9f039417928b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:05.934178 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a454296-d7f4-4927-be29-9f039417928b admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:05.934617 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a454296-d7f4-4927-be29-9f039417928b admin admin] PATH_INFO: `/v3/projects/6d688558112b4d75be86cce92a1b8404` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:05.938278 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a454296-d7f4-4927-be29-9f039417928b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d688558112b4d75be86cce92a1b8404)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:05.940350 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a454296-d7f4-4927-be29-9f039417928b admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:06.148434 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df8edd-e442-48e7-83b6-de7b345701e1 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:06.153606 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df8edd-e442-48e7-83b6-de7b345701e1 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:06.157718 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df8edd-e442-48e7-83b6-de7b345701e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:06.248942 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-0a454296-d7f4-4927-be29-9f039417928b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d688558112b4d75be86cce92a1b8404', 'request_id': 'req-0a454296-d7f4-4927-be29-9f039417928b'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:06.263652 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-43df8edd-e442-48e7-83b6-de7b345701e1 None None] MFA Rules not processed for user `de532a6dce8247e79bd8285220297a50`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:44:06.268072 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-43df8edd-e442-48e7-83b6-de7b345701e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:06.274007 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-0a454296-d7f4-4927-be29-9f039417928b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d688558112b4d75be86cce92a1b8404', 'request_id': 'req-0a454296-d7f4-4927-be29-9f039417928b'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:06.313433 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-0a454296-d7f4-4927-be29-9f039417928b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d688558112b4d75be86cce92a1b8404', 'request_id': 'req-0a454296-d7f4-4927-be29-9f039417928b'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:06.414064 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1126/2232] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:44:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:44:06.511766 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-0a454296-d7f4-4927-be29-9f039417928b admin admin] The token cache is being invalidate because project 6d688558112b4d75be86cce92a1b8404 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:44:06.514894 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-0a454296-d7f4-4927-be29-9f039417928b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:06.514894 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-0a454296-d7f4-4927-be29-9f039417928b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:06.519938 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1107/2233] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:44:05 2022] DELETE /identity/v3/projects/6d688558112b4d75be86cce92a1b8404 => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:44:06.521904 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0915d26-082e-4777-b30e-67cbf9f463c1 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:06.522213 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0915d26-082e-4777-b30e-67cbf9f463c1 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:06.522597 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0915d26-082e-4777-b30e-67cbf9f463c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:06.585361 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-a0915d26-082e-4777-b30e-67cbf9f463c1 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:44:06.586606 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-a0915d26-082e-4777-b30e-67cbf9f463c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:06.738368 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1127/2234] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:44:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:44:06.748108 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473513f-298f-4fee-9706-03f28fa447d0 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:06.748392 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473513f-298f-4fee-9706-03f28fa447d0 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:06.748666 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473513f-298f-4fee-9706-03f28fa447d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:06.787074 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-8473513f-298f-4fee-9706-03f28fa447d0 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:44:06.789072 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-8473513f-298f-4fee-9706-03f28fa447d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:06.804675 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1108/2235] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:44:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:44:06.813754 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0915d26-082e-4777-b30e-67cbf9f463c1 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:06.829899 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0915d26-082e-4777-b30e-67cbf9f463c1 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:06.842748 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5303cb5e-9f38-4658-9185-d6817627ddac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:06.846305 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5303cb5e-9f38-4658-9185-d6817627ddac admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:06.846305 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5303cb5e-9f38-4658-9185-d6817627ddac admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:06.846305 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5303cb5e-9f38-4658-9185-d6817627ddac admin admin] PATH_INFO: `/v3/domains` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:06.846305 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5303cb5e-9f38-4658-9185-d6817627ddac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:44:06.846305 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5303cb5e-9f38-4658-9185-d6817627ddac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:06.849346 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5303cb5e-9f38-4658-9185-d6817627ddac admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:06.875694 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1128/2236] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 10:44:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:44:06.877947 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8473513f-298f-4fee-9706-03f28fa447d0 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:06.893077 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8473513f-298f-4fee-9706-03f28fa447d0 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:06.899248 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad192c-2b62-4d4e-adfc-1afb60f122e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:06.900255 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad192c-2b62-4d4e-adfc-1afb60f122e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:06.900714 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad192c-2b62-4d4e-adfc-1afb60f122e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:06.901214 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad192c-2b62-4d4e-adfc-1afb60f122e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:06.902328 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ad192c-2b62-4d4e-adfc-1afb60f122e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:06.904678 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ad192c-2b62-4d4e-adfc-1afb60f122e8 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:06.910627 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:44:07.056295 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1109/2237] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:44:06 2022] POST /identity/v3/projects => generated 363 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:44:07.058103 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5303cb5e-9f38-4658-9185-d6817627ddac admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:07.079041 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5303cb5e-9f38-4658-9185-d6817627ddac admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:07.099095 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:44:07.203296 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127dd172-b4b7-43cd-9ff5-339372840f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:07.204125 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127dd172-b4b7-43cd-9ff5-339372840f73 admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:07.204346 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127dd172-b4b7-43cd-9ff5-339372840f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:07.204532 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127dd172-b4b7-43cd-9ff5-339372840f73 admin admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:07.205259 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127dd172-b4b7-43cd-9ff5-339372840f73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:07.207470 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127dd172-b4b7-43cd-9ff5-339372840f73 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:07.295683 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad192c-2b62-4d4e-adfc-1afb60f122e8 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:07.297526 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-81ad192c-2b62-4d4e-adfc-1afb60f122e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:07.319251 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1129/2238] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:44:07 2022] POST /identity/v3/users => generated 282 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:44:07.324293 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127dd172-b4b7-43cd-9ff5-339372840f73 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:07.342911 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad192c-2b62-4d4e-adfc-1afb60f122e8 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:07.348070 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127dd172-b4b7-43cd-9ff5-339372840f73 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:07.355954 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f008f91-77ea-4bec-8201-c2d8904e8537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:07.358241 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f008f91-77ea-4bec-8201-c2d8904e8537 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:07.358241 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f008f91-77ea-4bec-8201-c2d8904e8537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:07.358241 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f008f91-77ea-4bec-8201-c2d8904e8537 admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:07.358968 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff7a62d-ee13-43a9-9287-3a28df4a28ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:07.361214 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff7a62d-ee13-43a9-9287-3a28df4a28ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:07.361503 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff7a62d-ee13-43a9-9287-3a28df4a28ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:07.361625 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f008f91-77ea-4bec-8201-c2d8904e8537 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:07.361910 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff7a62d-ee13-43a9-9287-3a28df4a28ef admin admin] PATH_INFO: `/v3/users/ff419427ce554a10bd9c7605a216b27e` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:07.363741 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff7a62d-ee13-43a9-9287-3a28df4a28ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff419427ce554a10bd9c7605a216b27e)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:07.364629 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f008f91-77ea-4bec-8201-c2d8904e8537 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:07.367252 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff7a62d-ee13-43a9-9287-3a28df4a28ef admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:07.420929 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1130/2239] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:44:07 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:44:07.432141 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f008f91-77ea-4bec-8201-c2d8904e8537 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:07.443943 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f008f91-77ea-4bec-8201-c2d8904e8537 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:07.449549 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8bf6a9-b941-4f8a-8546-aa3831422a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:07.450260 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8bf6a9-b941-4f8a-8546-aa3831422a99 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:07.450652 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8bf6a9-b941-4f8a-8546-aa3831422a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:07.450855 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8bf6a9-b941-4f8a-8546-aa3831422a99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:07.451574 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8bf6a9-b941-4f8a-8546-aa3831422a99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:07.456583 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8bf6a9-b941-4f8a-8546-aa3831422a99 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:07.475153 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1131/2240] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:44:07 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:44:07.478285 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8bf6a9-b941-4f8a-8546-aa3831422a99 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:07.493466 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8bf6a9-b941-4f8a-8546-aa3831422a99 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:07.501223 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5753ee0-c9b1-4583-b264-58adac56497c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:07.503293 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5753ee0-c9b1-4583-b264-58adac56497c admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:07.503686 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5753ee0-c9b1-4583-b264-58adac56497c admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:07.503969 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5753ee0-c9b1-4583-b264-58adac56497c admin admin] PATH_INFO: `/v3/projects/d9d5d870b1b14c7a989c0a304ef4da7c/users/75fd2cec14f4445bb4c1e26c10d04d36/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:07.530067 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5753ee0-c9b1-4583-b264-58adac56497c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9d5d870b1b14c7a989c0a304ef4da7c, user_id=75fd2cec14f4445bb4c1e26c10d04d36, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:07.532773 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5753ee0-c9b1-4583-b264-58adac56497c admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:07.605184 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-eff7a62d-ee13-43a9-9287-3a28df4a28ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff419427ce554a10bd9c7605a216b27e'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:07.638097 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1132/2241] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:44:07 2022] PUT /identity/v3/projects/d9d5d870b1b14c7a989c0a304ef4da7c/users/75fd2cec14f4445bb4c1e26c10d04d36/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:44:07.649907 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72430575-8387-4a81-93be-594ae9fc2b73 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:07.651077 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72430575-8387-4a81-93be-594ae9fc2b73 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:07.651600 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72430575-8387-4a81-93be-594ae9fc2b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:07.685461 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-72430575-8387-4a81-93be-594ae9fc2b73 None None] MFA Rules not processed for user `75fd2cec14f4445bb4c1e26c10d04d36`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:44:07.687674 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-eff7a62d-ee13-43a9-9287-3a28df4a28ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff419427ce554a10bd9c7605a216b27e'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:07.688791 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-eff7a62d-ee13-43a9-9287-3a28df4a28ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff419427ce554a10bd9c7605a216b27e'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:07.692075 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-72430575-8387-4a81-93be-594ae9fc2b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:07.710027 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-eff7a62d-ee13-43a9-9287-3a28df4a28ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff419427ce554a10bd9c7605a216b27e'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:07.720397 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-eff7a62d-ee13-43a9-9287-3a28df4a28ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff419427ce554a10bd9c7605a216b27e'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:07.730353 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1110/2242] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:44:07 2022] DELETE /identity/v3/users/ff419427ce554a10bd9c7605a216b27e => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:44:07.735382 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a0716-f6b8-4adc-bd1c-86a53a95def9 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:07.735806 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a0716-f6b8-4adc-bd1c-86a53a95def9 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:07.736201 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a0716-f6b8-4adc-bd1c-86a53a95def9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:07.760724 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-7d7a0716-f6b8-4adc-bd1c-86a53a95def9 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:44:07.762306 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-7d7a0716-f6b8-4adc-bd1c-86a53a95def9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:07.813589 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1133/2243] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:44:07 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:44:07.824585 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72430575-8387-4a81-93be-594ae9fc2b73 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:07.827026 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-72430575-8387-4a81-93be-594ae9fc2b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:07.874079 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1111/2244] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:44:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:44:07.890886 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a0716-f6b8-4adc-bd1c-86a53a95def9 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:07.894668 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-7d7a0716-f6b8-4adc-bd1c-86a53a95def9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:07.940525 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:44:07.960868 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72430575-8387-4a81-93be-594ae9fc2b73 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:08.000896 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a0716-f6b8-4adc-bd1c-86a53a95def9 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:08.005793 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d4d6a0-66d6-4d41-b760-98845b8df4b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:08.006782 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d4d6a0-66d6-4d41-b760-98845b8df4b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:08.007270 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d4d6a0-66d6-4d41-b760-98845b8df4b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:08.007908 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d4d6a0-66d6-4d41-b760-98845b8df4b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:08.040658 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d4d6a0-66d6-4d41-b760-98845b8df4b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:08.044362 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d4d6a0-66d6-4d41-b760-98845b8df4b0 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:08.060932 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1112/2245] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:44:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:44:08.097929 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0806907f-3bdf-46bd-b97c-f8b816e664c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:08.098640 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806907f-3bdf-46bd-b97c-f8b816e664c8 service cinder] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:08.099117 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806907f-3bdf-46bd-b97c-f8b816e664c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:08.099407 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0806907f-3bdf-46bd-b97c-f8b816e664c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:08.242563 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0806907f-3bdf-46bd-b97c-f8b816e664c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:08.244588 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0806907f-3bdf-46bd-b97c-f8b816e664c8 service cinder] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:08.256582 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1134/2246] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:44:07 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:44:08.863983 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d4d6a0-66d6-4d41-b760-98845b8df4b0 service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:08.863983 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-b4d4d6a0-66d6-4d41-b760-98845b8df4b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:08.874660 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:44:08.886687 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d4d6a0-66d6-4d41-b760-98845b8df4b0 service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:08.899700 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c7aa5-b5c7-4907-91fa-8c54aed9c9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:08.902259 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c7aa5-b5c7-4907-91fa-8c54aed9c9b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:08.902672 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c7aa5-b5c7-4907-91fa-8c54aed9c9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:08.903020 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c7aa5-b5c7-4907-91fa-8c54aed9c9b3 admin admin] PATH_INFO: `/v3/projects/75588acc64044e78a175d95996b2daa8` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:08.904809 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6c7aa5-b5c7-4907-91fa-8c54aed9c9b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75588acc64044e78a175d95996b2daa8)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:08.908316 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6c7aa5-b5c7-4907-91fa-8c54aed9c9b3 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:09.143773 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-9f6c7aa5-b5c7-4907-91fa-8c54aed9c9b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75588acc64044e78a175d95996b2daa8', 'request_id': 'req-9f6c7aa5-b5c7-4907-91fa-8c54aed9c9b3'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:09.153878 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-9f6c7aa5-b5c7-4907-91fa-8c54aed9c9b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75588acc64044e78a175d95996b2daa8', 'request_id': 'req-9f6c7aa5-b5c7-4907-91fa-8c54aed9c9b3'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:09.174475 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-9f6c7aa5-b5c7-4907-91fa-8c54aed9c9b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75588acc64044e78a175d95996b2daa8', 'request_id': 'req-9f6c7aa5-b5c7-4907-91fa-8c54aed9c9b3'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:09.710858 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-9f6c7aa5-b5c7-4907-91fa-8c54aed9c9b3 admin admin] The token cache is being invalidate because project 75588acc64044e78a175d95996b2daa8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:44:09.710858 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-9f6c7aa5-b5c7-4907-91fa-8c54aed9c9b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:09.710858 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-9f6c7aa5-b5c7-4907-91fa-8c54aed9c9b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:09.714577 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1113/2247] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:44:08 2022] DELETE /identity/v3/projects/75588acc64044e78a175d95996b2daa8 => generated 0 bytes in 858 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:44:09.730298 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0806907f-3bdf-46bd-b97c-f8b816e664c8 service cinder] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:09.770555 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0806907f-3bdf-46bd-b97c-f8b816e664c8 service cinder] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:09.954292 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4b4010-4ed0-44e6-855f-3d56a99e3b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:09.955285 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b4010-4ed0-44e6-855f-3d56a99e3b8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:09.955682 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b4010-4ed0-44e6-855f-3d56a99e3b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:09.955842 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b4010-4ed0-44e6-855f-3d56a99e3b8c admin admin] PATH_INFO: `/v3/users/a4d86c357ff3415b8cc0437fb4af6163` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:09.960081 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4b4010-4ed0-44e6-855f-3d56a99e3b8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4d86c357ff3415b8cc0437fb4af6163)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:09.962143 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4b4010-4ed0-44e6-855f-3d56a99e3b8c admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:10.577702 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-5e4b4010-4ed0-44e6-855f-3d56a99e3b8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4d86c357ff3415b8cc0437fb4af6163'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:10.705396 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-5e4b4010-4ed0-44e6-855f-3d56a99e3b8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4d86c357ff3415b8cc0437fb4af6163'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:10.706184 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-5e4b4010-4ed0-44e6-855f-3d56a99e3b8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4d86c357ff3415b8cc0437fb4af6163'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:10.712686 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:44:10.728085 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-5e4b4010-4ed0-44e6-855f-3d56a99e3b8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4d86c357ff3415b8cc0437fb4af6163'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:10.739147 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-5e4b4010-4ed0-44e6-855f-3d56a99e3b8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4d86c357ff3415b8cc0437fb4af6163'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:10.746495 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1135/2248] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:44:09 2022] DELETE /identity/v3/users/a4d86c357ff3415b8cc0437fb4af6163 => generated 0 bytes in 1024 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:44:11.433231 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c7aa5-b5c7-4907-91fa-8c54aed9c9b3 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:11.434960 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-9f6c7aa5-b5c7-4907-91fa-8c54aed9c9b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:11.469063 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c7aa5-b5c7-4907-91fa-8c54aed9c9b3 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:11.621484 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f2ecdc-e1f6-44ad-936c-d7cdda3f18c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:11.622772 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2ecdc-e1f6-44ad-936c-d7cdda3f18c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:11.623245 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2ecdc-e1f6-44ad-936c-d7cdda3f18c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:11.623572 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2ecdc-e1f6-44ad-936c-d7cdda3f18c5 admin admin] PATH_INFO: `/v3/projects/6e3e1604eb304e1aa152bd774a77d4ab` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:11.624898 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f2ecdc-e1f6-44ad-936c-d7cdda3f18c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e3e1604eb304e1aa152bd774a77d4ab)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:11.627210 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f2ecdc-e1f6-44ad-936c-d7cdda3f18c5 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:11.822891 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a3f2ecdc-e1f6-44ad-936c-d7cdda3f18c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e3e1604eb304e1aa152bd774a77d4ab', 'request_id': 'req-a3f2ecdc-e1f6-44ad-936c-d7cdda3f18c5'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:11.831568 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a3f2ecdc-e1f6-44ad-936c-d7cdda3f18c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e3e1604eb304e1aa152bd774a77d4ab', 'request_id': 'req-a3f2ecdc-e1f6-44ad-936c-d7cdda3f18c5'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:11.847311 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a3f2ecdc-e1f6-44ad-936c-d7cdda3f18c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e3e1604eb304e1aa152bd774a77d4ab', 'request_id': 'req-a3f2ecdc-e1f6-44ad-936c-d7cdda3f18c5'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:11.976718 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a3f2ecdc-e1f6-44ad-936c-d7cdda3f18c5 admin admin] The token cache is being invalidate because project 6e3e1604eb304e1aa152bd774a77d4ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:44:11.977468 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a3f2ecdc-e1f6-44ad-936c-d7cdda3f18c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:12.000700 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a3f2ecdc-e1f6-44ad-936c-d7cdda3f18c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:12.000700 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1114/2249] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:44:11 2022] DELETE /identity/v3/projects/6e3e1604eb304e1aa152bd774a77d4ab => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:44:12.001072 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedaf582-40b8-4983-a59a-45da3f2399fc None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:12.001072 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedaf582-40b8-4983-a59a-45da3f2399fc None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:12.001072 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedaf582-40b8-4983-a59a-45da3f2399fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:12.065544 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-cedaf582-40b8-4983-a59a-45da3f2399fc None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:44:12.065544 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-cedaf582-40b8-4983-a59a-45da3f2399fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:12.245786 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1136/2250] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:44:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:44:12.254288 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c41ae2-e15a-4318-a756-f9c86f8b467c None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:12.254578 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c41ae2-e15a-4318-a756-f9c86f8b467c None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:12.254857 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c41ae2-e15a-4318-a756-f9c86f8b467c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:12.304820 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-18c41ae2-e15a-4318-a756-f9c86f8b467c None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:44:12.310191 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-18c41ae2-e15a-4318-a756-f9c86f8b467c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:12.321202 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1115/2251] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:44:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:44:12.326480 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedaf582-40b8-4983-a59a-45da3f2399fc None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:12.365491 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedaf582-40b8-4983-a59a-45da3f2399fc None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:12.373436 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8a0805-2293-4b4e-b37b-5891abfce8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:12.374767 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a0805-2293-4b4e-b37b-5891abfce8e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:12.375244 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a0805-2293-4b4e-b37b-5891abfce8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:12.375696 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a0805-2293-4b4e-b37b-5891abfce8e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:12.376695 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8a0805-2293-4b4e-b37b-5891abfce8e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:44:12.378312 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8a0805-2293-4b4e-b37b-5891abfce8e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:12.380566 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8a0805-2293-4b4e-b37b-5891abfce8e1 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:12.398033 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1137/2252] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 10:44:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:44:12.404370 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c41ae2-e15a-4318-a756-f9c86f8b467c None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:12.417540 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c41ae2-e15a-4318-a756-f9c86f8b467c None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:12.429422 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eebad87-0c7f-4c14-8abe-90af47763d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:12.430315 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eebad87-0c7f-4c14-8abe-90af47763d84 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:12.430677 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eebad87-0c7f-4c14-8abe-90af47763d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:12.431021 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eebad87-0c7f-4c14-8abe-90af47763d84 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:12.431945 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eebad87-0c7f-4c14-8abe-90af47763d84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:12.436929 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eebad87-0c7f-4c14-8abe-90af47763d84 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:12.441393 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:44:12.574336 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1116/2253] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:44:12 2022] POST /identity/v3/projects => generated 357 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:44:12.578724 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8a0805-2293-4b4e-b37b-5891abfce8e1 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:12.594583 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8a0805-2293-4b4e-b37b-5891abfce8e1 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:12.729987 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f5836b-8155-4a66-99e8-0dfdc7e59f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:12.730745 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5836b-8155-4a66-99e8-0dfdc7e59f67 admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:12.731049 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5836b-8155-4a66-99e8-0dfdc7e59f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:12.731328 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5836b-8155-4a66-99e8-0dfdc7e59f67 admin admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:12.732061 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f5836b-8155-4a66-99e8-0dfdc7e59f67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:12.734413 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f5836b-8155-4a66-99e8-0dfdc7e59f67 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:12.896171 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1138/2254] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:44:12 2022] POST /identity/v3/users => generated 279 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:44:12.901325 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eebad87-0c7f-4c14-8abe-90af47763d84 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:12.921792 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eebad87-0c7f-4c14-8abe-90af47763d84 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:12.931191 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd6290c-0069-4c78-a8f7-7d46222e3e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:12.938056 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6290c-0069-4c78-a8f7-7d46222e3e0d admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:12.938056 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6290c-0069-4c78-a8f7-7d46222e3e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:12.938056 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd6290c-0069-4c78-a8f7-7d46222e3e0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:12.938056 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd6290c-0069-4c78-a8f7-7d46222e3e0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:12.938056 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd6290c-0069-4c78-a8f7-7d46222e3e0d admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:12.965711 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1117/2255] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:44:12 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:44:12.966541 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f5836b-8155-4a66-99e8-0dfdc7e59f67 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:12.985858 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f5836b-8155-4a66-99e8-0dfdc7e59f67 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:12.994896 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94767d1d-bdce-43e2-873e-df19f4c0421b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:12.995728 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94767d1d-bdce-43e2-873e-df19f4c0421b admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:12.998052 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94767d1d-bdce-43e2-873e-df19f4c0421b admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:12.998052 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94767d1d-bdce-43e2-873e-df19f4c0421b admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:12.998052 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94767d1d-bdce-43e2-873e-df19f4c0421b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:12.999372 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94767d1d-bdce-43e2-873e-df19f4c0421b admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:13.038133 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1139/2256] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:44:12 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:44:13.046014 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd6290c-0069-4c78-a8f7-7d46222e3e0d admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:13.092670 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd6290c-0069-4c78-a8f7-7d46222e3e0d admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:13.104578 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1f88e0-9e7d-43aa-a5d4-63dfd3fc5c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:13.106193 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f88e0-9e7d-43aa-a5d4-63dfd3fc5c29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:13.106669 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f88e0-9e7d-43aa-a5d4-63dfd3fc5c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:13.107130 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f88e0-9e7d-43aa-a5d4-63dfd3fc5c29 admin admin] PATH_INFO: `/v3/projects/05a7819c300a4c2883dc7806aad360a4/users/0b60e6f3c5d04881b44490100d4bad24/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:13.129834 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1f88e0-9e7d-43aa-a5d4-63dfd3fc5c29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05a7819c300a4c2883dc7806aad360a4, user_id=0b60e6f3c5d04881b44490100d4bad24, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:13.132697 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1f88e0-9e7d-43aa-a5d4-63dfd3fc5c29 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:14.003029 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1118/2257] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:44:13 2022] PUT /identity/v3/projects/05a7819c300a4c2883dc7806aad360a4/users/0b60e6f3c5d04881b44490100d4bad24/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 959 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:44:14.017411 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb6e1b-6245-4843-9bec-bca8f9865421 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:14.018071 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb6e1b-6245-4843-9bec-bca8f9865421 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:14.018350 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb6e1b-6245-4843-9bec-bca8f9865421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:14.053810 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-fefb6e1b-6245-4843-9bec-bca8f9865421 None None] MFA Rules not processed for user `0b60e6f3c5d04881b44490100d4bad24`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:44:14.055086 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-fefb6e1b-6245-4843-9bec-bca8f9865421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:14.097138 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:44:14.145234 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1140/2258] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:44:14 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:44:14.151634 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1f88e0-9e7d-43aa-a5d4-63dfd3fc5c29 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:14.289658 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1f88e0-9e7d-43aa-a5d4-63dfd3fc5c29 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:14.303061 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff95f7-30d4-4d36-bd80-7017b879699a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:14.304629 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff95f7-30d4-4d36-bd80-7017b879699a admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:14.305114 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff95f7-30d4-4d36-bd80-7017b879699a admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:14.305481 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff95f7-30d4-4d36-bd80-7017b879699a admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:14.306543 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ff95f7-30d4-4d36-bd80-7017b879699a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:14.310824 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ff95f7-30d4-4d36-bd80-7017b879699a admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:14.488312 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1119/2259] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:44:14 2022] POST /identity/v3/projects => generated 357 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:44:14.495064 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb6e1b-6245-4843-9bec-bca8f9865421 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:14.528375 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb6e1b-6245-4843-9bec-bca8f9865421 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:14.676885 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5efe03-531f-4c7b-80c6-acd8204a0171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:14.677622 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5efe03-531f-4c7b-80c6-acd8204a0171 admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:14.677908 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5efe03-531f-4c7b-80c6-acd8204a0171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:14.678182 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5efe03-531f-4c7b-80c6-acd8204a0171 admin admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:14.679018 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5efe03-531f-4c7b-80c6-acd8204a0171 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:14.681123 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5efe03-531f-4c7b-80c6-acd8204a0171 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:14.865281 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1141/2260] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:44:14 2022] POST /identity/v3/users => generated 285 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:44:14.870085 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff95f7-30d4-4d36-bd80-7017b879699a admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:14.884232 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff95f7-30d4-4d36-bd80-7017b879699a admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:14.889544 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00624f59-72f6-4ccc-9836-ed020ff2f8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:14.890233 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00624f59-72f6-4ccc-9836-ed020ff2f8de admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:14.890514 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00624f59-72f6-4ccc-9836-ed020ff2f8de admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:14.890788 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00624f59-72f6-4ccc-9836-ed020ff2f8de admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:14.891560 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00624f59-72f6-4ccc-9836-ed020ff2f8de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:14.893190 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00624f59-72f6-4ccc-9836-ed020ff2f8de admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:14.905912 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1120/2261] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:44:14 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:44:14.910190 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5efe03-531f-4c7b-80c6-acd8204a0171 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:14.929541 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5efe03-531f-4c7b-80c6-acd8204a0171 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:14.941527 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594dd5c8-2fde-4d7a-bdeb-04f69079053a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:14.945758 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594dd5c8-2fde-4d7a-bdeb-04f69079053a admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:14.947883 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594dd5c8-2fde-4d7a-bdeb-04f69079053a admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:14.948308 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594dd5c8-2fde-4d7a-bdeb-04f69079053a admin admin] PATH_INFO: `/v3/projects/57e5bf5dcc7a44db81e4d03c5743e993/users/1829f87b15124b919bab1ea125769d49/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:14.967821 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594dd5c8-2fde-4d7a-bdeb-04f69079053a admin admin] RBAC: Authorizing `identity:create_grant(project_id=57e5bf5dcc7a44db81e4d03c5743e993, user_id=1829f87b15124b919bab1ea125769d49, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:14.971067 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594dd5c8-2fde-4d7a-bdeb-04f69079053a admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:15.059459 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1142/2262] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:44:14 2022] PUT /identity/v3/projects/57e5bf5dcc7a44db81e4d03c5743e993/users/1829f87b15124b919bab1ea125769d49/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:44:15.063656 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00624f59-72f6-4ccc-9836-ed020ff2f8de admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:15.076586 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00624f59-72f6-4ccc-9836-ed020ff2f8de admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:15.203664 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40d249a-1a29-461c-a0ad-2f4d588e8649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:15.204362 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d249a-1a29-461c-a0ad-2f4d588e8649 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:15.204649 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d249a-1a29-461c-a0ad-2f4d588e8649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:15.204941 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40d249a-1a29-461c-a0ad-2f4d588e8649 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:15.206306 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40d249a-1a29-461c-a0ad-2f4d588e8649 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:15.238391 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40d249a-1a29-461c-a0ad-2f4d588e8649 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:15.273758 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1121/2263] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:44:15 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:44:15.278386 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594dd5c8-2fde-4d7a-bdeb-04f69079053a admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:15.306464 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594dd5c8-2fde-4d7a-bdeb-04f69079053a admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:15.319663 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54679299-40da-4976-a1d7-7c6248c23e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:15.320830 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54679299-40da-4976-a1d7-7c6248c23e5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:15.321700 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54679299-40da-4976-a1d7-7c6248c23e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:15.322539 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54679299-40da-4976-a1d7-7c6248c23e5c admin admin] PATH_INFO: `/v3/projects/57e5bf5dcc7a44db81e4d03c5743e993/users/1829f87b15124b919bab1ea125769d49/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:15.336039 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54679299-40da-4976-a1d7-7c6248c23e5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=57e5bf5dcc7a44db81e4d03c5743e993, user_id=1829f87b15124b919bab1ea125769d49, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:15.342607 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54679299-40da-4976-a1d7-7c6248c23e5c admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:15.363961 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1143/2264] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:44:15 2022] PUT /identity/v3/projects/57e5bf5dcc7a44db81e4d03c5743e993/users/1829f87b15124b919bab1ea125769d49/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:44:15.379037 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd837d-96c2-47a9-a7f9-6e7585d0908e None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:15.380581 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd837d-96c2-47a9-a7f9-6e7585d0908e None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:15.380581 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd837d-96c2-47a9-a7f9-6e7585d0908e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:15.437024 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-6bfd837d-96c2-47a9-a7f9-6e7585d0908e None None] MFA Rules not processed for user `1829f87b15124b919bab1ea125769d49`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:44:15.440335 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-6bfd837d-96c2-47a9-a7f9-6e7585d0908e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:15.462268 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:44:15.654780 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1122/2265] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:44:15 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:44:15.673785 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54679299-40da-4976-a1d7-7c6248c23e5c admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:15.676585 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-54679299-40da-4976-a1d7-7c6248c23e5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:15.816341 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54679299-40da-4976-a1d7-7c6248c23e5c admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:15.845164 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9874b1-4fcc-4970-8348-1678c0a7eb9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:15.845995 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9874b1-4fcc-4970-8348-1678c0a7eb9f service cinder] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:15.846319 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9874b1-4fcc-4970-8348-1678c0a7eb9f service cinder] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:15.846558 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9874b1-4fcc-4970-8348-1678c0a7eb9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:15.890182 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9874b1-4fcc-4970-8348-1678c0a7eb9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:15.891688 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9874b1-4fcc-4970-8348-1678c0a7eb9f service cinder] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:15.918031 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1144/2266] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:44:15 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:44:16.178797 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd837d-96c2-47a9-a7f9-6e7585d0908e None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:16.191556 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd837d-96c2-47a9-a7f9-6e7585d0908e None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:16.195791 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d747af-5c97-4e2f-8576-9c4e2034bb43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:16.196455 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d747af-5c97-4e2f-8576-9c4e2034bb43 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:16.196826 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d747af-5c97-4e2f-8576-9c4e2034bb43 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:16.197169 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d747af-5c97-4e2f-8576-9c4e2034bb43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:16.305096 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d747af-5c97-4e2f-8576-9c4e2034bb43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:16.311598 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d747af-5c97-4e2f-8576-9c4e2034bb43 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:16.339191 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1123/2267] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:44:16 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:44:25.899207 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=83,keystone:INSERT=5 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:44:26.319534 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=52 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:44:29.046070 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b2a9b-9874-4a49-ba93-46e3b184ecc4 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:29.046670 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b2a9b-9874-4a49-ba93-46e3b184ecc4 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:29.046753 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b2a9b-9874-4a49-ba93-46e3b184ecc4 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:29.048463 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1145/2268] 10.222.0.39 () {54 vars in 921 bytes} [Mon Jul 18 10:44:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:44:29.058357 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222d039-68cb-4c6c-bcbb-b872ca74c980 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:29.063750 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222d039-68cb-4c6c-bcbb-b872ca74c980 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:29.063750 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222d039-68cb-4c6c-bcbb-b872ca74c980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:29.090368 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-c222d039-68cb-4c6c-bcbb-b872ca74c980 None None] MFA Rules not processed for user `8bbebf16219943879df84bdc9a900516`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:44:29.092136 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c222d039-68cb-4c6c-bcbb-b872ca74c980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:29.192485 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1124/2269] 10.222.0.39 () {58 vars in 1018 bytes} [Mon Jul 18 10:44:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:44:29.207073 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b2a9b-9874-4a49-ba93-46e3b184ecc4 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:29.210679 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-8f3b2a9b-9874-4a49-ba93-46e3b184ecc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:29.286254 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b2a9b-9874-4a49-ba93-46e3b184ecc4 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:29.289746 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a56dd33-f4fc-44e5-b26d-e566e377f5e4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d1f7d0286745a396905aee50c9410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:29.290385 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56dd33-f4fc-44e5-b26d-e566e377f5e4 service glance] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:29.290667 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56dd33-f4fc-44e5-b26d-e566e377f5e4 service glance] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:29.291606 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56dd33-f4fc-44e5-b26d-e566e377f5e4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:29.302592 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a56dd33-f4fc-44e5-b26d-e566e377f5e4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:29.304059 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a56dd33-f4fc-44e5-b26d-e566e377f5e4 service glance] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:29.323635 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1146/2270] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:44:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:44:29.674604 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3a62b-9d61-4fda-8ed7-7c458293c04b None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:29.675192 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3a62b-9d61-4fda-8ed7-7c458293c04b None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:29.675623 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3a62b-9d61-4fda-8ed7-7c458293c04b None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:29.679166 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1125/2271] 10.222.0.39 () {54 vars in 921 bytes} [Mon Jul 18 10:44:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:44:29.689460 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31ba61-9de5-4bd4-87c2-2bc5ab98fc87 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:29.690638 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31ba61-9de5-4bd4-87c2-2bc5ab98fc87 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:29.691082 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31ba61-9de5-4bd4-87c2-2bc5ab98fc87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:29.745135 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-ea31ba61-9de5-4bd4-87c2-2bc5ab98fc87 None None] MFA Rules not processed for user `2f88e3a2b95e477bae1cc98e9e18dc24`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:44:29.746736 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-ea31ba61-9de5-4bd4-87c2-2bc5ab98fc87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:29.835410 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1147/2272] 10.222.0.39 () {58 vars in 1018 bytes} [Mon Jul 18 10:44:29 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:44:29.848713 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3a62b-9d61-4fda-8ed7-7c458293c04b None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:29.850482 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-74f3a62b-9d61-4fda-8ed7-7c458293c04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:29.865601 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3a62b-9d61-4fda-8ed7-7c458293c04b None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:29.872587 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2376a76f-65a3-4bc9-8bec-1abfe228e031 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:29.873364 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376a76f-65a3-4bc9-8bec-1abfe228e031 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:29.873645 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376a76f-65a3-4bc9-8bec-1abfe228e031 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:29.873919 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376a76f-65a3-4bc9-8bec-1abfe228e031 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:29.883043 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2376a76f-65a3-4bc9-8bec-1abfe228e031 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:29.884893 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2376a76f-65a3-4bc9-8bec-1abfe228e031 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:29.898332 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1126/2273] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:44:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:44:30.019797 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560fe99-584f-439a-82a0-2e6c3c4c29b3 None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:30.020493 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560fe99-584f-439a-82a0-2e6c3c4c29b3 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:30.021401 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560fe99-584f-439a-82a0-2e6c3c4c29b3 None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:30.026258 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1148/2274] 10.222.0.39 () {54 vars in 921 bytes} [Mon Jul 18 10:44:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:44:30.039131 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4e98a-9f29-48ad-aa6a-08cc1b618026 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:30.039987 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4e98a-9f29-48ad-aa6a-08cc1b618026 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:30.040630 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c4e98a-9f29-48ad-aa6a-08cc1b618026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:30.076376 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-16c4e98a-9f29-48ad-aa6a-08cc1b618026 None None] MFA Rules not processed for user `8bbebf16219943879df84bdc9a900516`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:44:30.078902 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-16c4e98a-9f29-48ad-aa6a-08cc1b618026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:30.096262 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1127/2275] 10.222.0.39 () {58 vars in 1018 bytes} [Mon Jul 18 10:44:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:44:30.116444 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560fe99-584f-439a-82a0-2e6c3c4c29b3 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:30.131176 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560fe99-584f-439a-82a0-2e6c3c4c29b3 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:30.137506 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16255211-8fcd-4299-bd50-903e7581a6a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:30.138721 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16255211-8fcd-4299-bd50-903e7581a6a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:30.138857 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16255211-8fcd-4299-bd50-903e7581a6a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:30.139374 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16255211-8fcd-4299-bd50-903e7581a6a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:30.153671 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16255211-8fcd-4299-bd50-903e7581a6a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:30.156194 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16255211-8fcd-4299-bd50-903e7581a6a8 service neutron] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:30.173395 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1149/2276] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:44:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:44:35.788406 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4e98a-9f29-48ad-aa6a-08cc1b618026 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:35.789852 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-16c4e98a-9f29-48ad-aa6a-08cc1b618026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:35.877422 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c4e98a-9f29-48ad-aa6a-08cc1b618026 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:35.885915 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522dd90a-17f1-4976-a6b8-a11875b2b317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:35.887433 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522dd90a-17f1-4976-a6b8-a11875b2b317 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:35.887928 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522dd90a-17f1-4976-a6b8-a11875b2b317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:35.888424 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522dd90a-17f1-4976-a6b8-a11875b2b317 admin admin] PATH_INFO: `/v3/users/577081e487104746a91052400adb2831` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:35.890597 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522dd90a-17f1-4976-a6b8-a11875b2b317 admin admin] RBAC: Authorizing `identity:delete_user(user_id=577081e487104746a91052400adb2831)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:35.894433 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522dd90a-17f1-4976-a6b8-a11875b2b317 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:36.262492 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-522dd90a-17f1-4976-a6b8-a11875b2b317 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '577081e487104746a91052400adb2831'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:36.362638 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-522dd90a-17f1-4976-a6b8-a11875b2b317 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '577081e487104746a91052400adb2831'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:36.363273 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-522dd90a-17f1-4976-a6b8-a11875b2b317 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '577081e487104746a91052400adb2831'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:36.377620 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-522dd90a-17f1-4976-a6b8-a11875b2b317 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '577081e487104746a91052400adb2831'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:36.379639 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:44:36.385928 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-522dd90a-17f1-4976-a6b8-a11875b2b317 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '577081e487104746a91052400adb2831'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:36.392436 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1128/2277] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:44:35 2022] DELETE /identity/v3/users/577081e487104746a91052400adb2831 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:44:36.397113 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a2de41-8e07-4926-8abf-fc32c0d92edf None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:36.397612 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a2de41-8e07-4926-8abf-fc32c0d92edf None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:36.397793 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a2de41-8e07-4926-8abf-fc32c0d92edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:36.422233 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-94a2de41-8e07-4926-8abf-fc32c0d92edf None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:44:36.425177 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-94a2de41-8e07-4926-8abf-fc32c0d92edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:36.489826 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1150/2278] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:44:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:44:36.503307 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522dd90a-17f1-4976-a6b8-a11875b2b317 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:36.504725 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-522dd90a-17f1-4976-a6b8-a11875b2b317 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:36.568426 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522dd90a-17f1-4976-a6b8-a11875b2b317 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:36.572786 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde410f5-6028-4867-a5e9-77b5b1913550 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:36.573618 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde410f5-6028-4867-a5e9-77b5b1913550 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:36.573901 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde410f5-6028-4867-a5e9-77b5b1913550 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:36.574175 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde410f5-6028-4867-a5e9-77b5b1913550 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:36.583739 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde410f5-6028-4867-a5e9-77b5b1913550 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:36.585203 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde410f5-6028-4867-a5e9-77b5b1913550 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:36.596828 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1129/2279] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:44:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:44:37.255952 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a2de41-8e07-4926-8abf-fc32c0d92edf None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:37.257462 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-94a2de41-8e07-4926-8abf-fc32c0d92edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:37.282795 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a2de41-8e07-4926-8abf-fc32c0d92edf None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:37.291685 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd8305-0281-4286-a56d-6c51ac994420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:37.292780 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd8305-0281-4286-a56d-6c51ac994420 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:37.293180 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd8305-0281-4286-a56d-6c51ac994420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:37.293858 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd8305-0281-4286-a56d-6c51ac994420 admin admin] PATH_INFO: `/v3/projects/a12c028b8bc04f108ddc4ab0ef8e790b` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:37.295390 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bd8305-0281-4286-a56d-6c51ac994420 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a12c028b8bc04f108ddc4ab0ef8e790b)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:37.298056 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bd8305-0281-4286-a56d-6c51ac994420 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:37.430367 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e31e3-33b7-41fd-bee6-f9237845ca62 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:37.431163 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e31e3-33b7-41fd-bee6-f9237845ca62 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:37.431163 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e31e3-33b7-41fd-bee6-f9237845ca62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:37.452742 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-9c4e31e3-33b7-41fd-bee6-f9237845ca62 None None] MFA Rules not processed for user `88ad60446c5447a8bbd0096fa2133efb`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:44:37.453995 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-9c4e31e3-33b7-41fd-bee6-f9237845ca62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:37.523573 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:44:37.539364 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-44bd8305-0281-4286-a56d-6c51ac994420 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a12c028b8bc04f108ddc4ab0ef8e790b', 'request_id': 'req-44bd8305-0281-4286-a56d-6c51ac994420'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:37.546874 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-44bd8305-0281-4286-a56d-6c51ac994420 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a12c028b8bc04f108ddc4ab0ef8e790b', 'request_id': 'req-44bd8305-0281-4286-a56d-6c51ac994420'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:37.554407 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1130/2280] 10.222.0.39 () {58 vars in 1009 bytes} [Mon Jul 18 10:44:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:44:37.574800 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-44bd8305-0281-4286-a56d-6c51ac994420 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a12c028b8bc04f108ddc4ab0ef8e790b', 'request_id': 'req-44bd8305-0281-4286-a56d-6c51ac994420'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:37.580825 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e31e3-33b7-41fd-bee6-f9237845ca62 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:37.586666 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-9c4e31e3-33b7-41fd-bee6-f9237845ca62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:37.668400 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e31e3-33b7-41fd-bee6-f9237845ca62 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:37.720599 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:44:37.739535 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-44bd8305-0281-4286-a56d-6c51ac994420 admin admin] The token cache is being invalidate because project a12c028b8bc04f108ddc4ab0ef8e790b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80392) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:44:37.739535 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-44bd8305-0281-4286-a56d-6c51ac994420 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:37.741520 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-44bd8305-0281-4286-a56d-6c51ac994420 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:37.746612 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1151/2281] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:44:37 2022] DELETE /identity/v3/projects/a12c028b8bc04f108ddc4ab0ef8e790b => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:44:37.749950 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93a967-5154-4e5d-a1ca-9c0d29475a35 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:37.750481 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93a967-5154-4e5d-a1ca-9c0d29475a35 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:37.750720 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93a967-5154-4e5d-a1ca-9c0d29475a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:37.760068 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4d157e-9748-4255-935c-512ba28390e7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c548474a8d94591ba58dd40e40a28d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:37.760852 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d157e-9748-4255-935c-512ba28390e7 service swift] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:37.761475 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d157e-9748-4255-935c-512ba28390e7 service swift] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:37.761869 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d157e-9748-4255-935c-512ba28390e7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:37.763953 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-6f4d157e-9748-4255-935c-512ba28390e7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:37.780057 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-8b93a967-5154-4e5d-a1ca-9c0d29475a35 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:44:37.781978 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-8b93a967-5154-4e5d-a1ca-9c0d29475a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:37.841938 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4d157e-9748-4255-935c-512ba28390e7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:37.843887 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4d157e-9748-4255-935c-512ba28390e7 service swift] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:37.859607 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1131/2282] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Jul 18 10:44:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 10:44:37.865971 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1152/2283] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:44:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:44:37.880613 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf9a4a-e10f-4d90-a73e-867a50c1f965 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:37.881183 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf9a4a-e10f-4d90-a73e-867a50c1f965 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:37.881478 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf9a4a-e10f-4d90-a73e-867a50c1f965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:37.903274 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-e3bf9a4a-e10f-4d90-a73e-867a50c1f965 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:44:37.904521 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-e3bf9a4a-e10f-4d90-a73e-867a50c1f965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:37.914467 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1132/2284] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:44:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:44:37.919232 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b93a967-5154-4e5d-a1ca-9c0d29475a35 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:37.929400 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b93a967-5154-4e5d-a1ca-9c0d29475a35 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:37.934684 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8204862-4fe0-4c90-af65-8161814789dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:37.935345 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8204862-4fe0-4c90-af65-8161814789dd admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:37.935654 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8204862-4fe0-4c90-af65-8161814789dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:37.935928 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8204862-4fe0-4c90-af65-8161814789dd admin admin] PATH_INFO: `/v3/domains` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:37.936654 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8204862-4fe0-4c90-af65-8161814789dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:44:37.936958 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8204862-4fe0-4c90-af65-8161814789dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:37.938580 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8204862-4fe0-4c90-af65-8161814789dd admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:37.950887 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1153/2285] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 10:44:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:44:37.955469 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf9a4a-e10f-4d90-a73e-867a50c1f965 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:37.965386 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf9a4a-e10f-4d90-a73e-867a50c1f965 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:37.971349 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff8318-4c01-484c-8c47-dc7f5b767381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:37.972007 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff8318-4c01-484c-8c47-dc7f5b767381 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:37.972287 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff8318-4c01-484c-8c47-dc7f5b767381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:37.972575 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff8318-4c01-484c-8c47-dc7f5b767381 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:37.974507 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ff8318-4c01-484c-8c47-dc7f5b767381 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:37.975274 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ff8318-4c01-484c-8c47-dc7f5b767381 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:38.170399 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1133/2286] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:44:37 2022] POST /identity/v3/projects => generated 391 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:44:38.171840 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8204862-4fe0-4c90-af65-8161814789dd admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:38.201813 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8204862-4fe0-4c90-af65-8161814789dd admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:38.320776 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7272193f-8fd8-406a-a684-3413eaaca485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:38.321640 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7272193f-8fd8-406a-a684-3413eaaca485 admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:38.322050 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7272193f-8fd8-406a-a684-3413eaaca485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:38.322491 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7272193f-8fd8-406a-a684-3413eaaca485 admin admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:38.323338 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7272193f-8fd8-406a-a684-3413eaaca485 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:38.325320 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7272193f-8fd8-406a-a684-3413eaaca485 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:38.504318 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1154/2287] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:44:38 2022] POST /identity/v3/users => generated 296 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:44:38.512812 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff8318-4c01-484c-8c47-dc7f5b767381 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:38.531125 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff8318-4c01-484c-8c47-dc7f5b767381 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:38.540578 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03238904-9273-47f1-a8b6-92658a872e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:38.542538 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03238904-9273-47f1-a8b6-92658a872e76 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:38.543752 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03238904-9273-47f1-a8b6-92658a872e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:38.544719 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03238904-9273-47f1-a8b6-92658a872e76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:38.545859 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03238904-9273-47f1-a8b6-92658a872e76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:38.548502 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03238904-9273-47f1-a8b6-92658a872e76 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:38.590051 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1134/2288] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:44:38 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:44:38.590717 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7272193f-8fd8-406a-a684-3413eaaca485 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:38.615416 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7272193f-8fd8-406a-a684-3413eaaca485 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:38.633664 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582594d2-7d75-4d8a-a080-7a0815359c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:38.635309 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582594d2-7d75-4d8a-a080-7a0815359c74 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:38.636658 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582594d2-7d75-4d8a-a080-7a0815359c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:38.637014 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582594d2-7d75-4d8a-a080-7a0815359c74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:38.638461 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582594d2-7d75-4d8a-a080-7a0815359c74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:38.646255 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582594d2-7d75-4d8a-a080-7a0815359c74 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:38.680739 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1155/2289] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:44:38 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:44:38.686954 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03238904-9273-47f1-a8b6-92658a872e76 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:38.712156 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03238904-9273-47f1-a8b6-92658a872e76 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:38.729990 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab8a40f-207e-4b5b-91b3-469d10f5e075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:38.731241 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8a40f-207e-4b5b-91b3-469d10f5e075 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:38.731670 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8a40f-207e-4b5b-91b3-469d10f5e075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:38.732044 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8a40f-207e-4b5b-91b3-469d10f5e075 admin admin] PATH_INFO: `/v3/projects/88a852386cb349fa8cfb48d8180c693d/users/e9c22b9719e148cd972637bc7b2fbc37/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:38.754604 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab8a40f-207e-4b5b-91b3-469d10f5e075 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88a852386cb349fa8cfb48d8180c693d, user_id=e9c22b9719e148cd972637bc7b2fbc37, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:38.761180 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab8a40f-207e-4b5b-91b3-469d10f5e075 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:38.965123 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1135/2290] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:44:38 2022] PUT /identity/v3/projects/88a852386cb349fa8cfb48d8180c693d/users/e9c22b9719e148cd972637bc7b2fbc37/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:44:38.976339 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc9766c-5db3-4b52-b354-eff1404aab7d None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:38.976746 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc9766c-5db3-4b52-b354-eff1404aab7d None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:38.977606 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc9766c-5db3-4b52-b354-eff1404aab7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:39.033935 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-0cc9766c-5db3-4b52-b354-eff1404aab7d None None] MFA Rules not processed for user `e9c22b9719e148cd972637bc7b2fbc37`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:44:39.036419 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-0cc9766c-5db3-4b52-b354-eff1404aab7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:39.108046 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:44:39.201062 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1156/2291] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:44:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:44:39.213654 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab8a40f-207e-4b5b-91b3-469d10f5e075 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:39.215245 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-dab8a40f-207e-4b5b-91b3-469d10f5e075 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:39.306786 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab8a40f-207e-4b5b-91b3-469d10f5e075 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:39.311569 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f62c9-76e0-4072-87e9-84c6f83d4952 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:39.312337 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f62c9-76e0-4072-87e9-84c6f83d4952 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:39.312700 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f62c9-76e0-4072-87e9-84c6f83d4952 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:39.313070 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f62c9-76e0-4072-87e9-84c6f83d4952 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:39.323972 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5f62c9-76e0-4072-87e9-84c6f83d4952 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:39.325459 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5f62c9-76e0-4072-87e9-84c6f83d4952 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:39.338150 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1136/2292] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:44:39 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:44:43.650372 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc9766c-5db3-4b52-b354-eff1404aab7d None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:43.652840 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-0cc9766c-5db3-4b52-b354-eff1404aab7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:43.767743 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc9766c-5db3-4b52-b354-eff1404aab7d None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:43.779022 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2799569b-d7c0-4e90-b110-586f640001b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:43.780738 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2799569b-d7c0-4e90-b110-586f640001b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:43.781345 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2799569b-d7c0-4e90-b110-586f640001b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:43.785096 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2799569b-d7c0-4e90-b110-586f640001b8 admin admin] PATH_INFO: `/v3/users/0b60e6f3c5d04881b44490100d4bad24` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:43.785096 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2799569b-d7c0-4e90-b110-586f640001b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b60e6f3c5d04881b44490100d4bad24)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:43.787618 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2799569b-d7c0-4e90-b110-586f640001b8 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:44.054328 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-2799569b-d7c0-4e90-b110-586f640001b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b60e6f3c5d04881b44490100d4bad24'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:44.140713 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-2799569b-d7c0-4e90-b110-586f640001b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b60e6f3c5d04881b44490100d4bad24'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:44.141938 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-2799569b-d7c0-4e90-b110-586f640001b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b60e6f3c5d04881b44490100d4bad24'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:44.163505 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-2799569b-d7c0-4e90-b110-586f640001b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b60e6f3c5d04881b44490100d4bad24'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:44.172449 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-2799569b-d7c0-4e90-b110-586f640001b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b60e6f3c5d04881b44490100d4bad24'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:44.181446 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1157/2293] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:44:43 2022] DELETE /identity/v3/users/0b60e6f3c5d04881b44490100d4bad24 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:44:44.186737 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946486c-d804-49ed-a623-1138fc57af27 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:44.192070 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946486c-d804-49ed-a623-1138fc57af27 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:44.192070 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946486c-d804-49ed-a623-1138fc57af27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:44.209271 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-0946486c-d804-49ed-a623-1138fc57af27 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:44:44.210511 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-0946486c-d804-49ed-a623-1138fc57af27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:44.243631 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:44:44.345758 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1137/2294] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:44:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:44:44.357385 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2799569b-d7c0-4e90-b110-586f640001b8 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:44.358964 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-2799569b-d7c0-4e90-b110-586f640001b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:44.441441 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:44:44.456210 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2799569b-d7c0-4e90-b110-586f640001b8 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:44.459970 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5a73b-bb55-43c0-8a0b-41d16d14aaaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:44.460627 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5a73b-bb55-43c0-8a0b-41d16d14aaaa service neutron] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:44.460912 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5a73b-bb55-43c0-8a0b-41d16d14aaaa service neutron] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:44.461213 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5a73b-bb55-43c0-8a0b-41d16d14aaaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:44.471113 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a5a73b-bb55-43c0-8a0b-41d16d14aaaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:44.472659 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a5a73b-bb55-43c0-8a0b-41d16d14aaaa service neutron] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:44.483451 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1158/2295] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:44:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:44:45.659723 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0946486c-d804-49ed-a623-1138fc57af27 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:45.659723 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-0946486c-d804-49ed-a623-1138fc57af27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:45.693378 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0946486c-d804-49ed-a623-1138fc57af27 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:45.712584 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53d3b99-7b89-41aa-bd39-60d2adf4a1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:45.714519 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d3b99-7b89-41aa-bd39-60d2adf4a1a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:45.714809 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d3b99-7b89-41aa-bd39-60d2adf4a1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:45.715094 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d3b99-7b89-41aa-bd39-60d2adf4a1a0 admin admin] PATH_INFO: `/v3/projects/05a7819c300a4c2883dc7806aad360a4` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:45.717639 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53d3b99-7b89-41aa-bd39-60d2adf4a1a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05a7819c300a4c2883dc7806aad360a4)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:45.720398 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53d3b99-7b89-41aa-bd39-60d2adf4a1a0 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:45.879930 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-f53d3b99-7b89-41aa-bd39-60d2adf4a1a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05a7819c300a4c2883dc7806aad360a4', 'request_id': 'req-f53d3b99-7b89-41aa-bd39-60d2adf4a1a0'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:45.887885 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-f53d3b99-7b89-41aa-bd39-60d2adf4a1a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05a7819c300a4c2883dc7806aad360a4', 'request_id': 'req-f53d3b99-7b89-41aa-bd39-60d2adf4a1a0'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:45.893732 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-f53d3b99-7b89-41aa-bd39-60d2adf4a1a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05a7819c300a4c2883dc7806aad360a4', 'request_id': 'req-f53d3b99-7b89-41aa-bd39-60d2adf4a1a0'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:45.989963 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-f53d3b99-7b89-41aa-bd39-60d2adf4a1a0 admin admin] The token cache is being invalidate because project 05a7819c300a4c2883dc7806aad360a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:44:45.990251 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-f53d3b99-7b89-41aa-bd39-60d2adf4a1a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:45.991012 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-f53d3b99-7b89-41aa-bd39-60d2adf4a1a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:45.992749 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1138/2296] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:44:45 2022] DELETE /identity/v3/projects/05a7819c300a4c2883dc7806aad360a4 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:44:45.997264 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5a73b-bb55-43c0-8a0b-41d16d14aaaa service neutron] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:46.011732 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5a73b-bb55-43c0-8a0b-41d16d14aaaa service neutron] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:46.081958 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8189654-5ed9-485b-86b4-e78e1f862d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:46.082683 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8189654-5ed9-485b-86b4-e78e1f862d90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:46.082963 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8189654-5ed9-485b-86b4-e78e1f862d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:46.083238 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8189654-5ed9-485b-86b4-e78e1f862d90 admin admin] PATH_INFO: `/v3/users/1829f87b15124b919bab1ea125769d49` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:46.084495 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8189654-5ed9-485b-86b4-e78e1f862d90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1829f87b15124b919bab1ea125769d49)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:46.086566 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8189654-5ed9-485b-86b4-e78e1f862d90 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:46.333461 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-f8189654-5ed9-485b-86b4-e78e1f862d90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1829f87b15124b919bab1ea125769d49'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:46.443055 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-f8189654-5ed9-485b-86b4-e78e1f862d90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1829f87b15124b919bab1ea125769d49'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:46.443698 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-f8189654-5ed9-485b-86b4-e78e1f862d90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1829f87b15124b919bab1ea125769d49'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:46.457605 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-f8189654-5ed9-485b-86b4-e78e1f862d90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1829f87b15124b919bab1ea125769d49'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:46.465298 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-f8189654-5ed9-485b-86b4-e78e1f862d90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1829f87b15124b919bab1ea125769d49'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:46.472179 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1159/2297] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:44:45 2022] DELETE /identity/v3/users/1829f87b15124b919bab1ea125769d49 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:44:47.185146 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53d3b99-7b89-41aa-bd39-60d2adf4a1a0 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:47.186673 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-f53d3b99-7b89-41aa-bd39-60d2adf4a1a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:47.213715 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53d3b99-7b89-41aa-bd39-60d2adf4a1a0 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:47.302323 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f857d25-505e-44ed-b2a1-311e33d77637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:47.303288 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f857d25-505e-44ed-b2a1-311e33d77637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:47.303575 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f857d25-505e-44ed-b2a1-311e33d77637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:47.303868 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f857d25-505e-44ed-b2a1-311e33d77637 admin admin] PATH_INFO: `/v3/projects/57e5bf5dcc7a44db81e4d03c5743e993` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:47.305164 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f857d25-505e-44ed-b2a1-311e33d77637 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57e5bf5dcc7a44db81e4d03c5743e993)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:47.307701 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f857d25-505e-44ed-b2a1-311e33d77637 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:47.469336 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:44:47.470757 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-8f857d25-505e-44ed-b2a1-311e33d77637 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57e5bf5dcc7a44db81e4d03c5743e993', 'request_id': 'req-8f857d25-505e-44ed-b2a1-311e33d77637'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:47.477994 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-8f857d25-505e-44ed-b2a1-311e33d77637 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57e5bf5dcc7a44db81e4d03c5743e993', 'request_id': 'req-8f857d25-505e-44ed-b2a1-311e33d77637'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:47.484205 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-8f857d25-505e-44ed-b2a1-311e33d77637 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57e5bf5dcc7a44db81e4d03c5743e993', 'request_id': 'req-8f857d25-505e-44ed-b2a1-311e33d77637'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:47.592182 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-8f857d25-505e-44ed-b2a1-311e33d77637 admin admin] The token cache is being invalidate because project 57e5bf5dcc7a44db81e4d03c5743e993 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:44:47.592477 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-8f857d25-505e-44ed-b2a1-311e33d77637 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:47.593161 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-8f857d25-505e-44ed-b2a1-311e33d77637 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:47.594776 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1139/2298] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:44:47 2022] DELETE /identity/v3/projects/57e5bf5dcc7a44db81e4d03c5743e993 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:44:47.599857 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c981957a-89b4-4839-aa4a-549a2346bcdf None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:47.600402 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c981957a-89b4-4839-aa4a-549a2346bcdf None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:47.600402 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c981957a-89b4-4839-aa4a-549a2346bcdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:47.621825 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-c981957a-89b4-4839-aa4a-549a2346bcdf None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:44:47.625359 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-c981957a-89b4-4839-aa4a-549a2346bcdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:47.679364 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:44:47.688569 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1160/2299] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:44:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:44:47.696765 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd323a84-9e89-4a58-8192-ddb3d90420d0 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:47.697755 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd323a84-9e89-4a58-8192-ddb3d90420d0 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:47.698041 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd323a84-9e89-4a58-8192-ddb3d90420d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:47.717456 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-fd323a84-9e89-4a58-8192-ddb3d90420d0 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:44:47.718690 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-fd323a84-9e89-4a58-8192-ddb3d90420d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:47.726894 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1140/2300] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:44:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:44:47.731415 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c981957a-89b4-4839-aa4a-549a2346bcdf None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:47.742025 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c981957a-89b4-4839-aa4a-549a2346bcdf None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:47.747763 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46d798-ac64-44a1-89c5-4b013c99ed0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:47.748533 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46d798-ac64-44a1-89c5-4b013c99ed0f admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:47.748816 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46d798-ac64-44a1-89c5-4b013c99ed0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:47.749125 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46d798-ac64-44a1-89c5-4b013c99ed0f admin admin] PATH_INFO: `/v3/domains` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:47.749860 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff46d798-ac64-44a1-89c5-4b013c99ed0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:44:47.750166 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff46d798-ac64-44a1-89c5-4b013c99ed0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:47.751877 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff46d798-ac64-44a1-89c5-4b013c99ed0f admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:47.764742 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1161/2301] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 10:44:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:44:47.771394 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd323a84-9e89-4a58-8192-ddb3d90420d0 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:47.780723 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd323a84-9e89-4a58-8192-ddb3d90420d0 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:47.785565 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077721a-c14a-4bf2-9c7f-fb51fa53e8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:47.786214 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077721a-c14a-4bf2-9c7f-fb51fa53e8a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:47.786498 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077721a-c14a-4bf2-9c7f-fb51fa53e8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:47.786775 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077721a-c14a-4bf2-9c7f-fb51fa53e8a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:47.787497 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f077721a-c14a-4bf2-9c7f-fb51fa53e8a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:47.789464 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f077721a-c14a-4bf2-9c7f-fb51fa53e8a7 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:47.913281 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1141/2302] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:44:47 2022] POST /identity/v3/projects => generated 381 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:44:47.919775 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46d798-ac64-44a1-89c5-4b013c99ed0f admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:47.932067 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46d798-ac64-44a1-89c5-4b013c99ed0f admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:48.008991 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2bee52-5cf3-4cd4-b047-09cadcd9648e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:48.011212 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2bee52-5cf3-4cd4-b047-09cadcd9648e admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:48.011212 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2bee52-5cf3-4cd4-b047-09cadcd9648e admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:48.011212 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2bee52-5cf3-4cd4-b047-09cadcd9648e admin admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:48.011212 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2bee52-5cf3-4cd4-b047-09cadcd9648e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:48.013509 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2bee52-5cf3-4cd4-b047-09cadcd9648e admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:48.176854 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1162/2303] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:44:47 2022] POST /identity/v3/users => generated 291 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:44:48.181032 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077721a-c14a-4bf2-9c7f-fb51fa53e8a7 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:48.193591 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077721a-c14a-4bf2-9c7f-fb51fa53e8a7 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:48.199614 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1824c07d-5826-4930-9680-8b9f66cb435e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:48.200293 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824c07d-5826-4930-9680-8b9f66cb435e admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:48.200582 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824c07d-5826-4930-9680-8b9f66cb435e admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:48.200862 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824c07d-5826-4930-9680-8b9f66cb435e admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:48.201705 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1824c07d-5826-4930-9680-8b9f66cb435e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:48.203305 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1824c07d-5826-4930-9680-8b9f66cb435e admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:48.214545 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1142/2304] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:44:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:44:48.221847 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2bee52-5cf3-4cd4-b047-09cadcd9648e admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:48.232613 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2bee52-5cf3-4cd4-b047-09cadcd9648e admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:48.237421 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a3614f-e385-4a6e-9d8d-6f0e7c4bf40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:48.238115 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a3614f-e385-4a6e-9d8d-6f0e7c4bf40d admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:48.238403 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a3614f-e385-4a6e-9d8d-6f0e7c4bf40d admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:48.238710 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a3614f-e385-4a6e-9d8d-6f0e7c4bf40d admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:48.239622 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a3614f-e385-4a6e-9d8d-6f0e7c4bf40d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:48.241365 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a3614f-e385-4a6e-9d8d-6f0e7c4bf40d admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:48.252784 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1163/2305] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:44:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:44:48.257404 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1824c07d-5826-4930-9680-8b9f66cb435e admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:48.268023 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1824c07d-5826-4930-9680-8b9f66cb435e admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:48.273455 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd32ccd2-3e1d-44e2-a97b-112773d95b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:48.274741 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32ccd2-3e1d-44e2-a97b-112773d95b7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:48.274942 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32ccd2-3e1d-44e2-a97b-112773d95b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:48.276075 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32ccd2-3e1d-44e2-a97b-112773d95b7b admin admin] PATH_INFO: `/v3/projects/10cf1a38ba294b21b212c41da7aea531/users/1469f77ff86c4f95b432be3a84c47be6/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:48.292594 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd32ccd2-3e1d-44e2-a97b-112773d95b7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=10cf1a38ba294b21b212c41da7aea531, user_id=1469f77ff86c4f95b432be3a84c47be6, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:48.295553 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd32ccd2-3e1d-44e2-a97b-112773d95b7b admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:48.460331 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1143/2306] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:44:48 2022] PUT /identity/v3/projects/10cf1a38ba294b21b212c41da7aea531/users/1469f77ff86c4f95b432be3a84c47be6/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:44:48.476039 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79727caf-1aae-4b0f-9d68-a9189b0cecee None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:48.476864 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79727caf-1aae-4b0f-9d68-a9189b0cecee None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:48.477570 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79727caf-1aae-4b0f-9d68-a9189b0cecee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:48.516238 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-79727caf-1aae-4b0f-9d68-a9189b0cecee None None] MFA Rules not processed for user `1469f77ff86c4f95b432be3a84c47be6`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:44:48.517814 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-79727caf-1aae-4b0f-9d68-a9189b0cecee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:48.595144 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1164/2307] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:44:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:44:48.599819 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd32ccd2-3e1d-44e2-a97b-112773d95b7b admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:48.685211 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd32ccd2-3e1d-44e2-a97b-112773d95b7b admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:48.692128 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817aa12-a640-4106-aa51-5d8a6c871183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:48.692886 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817aa12-a640-4106-aa51-5d8a6c871183 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:48.693131 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817aa12-a640-4106-aa51-5d8a6c871183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:48.693486 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817aa12-a640-4106-aa51-5d8a6c871183 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:48.694096 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0817aa12-a640-4106-aa51-5d8a6c871183 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:48.695999 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0817aa12-a640-4106-aa51-5d8a6c871183 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:48.885319 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1144/2308] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:44:48 2022] POST /identity/v3/projects => generated 383 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:44:48.894782 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79727caf-1aae-4b0f-9d68-a9189b0cecee None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:48.906963 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79727caf-1aae-4b0f-9d68-a9189b0cecee None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:48.962693 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:44:48.972496 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c1074-07e5-4ace-aecc-44f0a5c6ddbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:48.973236 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c1074-07e5-4ace-aecc-44f0a5c6ddbe admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:48.973548 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c1074-07e5-4ace-aecc-44f0a5c6ddbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:48.973923 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c1074-07e5-4ace-aecc-44f0a5c6ddbe admin admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:48.974585 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4c1074-07e5-4ace-aecc-44f0a5c6ddbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:48.976599 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4c1074-07e5-4ace-aecc-44f0a5c6ddbe admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:49.168301 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1165/2309] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:44:48 2022] POST /identity/v3/users => generated 298 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:44:49.178093 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817aa12-a640-4106-aa51-5d8a6c871183 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:49.184204 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817aa12-a640-4106-aa51-5d8a6c871183 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:49.200306 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefa951a-1dac-46c3-8271-f1580414651a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:49.200999 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa951a-1dac-46c3-8271-f1580414651a admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:49.201378 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa951a-1dac-46c3-8271-f1580414651a admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:49.201661 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa951a-1dac-46c3-8271-f1580414651a admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:49.202441 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefa951a-1dac-46c3-8271-f1580414651a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:49.204131 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefa951a-1dac-46c3-8271-f1580414651a admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:49.216874 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1145/2310] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:44:49.220897 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c1074-07e5-4ace-aecc-44f0a5c6ddbe admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:49.240216 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c1074-07e5-4ace-aecc-44f0a5c6ddbe admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:49.246185 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e32b7-9674-4d95-b0f8-274dba7847de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:49.247282 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e32b7-9674-4d95-b0f8-274dba7847de admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:49.247598 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e32b7-9674-4d95-b0f8-274dba7847de admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:49.247881 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e32b7-9674-4d95-b0f8-274dba7847de admin admin] PATH_INFO: `/v3/projects/ee9c33cf2bf1406cbae749d958da3d41/users/e011e140e9f94408852c2af4085ac869/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:49.269688 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3e32b7-9674-4d95-b0f8-274dba7847de admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee9c33cf2bf1406cbae749d958da3d41, user_id=e011e140e9f94408852c2af4085ac869, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:49.273063 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3e32b7-9674-4d95-b0f8-274dba7847de admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:49.350408 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1166/2311] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:44:49 2022] PUT /identity/v3/projects/ee9c33cf2bf1406cbae749d958da3d41/users/e011e140e9f94408852c2af4085ac869/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:44:49.355429 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefa951a-1dac-46c3-8271-f1580414651a admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:49.367184 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefa951a-1dac-46c3-8271-f1580414651a admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:49.420337 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:44:49.433908 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a336a334-5245-445d-aa30-12379a7a04c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:49.434589 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a336a334-5245-445d-aa30-12379a7a04c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:49.434875 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a336a334-5245-445d-aa30-12379a7a04c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:49.435154 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a336a334-5245-445d-aa30-12379a7a04c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:49.435981 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a336a334-5245-445d-aa30-12379a7a04c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:49.437613 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a336a334-5245-445d-aa30-12379a7a04c2 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:49.449065 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1146/2312] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:44:49.453584 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e32b7-9674-4d95-b0f8-274dba7847de admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:49.464905 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e32b7-9674-4d95-b0f8-274dba7847de admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:49.470157 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0864a915-cb0b-4df5-9790-2422538dc979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:49.471076 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864a915-cb0b-4df5-9790-2422538dc979 admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:49.471420 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864a915-cb0b-4df5-9790-2422538dc979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:49.471645 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864a915-cb0b-4df5-9790-2422538dc979 admin admin] PATH_INFO: `/v3/projects/ee9c33cf2bf1406cbae749d958da3d41/users/e011e140e9f94408852c2af4085ac869/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:49.473768 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0864a915-cb0b-4df5-9790-2422538dc979 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee9c33cf2bf1406cbae749d958da3d41, user_id=e011e140e9f94408852c2af4085ac869, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:49.476498 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0864a915-cb0b-4df5-9790-2422538dc979 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:49.488775 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1167/2313] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:44:49 2022] PUT /identity/v3/projects/ee9c33cf2bf1406cbae749d958da3d41/users/e011e140e9f94408852c2af4085ac869/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:44:49.502094 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20804427-1939-461d-bac7-db366070351d None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:49.502496 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20804427-1939-461d-bac7-db366070351d None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:49.502784 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20804427-1939-461d-bac7-db366070351d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:49.531154 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-20804427-1939-461d-bac7-db366070351d None None] MFA Rules not processed for user `e011e140e9f94408852c2af4085ac869`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:44:49.532500 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-20804427-1939-461d-bac7-db366070351d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:49.615612 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1147/2314] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:44:49 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:44:49.627436 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0864a915-cb0b-4df5-9790-2422538dc979 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:49.629191 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-0864a915-cb0b-4df5-9790-2422538dc979 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:49.690560 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0864a915-cb0b-4df5-9790-2422538dc979 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:49.694239 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191af5ee-ba15-46a2-848d-5400da0685cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:49.694885 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191af5ee-ba15-46a2-848d-5400da0685cc service cinder] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:49.695171 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191af5ee-ba15-46a2-848d-5400da0685cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:49.695449 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191af5ee-ba15-46a2-848d-5400da0685cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:49.706850 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191af5ee-ba15-46a2-848d-5400da0685cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:49.708286 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191af5ee-ba15-46a2-848d-5400da0685cc service cinder] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:49.719105 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1168/2315] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:44:49 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:44:49.828712 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20804427-1939-461d-bac7-db366070351d None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:49.838633 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20804427-1939-461d-bac7-db366070351d None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:49.842710 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead8280-4e9a-42a7-81fd-2aa0bc5d9f65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:49.843393 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead8280-4e9a-42a7-81fd-2aa0bc5d9f65 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:49.843674 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead8280-4e9a-42a7-81fd-2aa0bc5d9f65 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:49.843945 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead8280-4e9a-42a7-81fd-2aa0bc5d9f65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:49.904566 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead8280-4e9a-42a7-81fd-2aa0bc5d9f65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:49.906074 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead8280-4e9a-42a7-81fd-2aa0bc5d9f65 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:49.915576 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1148/2316] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:44:49 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:44:53.028084 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191af5ee-ba15-46a2-848d-5400da0685cc service cinder] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:53.030165 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-191af5ee-ba15-46a2-848d-5400da0685cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:53.112339 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191af5ee-ba15-46a2-848d-5400da0685cc service cinder] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:53.120341 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b9c979-2055-4e57-82e6-32543f4388fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:53.121066 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b9c979-2055-4e57-82e6-32543f4388fd service neutron] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:53.121412 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b9c979-2055-4e57-82e6-32543f4388fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:53.121761 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b9c979-2055-4e57-82e6-32543f4388fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:53.123739 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-d6b9c979-2055-4e57-82e6-32543f4388fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:53.191162 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b9c979-2055-4e57-82e6-32543f4388fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:53.192658 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b9c979-2055-4e57-82e6-32543f4388fd service neutron] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:53.198353 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:44:53.203399 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1169/2317] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:44:53 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:44:53.304542 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead8280-4e9a-42a7-81fd-2aa0bc5d9f65 service cinder] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:53.401714 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead8280-4e9a-42a7-81fd-2aa0bc5d9f65 service cinder] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:53.407873 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ac0ba8-d22e-49f9-910b-8949cea258f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:53.408880 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac0ba8-d22e-49f9-910b-8949cea258f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:53.409273 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac0ba8-d22e-49f9-910b-8949cea258f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:53.409659 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac0ba8-d22e-49f9-910b-8949cea258f7 admin admin] PATH_INFO: `/v3/users/1469f77ff86c4f95b432be3a84c47be6` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:53.411677 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ac0ba8-d22e-49f9-910b-8949cea258f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1469f77ff86c4f95b432be3a84c47be6)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:53.413973 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ac0ba8-d22e-49f9-910b-8949cea258f7 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:53.420944 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:44:53.694182 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-04ac0ba8-d22e-49f9-910b-8949cea258f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1469f77ff86c4f95b432be3a84c47be6'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:53.838387 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-04ac0ba8-d22e-49f9-910b-8949cea258f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1469f77ff86c4f95b432be3a84c47be6'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:53.839032 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-04ac0ba8-d22e-49f9-910b-8949cea258f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1469f77ff86c4f95b432be3a84c47be6'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:53.852407 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-04ac0ba8-d22e-49f9-910b-8949cea258f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1469f77ff86c4f95b432be3a84c47be6'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:53.859900 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-04ac0ba8-d22e-49f9-910b-8949cea258f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1469f77ff86c4f95b432be3a84c47be6'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:53.867421 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1149/2318] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:44:53 2022] DELETE /identity/v3/users/1469f77ff86c4f95b432be3a84c47be6 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:44:53.873173 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d910ba-8d47-466a-a76e-2b3d0db6dd80 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:53.873549 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d910ba-8d47-466a-a76e-2b3d0db6dd80 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:53.873909 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d910ba-8d47-466a-a76e-2b3d0db6dd80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:53.895841 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-60d910ba-8d47-466a-a76e-2b3d0db6dd80 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:44:53.897093 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-60d910ba-8d47-466a-a76e-2b3d0db6dd80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:53.984714 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1170/2319] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:44:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:44:54.001321 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ac0ba8-d22e-49f9-910b-8949cea258f7 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:54.004157 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-04ac0ba8-d22e-49f9-910b-8949cea258f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:54.113405 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ac0ba8-d22e-49f9-910b-8949cea258f7 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:54.124499 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a4c50e-86d2-4e22-950f-01fbc41de09d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:54.126219 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4c50e-86d2-4e22-950f-01fbc41de09d service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:54.126828 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4c50e-86d2-4e22-950f-01fbc41de09d service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:54.127809 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a4c50e-86d2-4e22-950f-01fbc41de09d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:54.151373 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a4c50e-86d2-4e22-950f-01fbc41de09d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:54.152908 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a4c50e-86d2-4e22-950f-01fbc41de09d service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:54.164640 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1150/2320] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:44:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:44:54.450190 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d910ba-8d47-466a-a76e-2b3d0db6dd80 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:54.452180 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-60d910ba-8d47-466a-a76e-2b3d0db6dd80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:54.465544 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d910ba-8d47-466a-a76e-2b3d0db6dd80 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:54.475147 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cbb6f3-df70-4148-acf8-e90a81a042a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:54.475147 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cbb6f3-df70-4148-acf8-e90a81a042a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:54.475147 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cbb6f3-df70-4148-acf8-e90a81a042a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:54.475147 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cbb6f3-df70-4148-acf8-e90a81a042a3 admin admin] PATH_INFO: `/v3/users/e9c22b9719e148cd972637bc7b2fbc37` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:54.475729 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cbb6f3-df70-4148-acf8-e90a81a042a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9c22b9719e148cd972637bc7b2fbc37)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:54.477498 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cbb6f3-df70-4148-acf8-e90a81a042a3 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:54.770880 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-86cbb6f3-df70-4148-acf8-e90a81a042a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9c22b9719e148cd972637bc7b2fbc37'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:54.863682 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a4c50e-86d2-4e22-950f-01fbc41de09d service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:54.865964 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-64a4c50e-86d2-4e22-950f-01fbc41de09d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:54.879667 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a4c50e-86d2-4e22-950f-01fbc41de09d service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:54.888115 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc9beb-7d24-4bba-88ca-c4b9a0c68ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:54.889130 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc9beb-7d24-4bba-88ca-c4b9a0c68ca9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:54.889130 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc9beb-7d24-4bba-88ca-c4b9a0c68ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:54.889130 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc9beb-7d24-4bba-88ca-c4b9a0c68ca9 admin admin] PATH_INFO: `/v3/projects/10cf1a38ba294b21b212c41da7aea531` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:54.890464 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcc9beb-7d24-4bba-88ca-c4b9a0c68ca9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10cf1a38ba294b21b212c41da7aea531)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:54.892742 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcc9beb-7d24-4bba-88ca-c4b9a0c68ca9 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:54.900718 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-86cbb6f3-df70-4148-acf8-e90a81a042a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9c22b9719e148cd972637bc7b2fbc37'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:54.901617 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-86cbb6f3-df70-4148-acf8-e90a81a042a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9c22b9719e148cd972637bc7b2fbc37'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:54.936276 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-86cbb6f3-df70-4148-acf8-e90a81a042a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9c22b9719e148cd972637bc7b2fbc37'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:54.944293 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-86cbb6f3-df70-4148-acf8-e90a81a042a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9c22b9719e148cd972637bc7b2fbc37'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:54.956365 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1171/2321] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:44:54 2022] DELETE /identity/v3/users/e9c22b9719e148cd972637bc7b2fbc37 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:44:54.957935 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb9de2-0261-4055-99dd-abacc37c767e None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:54.958240 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb9de2-0261-4055-99dd-abacc37c767e None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:54.961152 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb9de2-0261-4055-99dd-abacc37c767e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:54.983511 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-c6bb9de2-0261-4055-99dd-abacc37c767e None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:44:54.984806 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-c6bb9de2-0261-4055-99dd-abacc37c767e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:55.064117 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1172/2322] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:44:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:44:55.077144 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb9de2-0261-4055-99dd-abacc37c767e None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:55.079011 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-c6bb9de2-0261-4055-99dd-abacc37c767e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:55.079749 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-2dcc9beb-7d24-4bba-88ca-c4b9a0c68ca9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10cf1a38ba294b21b212c41da7aea531', 'request_id': 'req-2dcc9beb-7d24-4bba-88ca-c4b9a0c68ca9'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:55.095103 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-2dcc9beb-7d24-4bba-88ca-c4b9a0c68ca9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10cf1a38ba294b21b212c41da7aea531', 'request_id': 'req-2dcc9beb-7d24-4bba-88ca-c4b9a0c68ca9'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:55.104768 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:44:55.112034 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-2dcc9beb-7d24-4bba-88ca-c4b9a0c68ca9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10cf1a38ba294b21b212c41da7aea531', 'request_id': 'req-2dcc9beb-7d24-4bba-88ca-c4b9a0c68ca9'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:55.158334 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb9de2-0261-4055-99dd-abacc37c767e None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:55.203583 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-2dcc9beb-7d24-4bba-88ca-c4b9a0c68ca9 admin admin] The token cache is being invalidate because project 10cf1a38ba294b21b212c41da7aea531 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:44:55.203912 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-2dcc9beb-7d24-4bba-88ca-c4b9a0c68ca9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:55.204599 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-2dcc9beb-7d24-4bba-88ca-c4b9a0c68ca9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:55.206487 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1151/2323] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:44:54 2022] DELETE /identity/v3/projects/10cf1a38ba294b21b212c41da7aea531 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:44:55.210108 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc9beb-7d24-4bba-88ca-c4b9a0c68ca9 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:55.211625 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-2dcc9beb-7d24-4bba-88ca-c4b9a0c68ca9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:55.216539 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25573841-9c39-4144-9a8b-08e4219f8f0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:55.217230 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25573841-9c39-4144-9a8b-08e4219f8f0f service neutron] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:55.217513 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25573841-9c39-4144-9a8b-08e4219f8f0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:55.217783 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25573841-9c39-4144-9a8b-08e4219f8f0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:55.219765 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-25573841-9c39-4144-9a8b-08e4219f8f0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:55.227545 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:44:55.311899 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc9beb-7d24-4bba-88ca-c4b9a0c68ca9 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:55.318278 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7b3d6c-ccce-4cfe-9c8e-d0102dd1256d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:55.320320 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b3d6c-ccce-4cfe-9c8e-d0102dd1256d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:55.320843 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b3d6c-ccce-4cfe-9c8e-d0102dd1256d admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:55.321390 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7b3d6c-ccce-4cfe-9c8e-d0102dd1256d admin admin] PATH_INFO: `/v3/users/e011e140e9f94408852c2af4085ac869` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:55.323339 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7b3d6c-ccce-4cfe-9c8e-d0102dd1256d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e011e140e9f94408852c2af4085ac869)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:55.325757 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7b3d6c-ccce-4cfe-9c8e-d0102dd1256d admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:55.344852 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25573841-9c39-4144-9a8b-08e4219f8f0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:55.346541 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25573841-9c39-4144-9a8b-08e4219f8f0f service neutron] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:55.368031 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1173/2324] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:44:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:44:55.558124 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-9d7b3d6c-ccce-4cfe-9c8e-d0102dd1256d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e011e140e9f94408852c2af4085ac869'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:55.704748 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-9d7b3d6c-ccce-4cfe-9c8e-d0102dd1256d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e011e140e9f94408852c2af4085ac869'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:55.705901 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-9d7b3d6c-ccce-4cfe-9c8e-d0102dd1256d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e011e140e9f94408852c2af4085ac869'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:55.746548 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-9d7b3d6c-ccce-4cfe-9c8e-d0102dd1256d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e011e140e9f94408852c2af4085ac869'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:55.766071 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-9d7b3d6c-ccce-4cfe-9c8e-d0102dd1256d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e011e140e9f94408852c2af4085ac869'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:55.777726 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1152/2325] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:44:55 2022] DELETE /identity/v3/users/e011e140e9f94408852c2af4085ac869 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:44:55.961083 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25573841-9c39-4144-9a8b-08e4219f8f0f service neutron] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:55.962695 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-25573841-9c39-4144-9a8b-08e4219f8f0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:55.978130 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25573841-9c39-4144-9a8b-08e4219f8f0f service neutron] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:56.064757 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3543e8-ac6e-4b1f-93ad-8a0a09804b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:56.065715 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3543e8-ac6e-4b1f-93ad-8a0a09804b57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:56.069811 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3543e8-ac6e-4b1f-93ad-8a0a09804b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:56.069811 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3543e8-ac6e-4b1f-93ad-8a0a09804b57 admin admin] PATH_INFO: `/v3/projects/88a852386cb349fa8cfb48d8180c693d` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:56.069811 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3543e8-ac6e-4b1f-93ad-8a0a09804b57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88a852386cb349fa8cfb48d8180c693d)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:56.070490 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3543e8-ac6e-4b1f-93ad-8a0a09804b57 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:56.097418 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:44:56.256980 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-fc3543e8-ac6e-4b1f-93ad-8a0a09804b57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88a852386cb349fa8cfb48d8180c693d', 'request_id': 'req-fc3543e8-ac6e-4b1f-93ad-8a0a09804b57'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:56.264107 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-fc3543e8-ac6e-4b1f-93ad-8a0a09804b57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88a852386cb349fa8cfb48d8180c693d', 'request_id': 'req-fc3543e8-ac6e-4b1f-93ad-8a0a09804b57'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:56.271913 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-fc3543e8-ac6e-4b1f-93ad-8a0a09804b57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88a852386cb349fa8cfb48d8180c693d', 'request_id': 'req-fc3543e8-ac6e-4b1f-93ad-8a0a09804b57'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:56.373348 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-fc3543e8-ac6e-4b1f-93ad-8a0a09804b57 admin admin] The token cache is being invalidate because project 88a852386cb349fa8cfb48d8180c693d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80392) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:44:56.373348 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-fc3543e8-ac6e-4b1f-93ad-8a0a09804b57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:56.373742 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-fc3543e8-ac6e-4b1f-93ad-8a0a09804b57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:56.378904 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1174/2326] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:44:55 2022] DELETE /identity/v3/projects/88a852386cb349fa8cfb48d8180c693d => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:44:56.380407 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b2264-ab11-431b-95d0-6260dedb36b5 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:56.380856 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b2264-ab11-431b-95d0-6260dedb36b5 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:56.381024 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6b2264-ab11-431b-95d0-6260dedb36b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:56.402863 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-0a6b2264-ab11-431b-95d0-6260dedb36b5 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:44:56.404120 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-0a6b2264-ab11-431b-95d0-6260dedb36b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:56.484516 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1153/2327] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:44:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:44:56.492165 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b76f5f-5fe6-4223-9c19-bea58252de99 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:56.492458 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b76f5f-5fe6-4223-9c19-bea58252de99 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:56.492833 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b76f5f-5fe6-4223-9c19-bea58252de99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:56.521983 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-18b76f5f-5fe6-4223-9c19-bea58252de99 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:44:56.523288 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-18b76f5f-5fe6-4223-9c19-bea58252de99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:56.537024 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1175/2328] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:44:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:44:56.542344 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6b2264-ab11-431b-95d0-6260dedb36b5 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:56.552715 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6b2264-ab11-431b-95d0-6260dedb36b5 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:56.557525 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c16c1-ae02-4d47-8609-7ce7ba0b36de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:56.558188 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c16c1-ae02-4d47-8609-7ce7ba0b36de admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:56.558470 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c16c1-ae02-4d47-8609-7ce7ba0b36de admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:56.558749 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c16c1-ae02-4d47-8609-7ce7ba0b36de admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:56.559477 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50c16c1-ae02-4d47-8609-7ce7ba0b36de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:44:56.559784 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50c16c1-ae02-4d47-8609-7ce7ba0b36de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:56.561438 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50c16c1-ae02-4d47-8609-7ce7ba0b36de admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:56.579109 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1154/2329] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 10:44:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:44:56.584850 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b76f5f-5fe6-4223-9c19-bea58252de99 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:56.596771 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b76f5f-5fe6-4223-9c19-bea58252de99 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:56.601892 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8320e0-ce09-4001-a5ac-dbb5cc5059f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:56.602256 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8320e0-ce09-4001-a5ac-dbb5cc5059f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:56.602544 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8320e0-ce09-4001-a5ac-dbb5cc5059f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:56.602949 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8320e0-ce09-4001-a5ac-dbb5cc5059f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:56.604801 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8320e0-ce09-4001-a5ac-dbb5cc5059f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:56.606786 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8320e0-ce09-4001-a5ac-dbb5cc5059f6 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:56.693531 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c16c1-ae02-4d47-8609-7ce7ba0b36de admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:56.695954 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-e50c16c1-ae02-4d47-8609-7ce7ba0b36de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:56.712390 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c16c1-ae02-4d47-8609-7ce7ba0b36de admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:56.717887 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c94f1-20f6-4c6e-a866-34a5d1cfbb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:56.718885 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c94f1-20f6-4c6e-a866-34a5d1cfbb1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:56.719123 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c94f1-20f6-4c6e-a866-34a5d1cfbb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:56.719432 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c94f1-20f6-4c6e-a866-34a5d1cfbb1b admin admin] PATH_INFO: `/v3/projects/ee9c33cf2bf1406cbae749d958da3d41` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:56.720802 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4c94f1-20f6-4c6e-a866-34a5d1cfbb1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee9c33cf2bf1406cbae749d958da3d41)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:56.722821 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4c94f1-20f6-4c6e-a866-34a5d1cfbb1b admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:56.742901 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:44:56.746056 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1176/2330] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:44:56 2022] POST /identity/v3/projects => generated 397 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:44:56.749873 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8320e0-ce09-4001-a5ac-dbb5cc5059f6 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:56.848711 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8320e0-ce09-4001-a5ac-dbb5cc5059f6 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:56.855188 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24da1216-8c93-4468-af61-40655d92976c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:56.855188 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da1216-8c93-4468-af61-40655d92976c admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:56.857765 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da1216-8c93-4468-af61-40655d92976c admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:56.857765 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da1216-8c93-4468-af61-40655d92976c admin admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:56.857765 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24da1216-8c93-4468-af61-40655d92976c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:56.859152 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24da1216-8c93-4468-af61-40655d92976c admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:56.909141 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-6d4c94f1-20f6-4c6e-a866-34a5d1cfbb1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee9c33cf2bf1406cbae749d958da3d41', 'request_id': 'req-6d4c94f1-20f6-4c6e-a866-34a5d1cfbb1b'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:56.917001 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-6d4c94f1-20f6-4c6e-a866-34a5d1cfbb1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee9c33cf2bf1406cbae749d958da3d41', 'request_id': 'req-6d4c94f1-20f6-4c6e-a866-34a5d1cfbb1b'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:56.923673 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-6d4c94f1-20f6-4c6e-a866-34a5d1cfbb1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee9c33cf2bf1406cbae749d958da3d41', 'request_id': 'req-6d4c94f1-20f6-4c6e-a866-34a5d1cfbb1b'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:57.000111 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1177/2331] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:44:56 2022] POST /identity/v3/users => generated 299 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:44:57.002015 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9049340-0ba1-4d20-99b3-8854f737116b None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:57.002320 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9049340-0ba1-4d20-99b3-8854f737116b None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:57.002601 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9049340-0ba1-4d20-99b3-8854f737116b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:57.034456 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-6d4c94f1-20f6-4c6e-a866-34a5d1cfbb1b admin admin] The token cache is being invalidate because project ee9c33cf2bf1406cbae749d958da3d41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:44:57.034456 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-6d4c94f1-20f6-4c6e-a866-34a5d1cfbb1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:57.037533 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-6d4c94f1-20f6-4c6e-a866-34a5d1cfbb1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:57.038066 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-e9049340-0ba1-4d20-99b3-8854f737116b None None] MFA Rules not processed for user `88ad60446c5447a8bbd0096fa2133efb`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:44:57.040280 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1155/2332] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:44:56 2022] DELETE /identity/v3/projects/ee9c33cf2bf1406cbae749d958da3d41 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:44:57.040509 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-e9049340-0ba1-4d20-99b3-8854f737116b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:57.044756 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c94f1-20f6-4c6e-a866-34a5d1cfbb1b admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:57.048306 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-6d4c94f1-20f6-4c6e-a866-34a5d1cfbb1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:57.153840 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1178/2333] 10.222.0.39 () {58 vars in 967 bytes} [Mon Jul 18 10:44:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:44:57.155000 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9049340-0ba1-4d20-99b3-8854f737116b None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:57.156729 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-e9049340-0ba1-4d20-99b3-8854f737116b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:57.194057 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:44:57.208450 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c94f1-20f6-4c6e-a866-34a5d1cfbb1b admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:57.237877 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ace9eb-6f08-4a08-879d-703a8769024c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:57.237877 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ace9eb-6f08-4a08-879d-703a8769024c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:57.237877 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ace9eb-6f08-4a08-879d-703a8769024c admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:57.237877 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ace9eb-6f08-4a08-879d-703a8769024c admin admin] PATH_INFO: `/v3/users/75fd2cec14f4445bb4c1e26c10d04d36` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:57.241655 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ace9eb-6f08-4a08-879d-703a8769024c admin admin] RBAC: Authorizing `identity:delete_user(user_id=75fd2cec14f4445bb4c1e26c10d04d36)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:57.244103 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ace9eb-6f08-4a08-879d-703a8769024c admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:57.301365 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9049340-0ba1-4d20-99b3-8854f737116b None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:57.308546 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4857cda5-cd11-4aa1-b716-28a917fa06cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:57.309260 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857cda5-cd11-4aa1-b716-28a917fa06cb admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:57.309546 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857cda5-cd11-4aa1-b716-28a917fa06cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:57.309944 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857cda5-cd11-4aa1-b716-28a917fa06cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:57.311319 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4857cda5-cd11-4aa1-b716-28a917fa06cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:57.312950 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4857cda5-cd11-4aa1-b716-28a917fa06cb admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:57.328268 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1179/2334] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:44:57 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:44:57.328268 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5846ba7-0d01-4b1b-8d8a-04a8861a11cc None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:57.328268 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5846ba7-0d01-4b1b-8d8a-04a8861a11cc None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:57.328268 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5846ba7-0d01-4b1b-8d8a-04a8861a11cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:57.355877 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-a5846ba7-0d01-4b1b-8d8a-04a8861a11cc None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:44:57.358497 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-a5846ba7-0d01-4b1b-8d8a-04a8861a11cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:57.368313 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1180/2335] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:44:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:44:57.375369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5846ba7-0d01-4b1b-8d8a-04a8861a11cc None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:57.375369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-a5846ba7-0d01-4b1b-8d8a-04a8861a11cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:57.486733 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5846ba7-0d01-4b1b-8d8a-04a8861a11cc None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:57.492828 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5660f7-2f11-4f16-80cc-38665732f656 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c548474a8d94591ba58dd40e40a28d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:57.494303 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5660f7-2f11-4f16-80cc-38665732f656 service swift] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:57.494303 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5660f7-2f11-4f16-80cc-38665732f656 service swift] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:57.494303 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5660f7-2f11-4f16-80cc-38665732f656 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:57.503691 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5660f7-2f11-4f16-80cc-38665732f656 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:57.505351 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5660f7-2f11-4f16-80cc-38665732f656 service swift] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:57.514893 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1181/2336] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Jul 18 10:44:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 10:44:57.515560 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5660f7-2f11-4f16-80cc-38665732f656 service swift] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:57.531267 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5660f7-2f11-4f16-80cc-38665732f656 service swift] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:57.533215 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da928b-5e95-4068-b734-63ff44e19e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:57.534046 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da928b-5e95-4068-b734-63ff44e19e1d admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:57.534435 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da928b-5e95-4068-b734-63ff44e19e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:57.535282 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da928b-5e95-4068-b734-63ff44e19e1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:57.535816 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63da928b-5e95-4068-b734-63ff44e19e1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:57.537856 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63da928b-5e95-4068-b734-63ff44e19e1d admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:57.555552 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-57ace9eb-6f08-4a08-879d-703a8769024c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75fd2cec14f4445bb4c1e26c10d04d36'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:57.560087 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1182/2337] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:44:57 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:44:57.561966 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f159c-f860-46c6-bbe3-025e03bf6bbc None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:57.562453 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f159c-f860-46c6-bbe3-025e03bf6bbc None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:57.563040 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f159c-f860-46c6-bbe3-025e03bf6bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:57.590010 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-349f159c-f860-46c6-bbe3-025e03bf6bbc None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:44:57.591573 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-349f159c-f860-46c6-bbe3-025e03bf6bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:57.605393 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1183/2338] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:44:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:44:57.606450 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349f159c-f860-46c6-bbe3-025e03bf6bbc None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:57.616818 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349f159c-f860-46c6-bbe3-025e03bf6bbc None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:57.622018 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b431b7-30f0-4bb0-9356-77c0b95f817a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:57.622914 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b431b7-30f0-4bb0-9356-77c0b95f817a admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:57.623198 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b431b7-30f0-4bb0-9356-77c0b95f817a admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:57.623470 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b431b7-30f0-4bb0-9356-77c0b95f817a admin admin] PATH_INFO: `/v3/projects/c0c7e2c3a18843168568e1d0fa16ace0/users/f18a7608214041409a18ff4656cf2962/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:57.644521 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b431b7-30f0-4bb0-9356-77c0b95f817a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0c7e2c3a18843168568e1d0fa16ace0, user_id=f18a7608214041409a18ff4656cf2962, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:57.649238 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b431b7-30f0-4bb0-9356-77c0b95f817a admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:57.740403 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-57ace9eb-6f08-4a08-879d-703a8769024c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75fd2cec14f4445bb4c1e26c10d04d36'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:57.741053 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-57ace9eb-6f08-4a08-879d-703a8769024c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75fd2cec14f4445bb4c1e26c10d04d36'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:57.756846 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-57ace9eb-6f08-4a08-879d-703a8769024c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75fd2cec14f4445bb4c1e26c10d04d36'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:57.765952 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-57ace9eb-6f08-4a08-879d-703a8769024c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75fd2cec14f4445bb4c1e26c10d04d36'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:57.772518 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1156/2339] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:44:57 2022] DELETE /identity/v3/users/75fd2cec14f4445bb4c1e26c10d04d36 => generated 0 bytes in 731 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:44:57.773391 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ace9eb-6f08-4a08-879d-703a8769024c admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:57.774835 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-57ace9eb-6f08-4a08-879d-703a8769024c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:57.792637 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1184/2340] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:44:57 2022] PUT /identity/v3/projects/c0c7e2c3a18843168568e1d0fa16ace0/users/f18a7608214041409a18ff4656cf2962/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:44:57.794368 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fea02c-bcea-4413-9e97-1ff0abdffbc8 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:57.794675 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fea02c-bcea-4413-9e97-1ff0abdffbc8 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:57.794972 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fea02c-bcea-4413-9e97-1ff0abdffbc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:57.826838 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:44:57.831198 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-66fea02c-bcea-4413-9e97-1ff0abdffbc8 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:44:57.833224 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-66fea02c-bcea-4413-9e97-1ff0abdffbc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:57.886152 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ace9eb-6f08-4a08-879d-703a8769024c admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:57.922177 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1185/2341] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:44:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:44:57.926141 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efb66a1-5606-4db5-8e01-03e420db6fe3 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:57.926141 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efb66a1-5606-4db5-8e01-03e420db6fe3 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:57.926141 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efb66a1-5606-4db5-8e01-03e420db6fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:57.967520 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-9efb66a1-5606-4db5-8e01-03e420db6fe3 None None] MFA Rules not processed for user `f18a7608214041409a18ff4656cf2962`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:44:57.968712 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23dc1ec-d6de-4d26-ba13-41144bff053d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:57.968928 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-9efb66a1-5606-4db5-8e01-03e420db6fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:57.969960 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23dc1ec-d6de-4d26-ba13-41144bff053d admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:57.970511 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23dc1ec-d6de-4d26-ba13-41144bff053d admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:57.971054 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23dc1ec-d6de-4d26-ba13-41144bff053d admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:57.972021 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23dc1ec-d6de-4d26-ba13-41144bff053d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:44:57.972556 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23dc1ec-d6de-4d26-ba13-41144bff053d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:57.975048 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23dc1ec-d6de-4d26-ba13-41144bff053d admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:57.998151 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1157/2342] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 10:44:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:44:57.998151 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23dc1ec-d6de-4d26-ba13-41144bff053d admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:58.000511 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-f23dc1ec-d6de-4d26-ba13-41144bff053d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:58.055363 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1186/2343] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:44:57 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:44:58.056529 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efb66a1-5606-4db5-8e01-03e420db6fe3 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:58.065415 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23dc1ec-d6de-4d26-ba13-41144bff053d admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:58.069534 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4274a1b-dbee-4787-a9ed-ea3a49fd4ea1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:58.070186 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4274a1b-dbee-4787-a9ed-ea3a49fd4ea1 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:58.070470 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4274a1b-dbee-4787-a9ed-ea3a49fd4ea1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:58.070917 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4274a1b-dbee-4787-a9ed-ea3a49fd4ea1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:58.077907 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efb66a1-5606-4db5-8e01-03e420db6fe3 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:58.082045 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4274a1b-dbee-4787-a9ed-ea3a49fd4ea1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:58.083607 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4274a1b-dbee-4787-a9ed-ea3a49fd4ea1 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:58.083995 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51270564-53e1-47b7-8d99-7172147217bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:58.084668 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51270564-53e1-47b7-8d99-7172147217bb admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:58.084953 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51270564-53e1-47b7-8d99-7172147217bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:58.085316 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51270564-53e1-47b7-8d99-7172147217bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:58.086025 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51270564-53e1-47b7-8d99-7172147217bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:58.089659 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51270564-53e1-47b7-8d99-7172147217bb admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:58.109469 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1158/2344] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:44:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:44:58.109469 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4274a1b-dbee-4787-a9ed-ea3a49fd4ea1 service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:58.109469 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-d4274a1b-dbee-4787-a9ed-ea3a49fd4ea1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:58.195018 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4274a1b-dbee-4787-a9ed-ea3a49fd4ea1 service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:58.200148 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d164065-1e64-46bf-ae88-52f689534f9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:58.200834 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d164065-1e64-46bf-ae88-52f689534f9b service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:58.201149 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d164065-1e64-46bf-ae88-52f689534f9b service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:58.201429 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d164065-1e64-46bf-ae88-52f689534f9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:58.211609 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d164065-1e64-46bf-ae88-52f689534f9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:58.214225 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d164065-1e64-46bf-ae88-52f689534f9b service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:58.226068 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1159/2345] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:44:58 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:44:58.327376 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1187/2346] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:44:58 2022] POST /identity/v3/projects => generated 379 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:44:58.331731 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d164065-1e64-46bf-ae88-52f689534f9b service cinder] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:58.348475 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d164065-1e64-46bf-ae88-52f689534f9b service cinder] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:58.437230 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaef9a1-1e56-49dc-8d03-a064b2c1f5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:58.438753 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaef9a1-1e56-49dc-8d03-a064b2c1f5d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:58.439281 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaef9a1-1e56-49dc-8d03-a064b2c1f5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:58.439957 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaef9a1-1e56-49dc-8d03-a064b2c1f5d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:58.441118 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaef9a1-1e56-49dc-8d03-a064b2c1f5d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:58.443388 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaef9a1-1e56-49dc-8d03-a064b2c1f5d4 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:58.595337 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1160/2347] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:44:58 2022] POST /identity/v3/users => generated 290 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:44:58.599835 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51270564-53e1-47b7-8d99-7172147217bb admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:58.614738 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51270564-53e1-47b7-8d99-7172147217bb admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:58.622182 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc0cd4d-2574-4a5c-b8e4-63632a0f9ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:58.623160 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0cd4d-2574-4a5c-b8e4-63632a0f9ed4 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:58.623512 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0cd4d-2574-4a5c-b8e4-63632a0f9ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:58.624263 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0cd4d-2574-4a5c-b8e4-63632a0f9ed4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:58.625349 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc0cd4d-2574-4a5c-b8e4-63632a0f9ed4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:58.628515 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc0cd4d-2574-4a5c-b8e4-63632a0f9ed4 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:58.646722 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1188/2348] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:44:58 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:44:58.648250 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaef9a1-1e56-49dc-8d03-a064b2c1f5d4 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:58.660481 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaef9a1-1e56-49dc-8d03-a064b2c1f5d4 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:58.665282 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:44:58.669139 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c4f09b-b1ee-45d7-9c6c-8218fb15c39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:58.670274 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c4f09b-b1ee-45d7-9c6c-8218fb15c39d admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:58.670743 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c4f09b-b1ee-45d7-9c6c-8218fb15c39d admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:58.671243 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c4f09b-b1ee-45d7-9c6c-8218fb15c39d admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:58.672645 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c4f09b-b1ee-45d7-9c6c-8218fb15c39d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:58.674839 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c4f09b-b1ee-45d7-9c6c-8218fb15c39d admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:58.687682 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1161/2349] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:44:58 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:44:58.693473 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc0cd4d-2574-4a5c-b8e4-63632a0f9ed4 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:58.704815 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc0cd4d-2574-4a5c-b8e4-63632a0f9ed4 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:58.710270 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bf8ea1-4c6e-4ef9-9661-418f6bb46bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:58.711205 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf8ea1-4c6e-4ef9-9661-418f6bb46bd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:58.711492 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf8ea1-4c6e-4ef9-9661-418f6bb46bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:58.711772 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf8ea1-4c6e-4ef9-9661-418f6bb46bd8 admin admin] PATH_INFO: `/v3/projects/01f49ee8fce34d0c88acd519b9068030/users/e99903bf41f74a9f91266a19e5a455e8/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:58.729564 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bf8ea1-4c6e-4ef9-9661-418f6bb46bd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01f49ee8fce34d0c88acd519b9068030, user_id=e99903bf41f74a9f91266a19e5a455e8, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:58.732282 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bf8ea1-4c6e-4ef9-9661-418f6bb46bd8 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:58.813179 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c4f09b-b1ee-45d7-9c6c-8218fb15c39d admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:58.816191 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c9c4f09b-b1ee-45d7-9c6c-8218fb15c39d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:58.832159 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c4f09b-b1ee-45d7-9c6c-8218fb15c39d admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:58.845700 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ca60e4-648b-4940-80e6-63767ffecb36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:58.846590 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca60e4-648b-4940-80e6-63767ffecb36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:58.846878 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca60e4-648b-4940-80e6-63767ffecb36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:58.847157 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca60e4-648b-4940-80e6-63767ffecb36 admin admin] PATH_INFO: `/v3/projects/d9d5d870b1b14c7a989c0a304ef4da7c` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:58.848380 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ca60e4-648b-4940-80e6-63767ffecb36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9d5d870b1b14c7a989c0a304ef4da7c)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:58.851085 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ca60e4-648b-4940-80e6-63767ffecb36 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:58.868163 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1189/2350] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:44:58 2022] PUT /identity/v3/projects/01f49ee8fce34d0c88acd519b9068030/users/e99903bf41f74a9f91266a19e5a455e8/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:44:58.881018 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03de8b-eef4-4db5-a449-1a173cff9bad None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:58.881560 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03de8b-eef4-4db5-a449-1a173cff9bad None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:58.881995 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03de8b-eef4-4db5-a449-1a173cff9bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:58.916894 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-ac03de8b-eef4-4db5-a449-1a173cff9bad None None] MFA Rules not processed for user `e99903bf41f74a9f91266a19e5a455e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:44:58.918104 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-ac03de8b-eef4-4db5-a449-1a173cff9bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:58.998449 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1190/2351] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:44:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:44:59.003424 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac03de8b-eef4-4db5-a449-1a173cff9bad None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:59.070002 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-f4ca60e4-648b-4940-80e6-63767ffecb36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9d5d870b1b14c7a989c0a304ef4da7c', 'request_id': 'req-f4ca60e4-648b-4940-80e6-63767ffecb36'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:59.079277 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-f4ca60e4-648b-4940-80e6-63767ffecb36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9d5d870b1b14c7a989c0a304ef4da7c', 'request_id': 'req-f4ca60e4-648b-4940-80e6-63767ffecb36'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:59.089973 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac03de8b-eef4-4db5-a449-1a173cff9bad None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:59.094681 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-f4ca60e4-648b-4940-80e6-63767ffecb36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9d5d870b1b14c7a989c0a304ef4da7c', 'request_id': 'req-f4ca60e4-648b-4940-80e6-63767ffecb36'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:59.154442 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6444e1-3b4f-441e-b0d4-6697c01cba7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:59.155431 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6444e1-3b4f-441e-b0d4-6697c01cba7f admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:59.155872 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6444e1-3b4f-441e-b0d4-6697c01cba7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:59.156230 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6444e1-3b4f-441e-b0d4-6697c01cba7f admin admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:59.157452 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6444e1-3b4f-441e-b0d4-6697c01cba7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:59.160578 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6444e1-3b4f-441e-b0d4-6697c01cba7f admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:59.169098 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:44:59.233781 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-f4ca60e4-648b-4940-80e6-63767ffecb36 admin admin] The token cache is being invalidate because project d9d5d870b1b14c7a989c0a304ef4da7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:44:59.233781 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-f4ca60e4-648b-4940-80e6-63767ffecb36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:59.234238 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-f4ca60e4-648b-4940-80e6-63767ffecb36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:44:59.236823 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1162/2352] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:44:58 2022] DELETE /identity/v3/projects/d9d5d870b1b14c7a989c0a304ef4da7c => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:44:59.242884 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368bc487-1183-43c2-9e5c-3042c6962e39 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:59.243176 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368bc487-1183-43c2-9e5c-3042c6962e39 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:59.243456 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368bc487-1183-43c2-9e5c-3042c6962e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:59.265550 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-368bc487-1183-43c2-9e5c-3042c6962e39 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:44:59.268375 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-368bc487-1183-43c2-9e5c-3042c6962e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:59.269948 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1191/2353] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:44:59 2022] POST /identity/v3/projects => generated 379 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:44:59.274643 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6444e1-3b4f-441e-b0d4-6697c01cba7f admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:59.277713 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-dc6444e1-3b4f-441e-b0d4-6697c01cba7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:59.363904 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1163/2354] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:44:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:44:59.366668 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6694261-fb4c-4298-96a0-8fa45e01045a None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:59.367049 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6694261-fb4c-4298-96a0-8fa45e01045a None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:59.371913 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6694261-fb4c-4298-96a0-8fa45e01045a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:59.381236 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6444e1-3b4f-441e-b0d4-6697c01cba7f admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:59.384778 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:44:59.393733 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191fc6c-b5fb-4a2d-ac25-3db6baf2ddf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:59.395048 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191fc6c-b5fb-4a2d-ac25-3db6baf2ddf4 admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:59.395325 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191fc6c-b5fb-4a2d-ac25-3db6baf2ddf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:59.395640 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8191fc6c-b5fb-4a2d-ac25-3db6baf2ddf4 admin admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:59.396502 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8191fc6c-b5fb-4a2d-ac25-3db6baf2ddf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:59.398482 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8191fc6c-b5fb-4a2d-ac25-3db6baf2ddf4 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:59.400917 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-b6694261-fb4c-4298-96a0-8fa45e01045a None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:44:59.402730 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-b6694261-fb4c-4298-96a0-8fa45e01045a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:44:59.417203 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1164/2355] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:44:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:44:59.419120 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6694261-fb4c-4298-96a0-8fa45e01045a None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:59.429466 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6694261-fb4c-4298-96a0-8fa45e01045a None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:59.434655 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a908cc67-f0e0-4a02-a9e6-fe258a61811d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:59.435832 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908cc67-f0e0-4a02-a9e6-fe258a61811d admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:59.435832 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908cc67-f0e0-4a02-a9e6-fe258a61811d admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:59.442779 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908cc67-f0e0-4a02-a9e6-fe258a61811d admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:59.442779 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a908cc67-f0e0-4a02-a9e6-fe258a61811d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:44:59.442779 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a908cc67-f0e0-4a02-a9e6-fe258a61811d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:59.442779 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a908cc67-f0e0-4a02-a9e6-fe258a61811d admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:59.453319 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1165/2356] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 10:44:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:44:59.455715 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a908cc67-f0e0-4a02-a9e6-fe258a61811d admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:59.466858 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a908cc67-f0e0-4a02-a9e6-fe258a61811d admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:59.471669 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa749c8-a923-4c54-9122-637ab485f69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:59.472326 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa749c8-a923-4c54-9122-637ab485f69b admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:59.472608 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa749c8-a923-4c54-9122-637ab485f69b admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:59.472882 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa749c8-a923-4c54-9122-637ab485f69b admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:59.473593 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa749c8-a923-4c54-9122-637ab485f69b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:59.475563 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa749c8-a923-4c54-9122-637ab485f69b admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:59.575881 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:44:59.584586 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1192/2357] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:44:59 2022] POST /identity/v3/users => generated 296 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:44:59.589080 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191fc6c-b5fb-4a2d-ac25-3db6baf2ddf4 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:59.600443 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8191fc6c-b5fb-4a2d-ac25-3db6baf2ddf4 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:59.606724 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac46cc9-4bad-4c0f-9e35-86df648553f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:59.607417 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac46cc9-4bad-4c0f-9e35-86df648553f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:59.607723 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac46cc9-4bad-4c0f-9e35-86df648553f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:59.608003 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac46cc9-4bad-4c0f-9e35-86df648553f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:59.608773 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac46cc9-4bad-4c0f-9e35-86df648553f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:59.610490 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac46cc9-4bad-4c0f-9e35-86df648553f5 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:59.622730 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1193/2358] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:44:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 10:44:59.627460 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac46cc9-4bad-4c0f-9e35-86df648553f5 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:59.635635 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1166/2359] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:44:59 2022] POST /identity/v3/projects => generated 373 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:44:59.639597 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac46cc9-4bad-4c0f-9e35-86df648553f5 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:59.641250 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa749c8-a923-4c54-9122-637ab485f69b admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:59.723383 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa749c8-a923-4c54-9122-637ab485f69b admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:59.728106 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a2d9b-4aaa-47b6-a30e-125361869e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:59.728801 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a2d9b-4aaa-47b6-a30e-125361869e79 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:59.729102 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a2d9b-4aaa-47b6-a30e-125361869e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:59.729380 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a2d9b-4aaa-47b6-a30e-125361869e79 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:59.730070 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037a2d9b-4aaa-47b6-a30e-125361869e79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:59.734828 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037a2d9b-4aaa-47b6-a30e-125361869e79 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:59.736567 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafcfea4-ebb5-489b-b396-d1bd28132259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:59.736868 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafcfea4-ebb5-489b-b396-d1bd28132259 admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:59.737091 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafcfea4-ebb5-489b-b396-d1bd28132259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:59.737509 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafcfea4-ebb5-489b-b396-d1bd28132259 admin admin] PATH_INFO: `/v3/projects/0b1b9d0bd44f41fa921eb7e623ef4d9d/users/bb157f97361e422492cc95074667365f/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:59.757281 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafcfea4-ebb5-489b-b396-d1bd28132259 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b1b9d0bd44f41fa921eb7e623ef4d9d, user_id=bb157f97361e422492cc95074667365f, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:59.761465 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafcfea4-ebb5-489b-b396-d1bd28132259 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:59.814213 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1167/2360] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:44:59 2022] POST /identity/v3/users => generated 287 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:44:59.818116 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a2d9b-4aaa-47b6-a30e-125361869e79 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:59.831628 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a2d9b-4aaa-47b6-a30e-125361869e79 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:59.838982 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53669a08-4c4e-47ca-a2dd-30f34ea8d1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:59.839704 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53669a08-4c4e-47ca-a2dd-30f34ea8d1e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:59.840188 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53669a08-4c4e-47ca-a2dd-30f34ea8d1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:59.840485 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53669a08-4c4e-47ca-a2dd-30f34ea8d1e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:59.841719 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53669a08-4c4e-47ca-a2dd-30f34ea8d1e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:59.849436 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53669a08-4c4e-47ca-a2dd-30f34ea8d1e7 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:59.849662 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1194/2361] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:44:59 2022] PUT /identity/v3/projects/0b1b9d0bd44f41fa921eb7e623ef4d9d/users/bb157f97361e422492cc95074667365f/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:44:59.852422 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafcfea4-ebb5-489b-b396-d1bd28132259 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:59.862612 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1168/2362] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:44:59 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 10:44:59.866899 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53669a08-4c4e-47ca-a2dd-30f34ea8d1e7 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:59.878655 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53669a08-4c4e-47ca-a2dd-30f34ea8d1e7 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:59.939411 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafcfea4-ebb5-489b-b396-d1bd28132259 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:59.944424 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df8b417-875c-47c1-8619-e61483758b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:59.945137 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df8b417-875c-47c1-8619-e61483758b8d admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:59.945541 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df8b417-875c-47c1-8619-e61483758b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:59.946024 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df8b417-875c-47c1-8619-e61483758b8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:59.948387 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df8b417-875c-47c1-8619-e61483758b8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:59.950129 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df8b417-875c-47c1-8619-e61483758b8d admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:59.958164 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3899e78-a48b-44a1-b4fa-9f12d6578be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:59.959754 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3899e78-a48b-44a1-b4fa-9f12d6578be1 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:59.960683 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3899e78-a48b-44a1-b4fa-9f12d6578be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:59.961247 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1195/2363] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:44:59 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 10:44:59.961479 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3899e78-a48b-44a1-b4fa-9f12d6578be1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:59.966058 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3899e78-a48b-44a1-b4fa-9f12d6578be1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:59.966628 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df8b417-875c-47c1-8619-e61483758b8d admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:44:59.971810 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3899e78-a48b-44a1-b4fa-9f12d6578be1 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:59.978386 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df8b417-875c-47c1-8619-e61483758b8d admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:44:59.983331 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1169/2364] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:44:59 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 10:44:59.989931 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ecdab-a41f-4742-a2a7-b8ee1e9fabaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:44:59.990879 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ecdab-a41f-4742-a2a7-b8ee1e9fabaf admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:44:59.991162 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ecdab-a41f-4742-a2a7-b8ee1e9fabaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:44:59.991438 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ecdab-a41f-4742-a2a7-b8ee1e9fabaf admin admin] PATH_INFO: `/v3/projects/0b1b9d0bd44f41fa921eb7e623ef4d9d/users/bb157f97361e422492cc95074667365f/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:44:59.993501 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47ecdab-a41f-4742-a2a7-b8ee1e9fabaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b1b9d0bd44f41fa921eb7e623ef4d9d, user_id=bb157f97361e422492cc95074667365f, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:44:59.996663 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47ecdab-a41f-4742-a2a7-b8ee1e9fabaf admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:44:59.999145 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3899e78-a48b-44a1-b4fa-9f12d6578be1 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:00.008631 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1196/2365] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:44:59 2022] PUT /identity/v3/projects/0b1b9d0bd44f41fa921eb7e623ef4d9d/users/bb157f97361e422492cc95074667365f/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:45:00.011584 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:45:00.013241 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3899e78-a48b-44a1-b4fa-9f12d6578be1 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:00.018597 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11401ed-0832-4374-9a09-b4ad80425ef4 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:00.018883 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11401ed-0832-4374-9a09-b4ad80425ef4 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:00.019157 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11401ed-0832-4374-9a09-b4ad80425ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:00.051469 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-d11401ed-0832-4374-9a09-b4ad80425ef4 None None] MFA Rules not processed for user `bb157f97361e422492cc95074667365f`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:45:00.052810 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-d11401ed-0832-4374-9a09-b4ad80425ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:00.075875 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f20f5f-1fb5-4f5d-b16a-b2dc90726b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:00.076770 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f20f5f-1fb5-4f5d-b16a-b2dc90726b3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:00.077079 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f20f5f-1fb5-4f5d-b16a-b2dc90726b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:00.077426 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f20f5f-1fb5-4f5d-b16a-b2dc90726b3c admin admin] PATH_INFO: `/v3/projects/a278142efe41426c9399a831031a3613/users/44e80095b0714c85bd27375d864a55f2/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:00.094920 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f20f5f-1fb5-4f5d-b16a-b2dc90726b3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a278142efe41426c9399a831031a3613, user_id=44e80095b0714c85bd27375d864a55f2, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:00.097632 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f20f5f-1fb5-4f5d-b16a-b2dc90726b3c admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:00.141824 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1197/2366] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:45:00 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:45:00.153968 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11401ed-0832-4374-9a09-b4ad80425ef4 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:00.155545 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-d11401ed-0832-4374-9a09-b4ad80425ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:00.214513 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11401ed-0832-4374-9a09-b4ad80425ef4 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:00.218264 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26278461-6baf-4a92-b09b-b67e62115742 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:00.218946 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26278461-6baf-4a92-b09b-b67e62115742 service cinder] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:00.219227 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26278461-6baf-4a92-b09b-b67e62115742 service cinder] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:00.219502 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26278461-6baf-4a92-b09b-b67e62115742 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:00.229252 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26278461-6baf-4a92-b09b-b67e62115742 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:00.230606 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26278461-6baf-4a92-b09b-b67e62115742 service cinder] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:00.239048 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1170/2367] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:44:59 2022] PUT /identity/v3/projects/a278142efe41426c9399a831031a3613/users/44e80095b0714c85bd27375d864a55f2/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:45:00.244195 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1198/2368] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:45:00 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:45:00.251552 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab5c932-e9f5-420c-aba7-9b5af586ff16 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:00.251924 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab5c932-e9f5-420c-aba7-9b5af586ff16 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:00.252281 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab5c932-e9f5-420c-aba7-9b5af586ff16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:00.288312 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-4ab5c932-e9f5-420c-aba7-9b5af586ff16 None None] MFA Rules not processed for user `44e80095b0714c85bd27375d864a55f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:45:00.289633 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-4ab5c932-e9f5-420c-aba7-9b5af586ff16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:00.367737 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1171/2369] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:45:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:45:00.380150 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26278461-6baf-4a92-b09b-b67e62115742 service cinder] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:00.381642 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-26278461-6baf-4a92-b09b-b67e62115742 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:00.396415 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26278461-6baf-4a92-b09b-b67e62115742 service cinder] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:00.467249 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033bbc4a-6c2f-42f7-b8d5-bb92b1c20545 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:00.468306 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033bbc4a-6c2f-42f7-b8d5-bb92b1c20545 service cinder] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:00.468793 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033bbc4a-6c2f-42f7-b8d5-bb92b1c20545 service cinder] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:00.469297 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033bbc4a-6c2f-42f7-b8d5-bb92b1c20545 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:00.480898 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033bbc4a-6c2f-42f7-b8d5-bb92b1c20545 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:00.481725 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033bbc4a-6c2f-42f7-b8d5-bb92b1c20545 service cinder] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:00.493374 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1199/2370] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:45:00 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:45:00.530183 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:45:00.542258 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab5c932-e9f5-420c-aba7-9b5af586ff16 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:00.604968 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:45:00.638466 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab5c932-e9f5-420c-aba7-9b5af586ff16 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:00.645699 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0623aefc-eea0-4343-9445-c6a1ec0697c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:00.646674 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623aefc-eea0-4343-9445-c6a1ec0697c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:00.646961 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623aefc-eea0-4343-9445-c6a1ec0697c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:00.647335 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623aefc-eea0-4343-9445-c6a1ec0697c3 admin admin] PATH_INFO: `/v3/users/44e80095b0714c85bd27375d864a55f2` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:00.648596 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0623aefc-eea0-4343-9445-c6a1ec0697c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44e80095b0714c85bd27375d864a55f2)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:00.651513 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0623aefc-eea0-4343-9445-c6a1ec0697c3 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:00.937503 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-0623aefc-eea0-4343-9445-c6a1ec0697c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44e80095b0714c85bd27375d864a55f2'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:01.022343 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033bbc4a-6c2f-42f7-b8d5-bb92b1c20545 service cinder] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:01.028224 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-0623aefc-eea0-4343-9445-c6a1ec0697c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44e80095b0714c85bd27375d864a55f2'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:01.028902 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-0623aefc-eea0-4343-9445-c6a1ec0697c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44e80095b0714c85bd27375d864a55f2'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:01.032054 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:45:01.036710 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033bbc4a-6c2f-42f7-b8d5-bb92b1c20545 service cinder] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:01.051698 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b976a-f1e9-4ba9-896e-a3e119cf1869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:01.052854 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b976a-f1e9-4ba9-896e-a3e119cf1869 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:01.053367 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b976a-f1e9-4ba9-896e-a3e119cf1869 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:01.053816 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b976a-f1e9-4ba9-896e-a3e119cf1869 admin admin] PATH_INFO: `/v3/users/e99903bf41f74a9f91266a19e5a455e8` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:01.055257 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8b976a-f1e9-4ba9-896e-a3e119cf1869 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e99903bf41f74a9f91266a19e5a455e8)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:01.057540 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8b976a-f1e9-4ba9-896e-a3e119cf1869 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:01.066047 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-0623aefc-eea0-4343-9445-c6a1ec0697c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44e80095b0714c85bd27375d864a55f2'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:01.082422 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-0623aefc-eea0-4343-9445-c6a1ec0697c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44e80095b0714c85bd27375d864a55f2'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:01.093750 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1172/2371] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:45:00 2022] DELETE /identity/v3/users/44e80095b0714c85bd27375d864a55f2 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:45:01.098568 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c21f3-39c1-4e4d-ab8b-4b65d6664ab5 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:01.098867 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c21f3-39c1-4e4d-ab8b-4b65d6664ab5 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:01.099156 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c21f3-39c1-4e4d-ab8b-4b65d6664ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:01.120773 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-5b7c21f3-39c1-4e4d-ab8b-4b65d6664ab5 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:45:01.122183 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-5b7c21f3-39c1-4e4d-ab8b-4b65d6664ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:01.185755 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1173/2372] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:45:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:45:01.195804 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c21f3-39c1-4e4d-ab8b-4b65d6664ab5 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:01.198543 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-5b7c21f3-39c1-4e4d-ab8b-4b65d6664ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:01.281780 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c21f3-39c1-4e4d-ab8b-4b65d6664ab5 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:01.286461 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82db70c-0170-454f-9d77-6b79e47d937e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:01.287277 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82db70c-0170-454f-9d77-6b79e47d937e service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:01.287569 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82db70c-0170-454f-9d77-6b79e47d937e service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:01.287848 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82db70c-0170-454f-9d77-6b79e47d937e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:01.300151 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82db70c-0170-454f-9d77-6b79e47d937e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:01.302147 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82db70c-0170-454f-9d77-6b79e47d937e service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:01.311660 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-5b8b976a-f1e9-4ba9-896e-a3e119cf1869 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e99903bf41f74a9f91266a19e5a455e8'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:01.314246 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1174/2373] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:45:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:45:01.424030 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-5b8b976a-f1e9-4ba9-896e-a3e119cf1869 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e99903bf41f74a9f91266a19e5a455e8'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:01.424989 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-5b8b976a-f1e9-4ba9-896e-a3e119cf1869 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e99903bf41f74a9f91266a19e5a455e8'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:01.445376 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-5b8b976a-f1e9-4ba9-896e-a3e119cf1869 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e99903bf41f74a9f91266a19e5a455e8'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:01.453718 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-5b8b976a-f1e9-4ba9-896e-a3e119cf1869 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e99903bf41f74a9f91266a19e5a455e8'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:01.460956 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1200/2374] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:45:01 2022] DELETE /identity/v3/users/e99903bf41f74a9f91266a19e5a455e8 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:45:01.467022 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28cdf8-9593-4031-9253-89c7638d94db None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:01.467411 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28cdf8-9593-4031-9253-89c7638d94db None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:01.467765 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b28cdf8-9593-4031-9253-89c7638d94db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:01.491262 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-9b28cdf8-9593-4031-9253-89c7638d94db None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:45:01.492611 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-9b28cdf8-9593-4031-9253-89c7638d94db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:01.564826 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1175/2375] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:45:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:45:01.575934 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b976a-f1e9-4ba9-896e-a3e119cf1869 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:01.578064 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-5b8b976a-f1e9-4ba9-896e-a3e119cf1869 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:01.643082 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:45:01.667989 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b976a-f1e9-4ba9-896e-a3e119cf1869 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:01.672809 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ce8b9-bfe9-4a11-ac76-cb931b693a38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:01.673805 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ce8b9-bfe9-4a11-ac76-cb931b693a38 service neutron] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:01.674090 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ce8b9-bfe9-4a11-ac76-cb931b693a38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:01.674625 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ce8b9-bfe9-4a11-ac76-cb931b693a38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:01.684391 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2ce8b9-bfe9-4a11-ac76-cb931b693a38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:01.686014 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2ce8b9-bfe9-4a11-ac76-cb931b693a38 service neutron] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:01.697152 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1201/2376] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:45:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:45:01.897926 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b28cdf8-9593-4031-9253-89c7638d94db None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:01.899873 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-9b28cdf8-9593-4031-9253-89c7638d94db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:01.920446 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b28cdf8-9593-4031-9253-89c7638d94db None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:01.928340 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483bb325-5b88-4204-b651-707dc1ccfbc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:01.929497 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483bb325-5b88-4204-b651-707dc1ccfbc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:01.929971 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483bb325-5b88-4204-b651-707dc1ccfbc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:01.930247 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483bb325-5b88-4204-b651-707dc1ccfbc4 admin admin] PATH_INFO: `/v3/projects/a278142efe41426c9399a831031a3613` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:01.932351 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483bb325-5b88-4204-b651-707dc1ccfbc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a278142efe41426c9399a831031a3613)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:01.934776 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483bb325-5b88-4204-b651-707dc1ccfbc4 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:01.955214 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:45:02.089672 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-483bb325-5b88-4204-b651-707dc1ccfbc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a278142efe41426c9399a831031a3613', 'request_id': 'req-483bb325-5b88-4204-b651-707dc1ccfbc4'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:02.096098 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-483bb325-5b88-4204-b651-707dc1ccfbc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a278142efe41426c9399a831031a3613', 'request_id': 'req-483bb325-5b88-4204-b651-707dc1ccfbc4'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:02.102790 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-483bb325-5b88-4204-b651-707dc1ccfbc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a278142efe41426c9399a831031a3613', 'request_id': 'req-483bb325-5b88-4204-b651-707dc1ccfbc4'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:02.180486 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-483bb325-5b88-4204-b651-707dc1ccfbc4 admin admin] The token cache is being invalidate because project a278142efe41426c9399a831031a3613 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:45:02.180729 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-483bb325-5b88-4204-b651-707dc1ccfbc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:02.181986 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-483bb325-5b88-4204-b651-707dc1ccfbc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:02.183680 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1176/2377] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:45:01 2022] DELETE /identity/v3/projects/a278142efe41426c9399a831031a3613 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:45:02.189018 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b2c99-181a-443d-9805-17cbc9491859 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:02.189386 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b2c99-181a-443d-9805-17cbc9491859 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:02.189613 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b2c99-181a-443d-9805-17cbc9491859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:02.209389 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-1a0b2c99-181a-443d-9805-17cbc9491859 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:45:02.210677 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-1a0b2c99-181a-443d-9805-17cbc9491859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:02.294315 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1202/2378] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:45:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:45:02.305378 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4963f366-d060-4f14-b3c9-0638f95fb53b None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:02.305745 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4963f366-d060-4f14-b3c9-0638f95fb53b None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:02.306085 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4963f366-d060-4f14-b3c9-0638f95fb53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:02.331379 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-4963f366-d060-4f14-b3c9-0638f95fb53b None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:45:02.332638 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-4963f366-d060-4f14-b3c9-0638f95fb53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:02.343518 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1177/2379] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:45:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:45:02.350477 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b2c99-181a-443d-9805-17cbc9491859 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:02.370196 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4963f366-d060-4f14-b3c9-0638f95fb53b None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:02.372108 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b2c99-181a-443d-9805-17cbc9491859 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:02.373018 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-4963f366-d060-4f14-b3c9-0638f95fb53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:02.382512 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f185c02f-da4a-471a-97ac-3cbbc607ebe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:02.392581 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4963f366-d060-4f14-b3c9-0638f95fb53b None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:02.394358 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f185c02f-da4a-471a-97ac-3cbbc607ebe8 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:02.395028 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f185c02f-da4a-471a-97ac-3cbbc607ebe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:02.395855 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f185c02f-da4a-471a-97ac-3cbbc607ebe8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:02.397338 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f185c02f-da4a-471a-97ac-3cbbc607ebe8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:45:02.397864 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f185c02f-da4a-471a-97ac-3cbbc607ebe8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:02.400331 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f185c02f-da4a-471a-97ac-3cbbc607ebe8 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:02.413509 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d933e5-a282-4357-ac99-c7d49d71d252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:02.414999 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d933e5-a282-4357-ac99-c7d49d71d252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:02.416755 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d933e5-a282-4357-ac99-c7d49d71d252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:02.418283 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d933e5-a282-4357-ac99-c7d49d71d252 admin admin] PATH_INFO: `/v3/projects/01f49ee8fce34d0c88acd519b9068030` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:02.420748 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d933e5-a282-4357-ac99-c7d49d71d252 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01f49ee8fce34d0c88acd519b9068030)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:02.424668 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d933e5-a282-4357-ac99-c7d49d71d252 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:02.438577 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1203/2380] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 10:45:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:45:02.438577 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f185c02f-da4a-471a-97ac-3cbbc607ebe8 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:02.449716 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f185c02f-da4a-471a-97ac-3cbbc607ebe8 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:02.454928 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a70540f-1a01-4188-b5cc-ace538523649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:02.455640 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70540f-1a01-4188-b5cc-ace538523649 admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:02.455923 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70540f-1a01-4188-b5cc-ace538523649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:02.456200 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70540f-1a01-4188-b5cc-ace538523649 admin admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:02.456950 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a70540f-1a01-4188-b5cc-ace538523649 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:02.458963 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a70540f-1a01-4188-b5cc-ace538523649 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:02.586273 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1204/2381] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:45:02 2022] POST /identity/v3/projects => generated 383 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:45:02.587865 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a70540f-1a01-4188-b5cc-ace538523649 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:02.600164 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c8d933e5-a282-4357-ac99-c7d49d71d252 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01f49ee8fce34d0c88acd519b9068030', 'request_id': 'req-c8d933e5-a282-4357-ac99-c7d49d71d252'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:02.607937 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c8d933e5-a282-4357-ac99-c7d49d71d252 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01f49ee8fce34d0c88acd519b9068030', 'request_id': 'req-c8d933e5-a282-4357-ac99-c7d49d71d252'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:02.627446 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c8d933e5-a282-4357-ac99-c7d49d71d252 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01f49ee8fce34d0c88acd519b9068030', 'request_id': 'req-c8d933e5-a282-4357-ac99-c7d49d71d252'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:02.665063 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a70540f-1a01-4188-b5cc-ace538523649 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:02.671002 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af510070-30f8-41cf-8d73-04ce1d96d424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:02.671719 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af510070-30f8-41cf-8d73-04ce1d96d424 admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:02.672033 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af510070-30f8-41cf-8d73-04ce1d96d424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:02.672311 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af510070-30f8-41cf-8d73-04ce1d96d424 admin admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:02.673140 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af510070-30f8-41cf-8d73-04ce1d96d424 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:02.675404 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af510070-30f8-41cf-8d73-04ce1d96d424 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:02.752149 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c8d933e5-a282-4357-ac99-c7d49d71d252 admin admin] The token cache is being invalidate because project 01f49ee8fce34d0c88acd519b9068030 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:45:02.752443 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c8d933e5-a282-4357-ac99-c7d49d71d252 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:02.753225 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c8d933e5-a282-4357-ac99-c7d49d71d252 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:02.755109 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1178/2382] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:45:02 2022] DELETE /identity/v3/projects/01f49ee8fce34d0c88acd519b9068030 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:45:02.759320 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d933e5-a282-4357-ac99-c7d49d71d252 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:02.761270 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c8d933e5-a282-4357-ac99-c7d49d71d252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:02.784330 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1205/2383] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:45:02 2022] POST /identity/v3/users => generated 292 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:45:02.785639 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af510070-30f8-41cf-8d73-04ce1d96d424 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:02.787338 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-af510070-30f8-41cf-8d73-04ce1d96d424 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:02.804476 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af510070-30f8-41cf-8d73-04ce1d96d424 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:02.816907 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34899ca6-ec6e-442c-8dd1-bc17a4037831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:02.817626 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34899ca6-ec6e-442c-8dd1-bc17a4037831 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:02.817908 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34899ca6-ec6e-442c-8dd1-bc17a4037831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:02.818184 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34899ca6-ec6e-442c-8dd1-bc17a4037831 admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:02.818994 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34899ca6-ec6e-442c-8dd1-bc17a4037831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:02.820609 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34899ca6-ec6e-442c-8dd1-bc17a4037831 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:02.831973 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1206/2384] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:45:02 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 10:45:02.834422 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d933e5-a282-4357-ac99-c7d49d71d252 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:02.836409 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34899ca6-ec6e-442c-8dd1-bc17a4037831 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:02.840085 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed043aed-1867-4a61-b1d4-5394817a532b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:02.840987 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed043aed-1867-4a61-b1d4-5394817a532b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:02.841308 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed043aed-1867-4a61-b1d4-5394817a532b admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:02.841588 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed043aed-1867-4a61-b1d4-5394817a532b admin admin] PATH_INFO: `/v3/users/bb157f97361e422492cc95074667365f` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:02.843048 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed043aed-1867-4a61-b1d4-5394817a532b admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb157f97361e422492cc95074667365f)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:02.845925 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed043aed-1867-4a61-b1d4-5394817a532b admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:02.847238 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34899ca6-ec6e-442c-8dd1-bc17a4037831 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:02.852511 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8815d14-90bc-434c-b70d-c8f644a44d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:02.854261 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8815d14-90bc-434c-b70d-c8f644a44d7d admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:02.854261 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8815d14-90bc-434c-b70d-c8f644a44d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:02.854585 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8815d14-90bc-434c-b70d-c8f644a44d7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:02.855134 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8815d14-90bc-434c-b70d-c8f644a44d7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:02.857002 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8815d14-90bc-434c-b70d-c8f644a44d7d admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:02.868420 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1207/2385] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:45:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 10:45:02.872345 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:45:02.873527 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8815d14-90bc-434c-b70d-c8f644a44d7d admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:02.883543 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8815d14-90bc-434c-b70d-c8f644a44d7d admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:02.888895 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1cf40d-656e-46f3-b58a-c5f79617b48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:02.889810 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1cf40d-656e-46f3-b58a-c5f79617b48d admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:02.890094 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1cf40d-656e-46f3-b58a-c5f79617b48d admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:02.890368 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1cf40d-656e-46f3-b58a-c5f79617b48d admin admin] PATH_INFO: `/v3/projects/84a71dacbe884c0b9021ad955ad5ff55/users/1c2bb5fd02ae445e8cec51351b2770a4/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:02.899367 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:45:02.906666 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1cf40d-656e-46f3-b58a-c5f79617b48d admin admin] RBAC: Authorizing `identity:create_grant(project_id=84a71dacbe884c0b9021ad955ad5ff55, user_id=1c2bb5fd02ae445e8cec51351b2770a4, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:02.909586 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1cf40d-656e-46f3-b58a-c5f79617b48d admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:03.055719 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1208/2386] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:45:02 2022] PUT /identity/v3/projects/84a71dacbe884c0b9021ad955ad5ff55/users/1c2bb5fd02ae445e8cec51351b2770a4/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:45:03.061519 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb26fe-3a3d-44d8-b1d2-07925e9ee51b None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:03.061812 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb26fe-3a3d-44d8-b1d2-07925e9ee51b None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:03.062097 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb26fe-3a3d-44d8-b1d2-07925e9ee51b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:03.080363 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-11bb26fe-3a3d-44d8-b1d2-07925e9ee51b None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:45:03.081637 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-11bb26fe-3a3d-44d8-b1d2-07925e9ee51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:03.131697 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-ed043aed-1867-4a61-b1d4-5394817a532b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb157f97361e422492cc95074667365f'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:03.158706 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1209/2387] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:45:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:45:03.169783 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb26fe-3a3d-44d8-b1d2-07925e9ee51b None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:03.171561 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-11bb26fe-3a3d-44d8-b1d2-07925e9ee51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:03.220855 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-ed043aed-1867-4a61-b1d4-5394817a532b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb157f97361e422492cc95074667365f'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:03.221499 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-ed043aed-1867-4a61-b1d4-5394817a532b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb157f97361e422492cc95074667365f'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:03.232793 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb26fe-3a3d-44d8-b1d2-07925e9ee51b None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:03.237066 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-ed043aed-1867-4a61-b1d4-5394817a532b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb157f97361e422492cc95074667365f'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:03.237250 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9868f493-e63f-45ab-a7f8-f71233bb641e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:03.237972 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9868f493-e63f-45ab-a7f8-f71233bb641e service neutron] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:03.238215 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9868f493-e63f-45ab-a7f8-f71233bb641e service neutron] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:03.238491 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9868f493-e63f-45ab-a7f8-f71233bb641e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:03.240534 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-9868f493-e63f-45ab-a7f8-f71233bb641e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:03.248808 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-ed043aed-1867-4a61-b1d4-5394817a532b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb157f97361e422492cc95074667365f'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:03.257309 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9868f493-e63f-45ab-a7f8-f71233bb641e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:03.258781 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9868f493-e63f-45ab-a7f8-f71233bb641e service neutron] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:03.261944 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1179/2388] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:45:02 2022] DELETE /identity/v3/users/bb157f97361e422492cc95074667365f => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:45:03.273900 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1210/2389] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:45:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:45:03.839757 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed043aed-1867-4a61-b1d4-5394817a532b admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:03.841751 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-ed043aed-1867-4a61-b1d4-5394817a532b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:03.933414 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed043aed-1867-4a61-b1d4-5394817a532b admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:03.939308 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbd7b06-6edf-4290-b2fb-53cd5ea5e636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:03.939955 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd7b06-6edf-4290-b2fb-53cd5ea5e636 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:03.940236 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd7b06-6edf-4290-b2fb-53cd5ea5e636 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:03.940508 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd7b06-6edf-4290-b2fb-53cd5ea5e636 admin admin] PATH_INFO: `/v3/projects/0b1b9d0bd44f41fa921eb7e623ef4d9d` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:03.942134 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbd7b06-6edf-4290-b2fb-53cd5ea5e636 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b1b9d0bd44f41fa921eb7e623ef4d9d)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:03.944105 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbd7b06-6edf-4290-b2fb-53cd5ea5e636 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:04.063341 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1cbd7b06-6edf-4290-b2fb-53cd5ea5e636 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b1b9d0bd44f41fa921eb7e623ef4d9d', 'request_id': 'req-1cbd7b06-6edf-4290-b2fb-53cd5ea5e636'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:04.070359 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1cbd7b06-6edf-4290-b2fb-53cd5ea5e636 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b1b9d0bd44f41fa921eb7e623ef4d9d', 'request_id': 'req-1cbd7b06-6edf-4290-b2fb-53cd5ea5e636'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:04.077082 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1cbd7b06-6edf-4290-b2fb-53cd5ea5e636 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b1b9d0bd44f41fa921eb7e623ef4d9d', 'request_id': 'req-1cbd7b06-6edf-4290-b2fb-53cd5ea5e636'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:04.170953 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1cbd7b06-6edf-4290-b2fb-53cd5ea5e636 admin admin] The token cache is being invalidate because project 0b1b9d0bd44f41fa921eb7e623ef4d9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:45:04.172011 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1cbd7b06-6edf-4290-b2fb-53cd5ea5e636 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:04.172678 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1cbd7b06-6edf-4290-b2fb-53cd5ea5e636 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:04.177222 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1180/2390] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:45:03 2022] DELETE /identity/v3/projects/0b1b9d0bd44f41fa921eb7e623ef4d9d => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:45:04.182742 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa2337-c879-490c-b3b0-e8493f2e7cd4 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:04.183541 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa2337-c879-490c-b3b0-e8493f2e7cd4 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:04.183541 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa2337-c879-490c-b3b0-e8493f2e7cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:04.202883 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-9aaa2337-c879-490c-b3b0-e8493f2e7cd4 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:45:04.204123 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-9aaa2337-c879-490c-b3b0-e8493f2e7cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:04.269930 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1211/2391] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:45:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:45:04.279370 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4056ed28-ac9b-4119-a2b7-ccd331e6b88f None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:04.279657 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4056ed28-ac9b-4119-a2b7-ccd331e6b88f None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:04.279940 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4056ed28-ac9b-4119-a2b7-ccd331e6b88f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:04.301799 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-4056ed28-ac9b-4119-a2b7-ccd331e6b88f None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:45:04.306215 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-4056ed28-ac9b-4119-a2b7-ccd331e6b88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:04.312840 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1181/2392] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:45:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:45:04.317319 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa2337-c879-490c-b3b0-e8493f2e7cd4 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:04.328872 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa2337-c879-490c-b3b0-e8493f2e7cd4 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:04.335781 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de31a1-1101-4eec-a647-54b182aca506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:04.336514 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de31a1-1101-4eec-a647-54b182aca506 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:04.336807 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de31a1-1101-4eec-a647-54b182aca506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:04.337118 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de31a1-1101-4eec-a647-54b182aca506 admin admin] PATH_INFO: `/v3/domains` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:04.338174 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2de31a1-1101-4eec-a647-54b182aca506 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:45:04.338702 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2de31a1-1101-4eec-a647-54b182aca506 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:04.340619 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2de31a1-1101-4eec-a647-54b182aca506 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:04.355386 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1212/2393] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 10:45:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:45:04.360220 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4056ed28-ac9b-4119-a2b7-ccd331e6b88f None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:04.370190 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4056ed28-ac9b-4119-a2b7-ccd331e6b88f None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:04.375027 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db91cb4d-ff0f-4189-a42f-27f766020b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:04.375685 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db91cb4d-ff0f-4189-a42f-27f766020b0c admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:04.377243 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db91cb4d-ff0f-4189-a42f-27f766020b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:04.377243 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db91cb4d-ff0f-4189-a42f-27f766020b0c admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:04.377243 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db91cb4d-ff0f-4189-a42f-27f766020b0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:04.378837 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db91cb4d-ff0f-4189-a42f-27f766020b0c admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:04.506774 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:DELETE=15,keystone:SELECT=82,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:45:04.518519 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1182/2394] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:45:04 2022] POST /identity/v3/projects => generated 371 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:45:04.519854 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de31a1-1101-4eec-a647-54b182aca506 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:04.533194 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de31a1-1101-4eec-a647-54b182aca506 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:04.547300 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:45:04.592577 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9033a9-e1ef-49c0-9b78-5f000e00eac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:04.593310 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9033a9-e1ef-49c0-9b78-5f000e00eac9 admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:04.593599 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9033a9-e1ef-49c0-9b78-5f000e00eac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:04.593874 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9033a9-e1ef-49c0-9b78-5f000e00eac9 admin admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:04.594707 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9033a9-e1ef-49c0-9b78-5f000e00eac9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:04.596675 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9033a9-e1ef-49c0-9b78-5f000e00eac9 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:04.784603 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1213/2395] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:45:04 2022] POST /identity/v3/users => generated 286 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:45:04.789100 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db91cb4d-ff0f-4189-a42f-27f766020b0c admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:04.801790 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db91cb4d-ff0f-4189-a42f-27f766020b0c admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:04.812109 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41932c80-d36a-4b60-acca-775bc84e59ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:04.813028 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41932c80-d36a-4b60-acca-775bc84e59ec admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:04.813339 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41932c80-d36a-4b60-acca-775bc84e59ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:04.813615 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41932c80-d36a-4b60-acca-775bc84e59ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:04.814378 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41932c80-d36a-4b60-acca-775bc84e59ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:04.816062 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41932c80-d36a-4b60-acca-775bc84e59ec admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:04.827885 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1183/2396] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:45:04 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:45:04.831932 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9033a9-e1ef-49c0-9b78-5f000e00eac9 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:04.844013 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9033a9-e1ef-49c0-9b78-5f000e00eac9 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:04.848932 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042e0955-08b9-42c0-b1a2-06d12ff74248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:04.849645 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e0955-08b9-42c0-b1a2-06d12ff74248 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:04.849930 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e0955-08b9-42c0-b1a2-06d12ff74248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:04.853710 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e0955-08b9-42c0-b1a2-06d12ff74248 admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:04.853710 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042e0955-08b9-42c0-b1a2-06d12ff74248 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:04.853710 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042e0955-08b9-42c0-b1a2-06d12ff74248 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:04.872331 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1214/2397] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:45:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 10:45:04.874300 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41932c80-d36a-4b60-acca-775bc84e59ec admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:04.886898 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41932c80-d36a-4b60-acca-775bc84e59ec admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:04.894658 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e2ba47-dd6d-4dcb-a26a-ca9558a52bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:04.895687 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2ba47-dd6d-4dcb-a26a-ca9558a52bc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:04.896146 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2ba47-dd6d-4dcb-a26a-ca9558a52bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:04.896431 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2ba47-dd6d-4dcb-a26a-ca9558a52bc4 admin admin] PATH_INFO: `/v3/projects/dcbc4bcbfa104174b91539129262ab69/users/221dbaef6eca4f5ca6e365e38a3ce375/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:04.913772 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e2ba47-dd6d-4dcb-a26a-ca9558a52bc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcbc4bcbfa104174b91539129262ab69, user_id=221dbaef6eca4f5ca6e365e38a3ce375, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:04.916600 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e2ba47-dd6d-4dcb-a26a-ca9558a52bc4 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:04.929875 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de1e5e-7c52-4233-9b4c-791fb8dca302 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:04.930228 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de1e5e-7c52-4233-9b4c-791fb8dca302 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:04.938246 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5de1e5e-7c52-4233-9b4c-791fb8dca302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:04.958715 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-a5de1e5e-7c52-4233-9b4c-791fb8dca302 None None] MFA Rules not processed for user `1c2bb5fd02ae445e8cec51351b2770a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:45:04.960354 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-a5de1e5e-7c52-4233-9b4c-791fb8dca302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:04.998751 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1184/2398] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:45:04 2022] PUT /identity/v3/projects/dcbc4bcbfa104174b91539129262ab69/users/221dbaef6eca4f5ca6e365e38a3ce375/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:45:05.010548 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c907097-cc70-43ac-8fa1-208595fbbbb8 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:05.010890 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c907097-cc70-43ac-8fa1-208595fbbbb8 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:05.011110 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c907097-cc70-43ac-8fa1-208595fbbbb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:05.045594 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1215/2399] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:45:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:45:05.053265 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5de1e5e-7c52-4233-9b4c-791fb8dca302 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:05.055276 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-a5de1e5e-7c52-4233-9b4c-791fb8dca302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:05.058967 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-2c907097-cc70-43ac-8fa1-208595fbbbb8 None None] MFA Rules not processed for user `221dbaef6eca4f5ca6e365e38a3ce375`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:45:05.060238 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-2c907097-cc70-43ac-8fa1-208595fbbbb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:05.068760 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5de1e5e-7c52-4233-9b4c-791fb8dca302 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:05.133251 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7ff1a1-359e-4f2c-97cd-c38ce593bbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:05.133641 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1185/2400] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:45:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:45:05.135296 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c907097-cc70-43ac-8fa1-208595fbbbb8 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:05.136958 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-2c907097-cc70-43ac-8fa1-208595fbbbb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:05.138175 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ff1a1-359e-4f2c-97cd-c38ce593bbd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:05.138475 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ff1a1-359e-4f2c-97cd-c38ce593bbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:05.138765 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ff1a1-359e-4f2c-97cd-c38ce593bbd7 admin admin] PATH_INFO: `/v3/users/f18a7608214041409a18ff4656cf2962` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:05.140085 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7ff1a1-359e-4f2c-97cd-c38ce593bbd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f18a7608214041409a18ff4656cf2962)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:05.142112 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7ff1a1-359e-4f2c-97cd-c38ce593bbd7 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:05.204882 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c907097-cc70-43ac-8fa1-208595fbbbb8 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:05.208819 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a3f78-8825-4e6a-b1c6-860031f6450b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:05.209521 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a3f78-8825-4e6a-b1c6-860031f6450b service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:05.209813 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a3f78-8825-4e6a-b1c6-860031f6450b service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:05.210116 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a3f78-8825-4e6a-b1c6-860031f6450b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:05.225793 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:45:05.269310 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869a3f78-8825-4e6a-b1c6-860031f6450b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:05.270758 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869a3f78-8825-4e6a-b1c6-860031f6450b service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:05.280868 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1186/2401] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:45:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:45:05.281776 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a3f78-8825-4e6a-b1c6-860031f6450b service cinder] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:05.292450 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a3f78-8825-4e6a-b1c6-860031f6450b service cinder] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:05.297701 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c8eb4-419d-4838-b98f-aad90e975b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:05.298368 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c8eb4-419d-4838-b98f-aad90e975b23 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:05.298651 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c8eb4-419d-4838-b98f-aad90e975b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:05.298980 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c8eb4-419d-4838-b98f-aad90e975b23 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:05.299931 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c8eb4-419d-4838-b98f-aad90e975b23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:05.302326 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c8eb4-419d-4838-b98f-aad90e975b23 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:05.307822 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:45:05.319519 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-ea7ff1a1-359e-4f2c-97cd-c38ce593bbd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f18a7608214041409a18ff4656cf2962'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:05.395985 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-ea7ff1a1-359e-4f2c-97cd-c38ce593bbd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f18a7608214041409a18ff4656cf2962'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:05.397389 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-ea7ff1a1-359e-4f2c-97cd-c38ce593bbd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f18a7608214041409a18ff4656cf2962'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:05.407452 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1187/2402] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:45:05 2022] POST /identity/v3/projects => generated 371 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:45:05.411300 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c8eb4-419d-4838-b98f-aad90e975b23 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:05.413079 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-a08c8eb4-419d-4838-b98f-aad90e975b23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:05.415217 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-ea7ff1a1-359e-4f2c-97cd-c38ce593bbd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f18a7608214041409a18ff4656cf2962'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:05.427310 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-ea7ff1a1-359e-4f2c-97cd-c38ce593bbd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f18a7608214041409a18ff4656cf2962'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:05.434470 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1216/2403] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:45:05 2022] DELETE /identity/v3/users/f18a7608214041409a18ff4656cf2962 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:45:05.439255 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b1678-3ee3-4cf1-96e4-25074bec2939 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:05.439529 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b1678-3ee3-4cf1-96e4-25074bec2939 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:05.439834 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b1678-3ee3-4cf1-96e4-25074bec2939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:05.458489 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-ac4b1678-3ee3-4cf1-96e4-25074bec2939 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:45:05.459727 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-ac4b1678-3ee3-4cf1-96e4-25074bec2939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:05.485854 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c8eb4-419d-4838-b98f-aad90e975b23 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:05.522253 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1217/2404] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:45:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:45:05.533897 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b1678-3ee3-4cf1-96e4-25074bec2939 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:05.535336 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-ac4b1678-3ee3-4cf1-96e4-25074bec2939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:05.555358 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be96ada-b6bb-42dc-aeb4-409ed03c6850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:05.556038 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be96ada-b6bb-42dc-aeb4-409ed03c6850 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:05.556834 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be96ada-b6bb-42dc-aeb4-409ed03c6850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:05.557139 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be96ada-b6bb-42dc-aeb4-409ed03c6850 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:05.557828 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be96ada-b6bb-42dc-aeb4-409ed03c6850 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:05.559796 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be96ada-b6bb-42dc-aeb4-409ed03c6850 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:05.606247 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b1678-3ee3-4cf1-96e4-25074bec2939 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:05.609994 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aad809-7b15-4b0a-9f4a-d5c983b74de1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:05.610651 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aad809-7b15-4b0a-9f4a-d5c983b74de1 service neutron] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:05.610943 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aad809-7b15-4b0a-9f4a-d5c983b74de1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:05.611440 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aad809-7b15-4b0a-9f4a-d5c983b74de1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:05.621981 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aad809-7b15-4b0a-9f4a-d5c983b74de1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:05.623461 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aad809-7b15-4b0a-9f4a-d5c983b74de1 service neutron] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:05.635181 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1218/2405] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:45:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:45:05.664732 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1188/2406] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:45:05 2022] POST /identity/v3/users => generated 292 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:45:05.667856 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aad809-7b15-4b0a-9f4a-d5c983b74de1 service neutron] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:05.678235 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aad809-7b15-4b0a-9f4a-d5c983b74de1 service neutron] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:05.684414 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a23eeb-4c30-42b4-b863-2296316a3b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:05.685205 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a23eeb-4c30-42b4-b863-2296316a3b70 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:05.685436 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a23eeb-4c30-42b4-b863-2296316a3b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:05.685711 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a23eeb-4c30-42b4-b863-2296316a3b70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:05.686437 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a23eeb-4c30-42b4-b863-2296316a3b70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:05.688045 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a23eeb-4c30-42b4-b863-2296316a3b70 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:05.703053 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1219/2407] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:45:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:45:05.704242 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be96ada-b6bb-42dc-aeb4-409ed03c6850 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:05.715655 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be96ada-b6bb-42dc-aeb4-409ed03c6850 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:05.721319 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1762ece2-8a32-4729-9697-d4ca1862653b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:05.721700 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762ece2-8a32-4729-9697-d4ca1862653b admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:05.721983 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762ece2-8a32-4729-9697-d4ca1862653b admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:05.722996 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1762ece2-8a32-4729-9697-d4ca1862653b admin admin] PATH_INFO: `/v3/projects/fcdbed0beff2459f9ca5c65daad3f090/users/06848d1628994833890b4dd56d26b085/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:05.740012 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1762ece2-8a32-4729-9697-d4ca1862653b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcdbed0beff2459f9ca5c65daad3f090, user_id=06848d1628994833890b4dd56d26b085, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:05.742475 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1762ece2-8a32-4729-9697-d4ca1862653b admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:05.851639 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1189/2408] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:45:05 2022] PUT /identity/v3/projects/fcdbed0beff2459f9ca5c65daad3f090/users/06848d1628994833890b4dd56d26b085/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:45:05.860598 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a23eeb-4c30-42b4-b863-2296316a3b70 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:05.872969 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a23eeb-4c30-42b4-b863-2296316a3b70 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:05.932652 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:45:05.961759 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09805f-4d33-4193-85f2-8aed97be7e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:05.963588 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09805f-4d33-4193-85f2-8aed97be7e55 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:05.964143 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09805f-4d33-4193-85f2-8aed97be7e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:05.964620 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09805f-4d33-4193-85f2-8aed97be7e55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:05.966163 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a09805f-4d33-4193-85f2-8aed97be7e55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:05.968626 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a09805f-4d33-4193-85f2-8aed97be7e55 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:05.988489 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1220/2409] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:45:05 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:45:05.991820 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1762ece2-8a32-4729-9697-d4ca1862653b admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:06.006287 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1762ece2-8a32-4729-9697-d4ca1862653b admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:06.012268 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ca33e-c5c1-4f5b-a356-b5cfd2db3c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:06.013479 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ca33e-c5c1-4f5b-a356-b5cfd2db3c3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:06.014042 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ca33e-c5c1-4f5b-a356-b5cfd2db3c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:06.014510 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ca33e-c5c1-4f5b-a356-b5cfd2db3c3d admin admin] PATH_INFO: `/v3/projects/fcdbed0beff2459f9ca5c65daad3f090/users/06848d1628994833890b4dd56d26b085/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:06.017511 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216ca33e-c5c1-4f5b-a356-b5cfd2db3c3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcdbed0beff2459f9ca5c65daad3f090, user_id=06848d1628994833890b4dd56d26b085, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:06.020883 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216ca33e-c5c1-4f5b-a356-b5cfd2db3c3d admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:06.037173 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1190/2410] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:45:05 2022] PUT /identity/v3/projects/fcdbed0beff2459f9ca5c65daad3f090/users/06848d1628994833890b4dd56d26b085/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:45:06.044563 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03046206-e830-46a5-9237-48ef36e96ea9 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:06.044904 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03046206-e830-46a5-9237-48ef36e96ea9 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:06.045270 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03046206-e830-46a5-9237-48ef36e96ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:06.089127 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-03046206-e830-46a5-9237-48ef36e96ea9 None None] MFA Rules not processed for user `06848d1628994833890b4dd56d26b085`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:45:06.091065 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-03046206-e830-46a5-9237-48ef36e96ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:06.132531 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ca33e-c5c1-4f5b-a356-b5cfd2db3c3d admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:06.135847 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-216ca33e-c5c1-4f5b-a356-b5cfd2db3c3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:06.183516 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1221/2411] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:45:06 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:45:06.199225 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03046206-e830-46a5-9237-48ef36e96ea9 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:06.200778 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-03046206-e830-46a5-9237-48ef36e96ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:06.209914 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:45:06.245095 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ca33e-c5c1-4f5b-a356-b5cfd2db3c3d admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:06.250705 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca371a8-b512-4041-8ab9-1b99f9f91453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:06.255692 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca371a8-b512-4041-8ab9-1b99f9f91453 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:06.255692 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca371a8-b512-4041-8ab9-1b99f9f91453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:06.255692 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca371a8-b512-4041-8ab9-1b99f9f91453 admin admin] PATH_INFO: `/v3/projects/c0c7e2c3a18843168568e1d0fa16ace0` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:06.255692 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca371a8-b512-4041-8ab9-1b99f9f91453 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0c7e2c3a18843168568e1d0fa16ace0)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:06.255692 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca371a8-b512-4041-8ab9-1b99f9f91453 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:06.277702 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03046206-e830-46a5-9237-48ef36e96ea9 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:06.282211 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fbaada-0069-4b75-8772-230be3363c34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:06.282893 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbaada-0069-4b75-8772-230be3363c34 service cinder] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:06.283182 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbaada-0069-4b75-8772-230be3363c34 service cinder] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:06.284427 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbaada-0069-4b75-8772-230be3363c34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:06.285669 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-e3fbaada-0069-4b75-8772-230be3363c34 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:06.351189 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fbaada-0069-4b75-8772-230be3363c34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:06.352642 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fbaada-0069-4b75-8772-230be3363c34 service cinder] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:06.363184 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1222/2412] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:45:06 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:45:06.382993 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-2ca371a8-b512-4041-8ab9-1b99f9f91453 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0c7e2c3a18843168568e1d0fa16ace0', 'request_id': 'req-2ca371a8-b512-4041-8ab9-1b99f9f91453'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:06.392752 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-2ca371a8-b512-4041-8ab9-1b99f9f91453 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0c7e2c3a18843168568e1d0fa16ace0', 'request_id': 'req-2ca371a8-b512-4041-8ab9-1b99f9f91453'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:06.400571 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-2ca371a8-b512-4041-8ab9-1b99f9f91453 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0c7e2c3a18843168568e1d0fa16ace0', 'request_id': 'req-2ca371a8-b512-4041-8ab9-1b99f9f91453'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:06.483863 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-2ca371a8-b512-4041-8ab9-1b99f9f91453 admin admin] The token cache is being invalidate because project c0c7e2c3a18843168568e1d0fa16ace0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:45:06.484158 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-2ca371a8-b512-4041-8ab9-1b99f9f91453 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:06.484840 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-2ca371a8-b512-4041-8ab9-1b99f9f91453 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:06.486538 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1191/2413] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:45:06 2022] DELETE /identity/v3/projects/c0c7e2c3a18843168568e1d0fa16ace0 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:45:07.186904 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec184aca-d70b-4bd9-b4b2-4abe8ff6c98c None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:07.187208 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec184aca-d70b-4bd9-b4b2-4abe8ff6c98c None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:07.187492 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec184aca-d70b-4bd9-b4b2-4abe8ff6c98c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:07.206445 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-ec184aca-d70b-4bd9-b4b2-4abe8ff6c98c None None] MFA Rules not processed for user `1c2bb5fd02ae445e8cec51351b2770a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:45:07.207449 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-ec184aca-d70b-4bd9-b4b2-4abe8ff6c98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:07.216462 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:45:07.267449 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1223/2414] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:45:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:45:09.508542 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca371a8-b512-4041-8ab9-1b99f9f91453 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:09.511406 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-2ca371a8-b512-4041-8ab9-1b99f9f91453 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:09.590076 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca371a8-b512-4041-8ab9-1b99f9f91453 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:09.594851 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a76719-e5f2-427e-8d72-f245c9ff8cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:09.595747 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a76719-e5f2-427e-8d72-f245c9ff8cf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:09.596027 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a76719-e5f2-427e-8d72-f245c9ff8cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:09.596304 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a76719-e5f2-427e-8d72-f245c9ff8cf9 admin admin] PATH_INFO: `/v3/users/221dbaef6eca4f5ca6e365e38a3ce375` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:09.597635 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a76719-e5f2-427e-8d72-f245c9ff8cf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=221dbaef6eca4f5ca6e365e38a3ce375)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:09.599617 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a76719-e5f2-427e-8d72-f245c9ff8cf9 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:09.658594 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec184aca-d70b-4bd9-b4b2-4abe8ff6c98c None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:09.660451 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-ec184aca-d70b-4bd9-b4b2-4abe8ff6c98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:09.735085 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec184aca-d70b-4bd9-b4b2-4abe8ff6c98c None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:09.740444 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730af455-36f7-4599-8598-e298ca623cd0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2330638e80a941cd9aeeb2fd615900d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:09.740831 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730af455-36f7-4599-8598-e298ca623cd0 service placement] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:09.741151 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730af455-36f7-4599-8598-e298ca623cd0 service placement] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:09.741428 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730af455-36f7-4599-8598-e298ca623cd0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:09.743227 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-730af455-36f7-4599-8598-e298ca623cd0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:09.755752 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730af455-36f7-4599-8598-e298ca623cd0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:09.757370 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730af455-36f7-4599-8598-e298ca623cd0 service placement] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:09.768111 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1224/2415] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:45:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:45:09.838221 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-10a76719-e5f2-427e-8d72-f245c9ff8cf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '221dbaef6eca4f5ca6e365e38a3ce375'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:09.963323 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-10a76719-e5f2-427e-8d72-f245c9ff8cf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '221dbaef6eca4f5ca6e365e38a3ce375'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:09.963959 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-10a76719-e5f2-427e-8d72-f245c9ff8cf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '221dbaef6eca4f5ca6e365e38a3ce375'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:09.980971 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-10a76719-e5f2-427e-8d72-f245c9ff8cf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '221dbaef6eca4f5ca6e365e38a3ce375'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:09.986227 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:45:09.990042 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-10a76719-e5f2-427e-8d72-f245c9ff8cf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '221dbaef6eca4f5ca6e365e38a3ce375'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:09.997561 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1192/2416] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:45:09 2022] DELETE /identity/v3/users/221dbaef6eca4f5ca6e365e38a3ce375 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:45:10.002866 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd29bc6-c9ec-4525-a66d-52f922fd4705 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:10.003262 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd29bc6-c9ec-4525-a66d-52f922fd4705 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:10.003548 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd29bc6-c9ec-4525-a66d-52f922fd4705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:10.022341 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-cbd29bc6-c9ec-4525-a66d-52f922fd4705 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:45:10.023559 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-cbd29bc6-c9ec-4525-a66d-52f922fd4705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:10.083634 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1225/2417] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:45:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:45:10.093341 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a76719-e5f2-427e-8d72-f245c9ff8cf9 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:10.094786 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-10a76719-e5f2-427e-8d72-f245c9ff8cf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:10.159738 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a76719-e5f2-427e-8d72-f245c9ff8cf9 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:10.163551 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fff1fa-7f48-440c-b11d-ab10d9f2ef0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:10.164209 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fff1fa-7f48-440c-b11d-ab10d9f2ef0a service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:10.164488 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fff1fa-7f48-440c-b11d-ab10d9f2ef0a service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:10.164759 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fff1fa-7f48-440c-b11d-ab10d9f2ef0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:10.176149 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fff1fa-7f48-440c-b11d-ab10d9f2ef0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:10.177849 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fff1fa-7f48-440c-b11d-ab10d9f2ef0a service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:10.188950 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1193/2418] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:45:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:45:10.655057 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd29bc6-c9ec-4525-a66d-52f922fd4705 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:10.656660 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-cbd29bc6-c9ec-4525-a66d-52f922fd4705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:10.671833 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd29bc6-c9ec-4525-a66d-52f922fd4705 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:10.676990 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8159c1-638c-44b8-a4ee-675945b8d601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:10.677898 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8159c1-638c-44b8-a4ee-675945b8d601 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:10.678178 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8159c1-638c-44b8-a4ee-675945b8d601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:10.678458 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8159c1-638c-44b8-a4ee-675945b8d601 admin admin] PATH_INFO: `/v3/projects/dcbc4bcbfa104174b91539129262ab69` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:10.679650 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8159c1-638c-44b8-a4ee-675945b8d601 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcbc4bcbfa104174b91539129262ab69)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:10.682452 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8159c1-638c-44b8-a4ee-675945b8d601 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:10.790477 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:45:10.795362 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-fe8159c1-638c-44b8-a4ee-675945b8d601 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcbc4bcbfa104174b91539129262ab69', 'request_id': 'req-fe8159c1-638c-44b8-a4ee-675945b8d601'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:10.801295 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-fe8159c1-638c-44b8-a4ee-675945b8d601 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcbc4bcbfa104174b91539129262ab69', 'request_id': 'req-fe8159c1-638c-44b8-a4ee-675945b8d601'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:10.807728 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-fe8159c1-638c-44b8-a4ee-675945b8d601 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcbc4bcbfa104174b91539129262ab69', 'request_id': 'req-fe8159c1-638c-44b8-a4ee-675945b8d601'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:10.907064 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-fe8159c1-638c-44b8-a4ee-675945b8d601 admin admin] The token cache is being invalidate because project dcbc4bcbfa104174b91539129262ab69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80392) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:45:10.907284 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-fe8159c1-638c-44b8-a4ee-675945b8d601 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:10.908018 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-fe8159c1-638c-44b8-a4ee-675945b8d601 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:10.909700 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1226/2419] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:45:10 2022] DELETE /identity/v3/projects/dcbc4bcbfa104174b91539129262ab69 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:45:10.913872 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fff1fa-7f48-440c-b11d-ab10d9f2ef0a service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:10.924011 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fff1fa-7f48-440c-b11d-ab10d9f2ef0a service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:10.984155 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa45b1be-ef22-4ae4-a88f-fd18f407c0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:10.985036 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45b1be-ef22-4ae4-a88f-fd18f407c0ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:10.985347 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45b1be-ef22-4ae4-a88f-fd18f407c0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:10.985626 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45b1be-ef22-4ae4-a88f-fd18f407c0ad admin admin] PATH_INFO: `/v3/users/06848d1628994833890b4dd56d26b085` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:10.986816 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa45b1be-ef22-4ae4-a88f-fd18f407c0ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=06848d1628994833890b4dd56d26b085)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:10.988748 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa45b1be-ef22-4ae4-a88f-fd18f407c0ad admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:11.195365 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-aa45b1be-ef22-4ae4-a88f-fd18f407c0ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06848d1628994833890b4dd56d26b085'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:11.274531 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-aa45b1be-ef22-4ae4-a88f-fd18f407c0ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06848d1628994833890b4dd56d26b085'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:11.277508 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-aa45b1be-ef22-4ae4-a88f-fd18f407c0ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06848d1628994833890b4dd56d26b085'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:11.321505 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-aa45b1be-ef22-4ae4-a88f-fd18f407c0ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06848d1628994833890b4dd56d26b085'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:11.338685 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-aa45b1be-ef22-4ae4-a88f-fd18f407c0ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06848d1628994833890b4dd56d26b085'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:11.353797 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1194/2420] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:45:10 2022] DELETE /identity/v3/users/06848d1628994833890b4dd56d26b085 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:45:11.918165 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8159c1-638c-44b8-a4ee-675945b8d601 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:11.919673 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-fe8159c1-638c-44b8-a4ee-675945b8d601 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:11.934767 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8159c1-638c-44b8-a4ee-675945b8d601 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:12.002979 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037800b-812e-444c-b2c1-05a7b1a4a69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:12.003848 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037800b-812e-444c-b2c1-05a7b1a4a69d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:12.004131 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037800b-812e-444c-b2c1-05a7b1a4a69d admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:12.004406 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037800b-812e-444c-b2c1-05a7b1a4a69d admin admin] PATH_INFO: `/v3/projects/fcdbed0beff2459f9ca5c65daad3f090` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:12.005630 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1037800b-812e-444c-b2c1-05a7b1a4a69d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcdbed0beff2459f9ca5c65daad3f090)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:12.007605 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1037800b-812e-444c-b2c1-05a7b1a4a69d admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:12.173785 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-1037800b-812e-444c-b2c1-05a7b1a4a69d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcdbed0beff2459f9ca5c65daad3f090', 'request_id': 'req-1037800b-812e-444c-b2c1-05a7b1a4a69d'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:12.179659 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-1037800b-812e-444c-b2c1-05a7b1a4a69d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcdbed0beff2459f9ca5c65daad3f090', 'request_id': 'req-1037800b-812e-444c-b2c1-05a7b1a4a69d'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:12.191639 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-1037800b-812e-444c-b2c1-05a7b1a4a69d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcdbed0beff2459f9ca5c65daad3f090', 'request_id': 'req-1037800b-812e-444c-b2c1-05a7b1a4a69d'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:12.299101 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-1037800b-812e-444c-b2c1-05a7b1a4a69d admin admin] The token cache is being invalidate because project fcdbed0beff2459f9ca5c65daad3f090 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80392) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:45:12.299101 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-1037800b-812e-444c-b2c1-05a7b1a4a69d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:12.299101 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-1037800b-812e-444c-b2c1-05a7b1a4a69d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:12.299101 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1227/2421] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:45:11 2022] DELETE /identity/v3/projects/fcdbed0beff2459f9ca5c65daad3f090 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:45:12.304064 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1294725-3e03-40c8-9b22-c4bf371b06c1 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:12.304938 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1294725-3e03-40c8-9b22-c4bf371b06c1 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:12.304938 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1294725-3e03-40c8-9b22-c4bf371b06c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:12.330644 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-e1294725-3e03-40c8-9b22-c4bf371b06c1 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:45:12.331897 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-e1294725-3e03-40c8-9b22-c4bf371b06c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:12.347966 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:45:12.426425 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1195/2422] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:45:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:45:12.428181 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268aad2-409e-4920-9e2c-37743f68cad2 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:12.428524 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268aad2-409e-4920-9e2c-37743f68cad2 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:12.428807 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268aad2-409e-4920-9e2c-37743f68cad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:12.452463 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-2268aad2-409e-4920-9e2c-37743f68cad2 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:45:12.454043 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-2268aad2-409e-4920-9e2c-37743f68cad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:12.462714 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1228/2423] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:45:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:45:12.467143 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1294725-3e03-40c8-9b22-c4bf371b06c1 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:12.479113 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1294725-3e03-40c8-9b22-c4bf371b06c1 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:12.486120 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e289ca-a6f4-4590-b195-9f8c1d7bb55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:12.486736 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e289ca-a6f4-4590-b195-9f8c1d7bb55a admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:12.487019 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e289ca-a6f4-4590-b195-9f8c1d7bb55a admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:12.487324 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e289ca-a6f4-4590-b195-9f8c1d7bb55a admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:12.488040 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e289ca-a6f4-4590-b195-9f8c1d7bb55a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:45:12.488350 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e289ca-a6f4-4590-b195-9f8c1d7bb55a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:12.490298 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e289ca-a6f4-4590-b195-9f8c1d7bb55a admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:12.506331 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1196/2424] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 10:45:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:45:12.511168 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2268aad2-409e-4920-9e2c-37743f68cad2 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:12.520989 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2268aad2-409e-4920-9e2c-37743f68cad2 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:12.526577 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeefcf6-f433-4123-9d5d-a9db4109b642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:12.527261 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeefcf6-f433-4123-9d5d-a9db4109b642 admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:12.527526 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeefcf6-f433-4123-9d5d-a9db4109b642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:12.527803 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeefcf6-f433-4123-9d5d-a9db4109b642 admin admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:12.529127 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeefcf6-f433-4123-9d5d-a9db4109b642 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:12.531113 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeefcf6-f433-4123-9d5d-a9db4109b642 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:12.664075 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1229/2425] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:45:12 2022] POST /identity/v3/projects => generated 369 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:45:12.667979 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e289ca-a6f4-4590-b195-9f8c1d7bb55a admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:12.679106 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e289ca-a6f4-4590-b195-9f8c1d7bb55a admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:12.736049 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8ff5de-2173-43c8-89a4-8ac0eb91a04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:12.736775 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ff5de-2173-43c8-89a4-8ac0eb91a04a admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:12.737025 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ff5de-2173-43c8-89a4-8ac0eb91a04a admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:12.737377 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ff5de-2173-43c8-89a4-8ac0eb91a04a admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:12.738122 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8ff5de-2173-43c8-89a4-8ac0eb91a04a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:12.740088 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8ff5de-2173-43c8-89a4-8ac0eb91a04a admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:12.861102 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1197/2426] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:45:12 2022] POST /identity/v3/users => generated 285 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:45:12.865323 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeefcf6-f433-4123-9d5d-a9db4109b642 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:12.876297 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeefcf6-f433-4123-9d5d-a9db4109b642 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:12.881252 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ad9109-0854-4227-89cb-6e4a90f9aad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:12.881941 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad9109-0854-4227-89cb-6e4a90f9aad2 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:12.882219 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad9109-0854-4227-89cb-6e4a90f9aad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:12.882491 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad9109-0854-4227-89cb-6e4a90f9aad2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:12.883224 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ad9109-0854-4227-89cb-6e4a90f9aad2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:12.885565 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ad9109-0854-4227-89cb-6e4a90f9aad2 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:12.897891 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1230/2427] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:45:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:45:12.902130 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8ff5de-2173-43c8-89a4-8ac0eb91a04a admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:12.914535 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8ff5de-2173-43c8-89a4-8ac0eb91a04a admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:12.919408 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facbb828-07ea-4ab1-a56c-f3e1776a949a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:12.920346 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facbb828-07ea-4ab1-a56c-f3e1776a949a admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:12.920717 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facbb828-07ea-4ab1-a56c-f3e1776a949a admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:12.921118 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facbb828-07ea-4ab1-a56c-f3e1776a949a admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:12.922151 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facbb828-07ea-4ab1-a56c-f3e1776a949a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:12.924027 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facbb828-07ea-4ab1-a56c-f3e1776a949a admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:12.938361 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1198/2428] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:45:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:45:12.942479 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ad9109-0854-4227-89cb-6e4a90f9aad2 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:12.954679 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ad9109-0854-4227-89cb-6e4a90f9aad2 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:12.960200 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131b913e-6cdf-4d92-a115-41533835c4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:12.961288 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b913e-6cdf-4d92-a115-41533835c4a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:12.961908 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b913e-6cdf-4d92-a115-41533835c4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:12.962187 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b913e-6cdf-4d92-a115-41533835c4a6 admin admin] PATH_INFO: `/v3/projects/211ac4ac0f464a40805b2d7fb16e53c6/users/937817b4560747868ef9b92c52376e44/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:12.985314 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131b913e-6cdf-4d92-a115-41533835c4a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=211ac4ac0f464a40805b2d7fb16e53c6, user_id=937817b4560747868ef9b92c52376e44, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:12.988109 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131b913e-6cdf-4d92-a115-41533835c4a6 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:13.076398 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:45:13.082705 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1231/2429] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:45:12 2022] PUT /identity/v3/projects/211ac4ac0f464a40805b2d7fb16e53c6/users/937817b4560747868ef9b92c52376e44/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:45:13.094075 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540466f4-2b29-4aa4-8f70-dff1524054c9 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:13.094367 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540466f4-2b29-4aa4-8f70-dff1524054c9 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:13.094646 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540466f4-2b29-4aa4-8f70-dff1524054c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:13.142805 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-540466f4-2b29-4aa4-8f70-dff1524054c9 None None] MFA Rules not processed for user `937817b4560747868ef9b92c52376e44`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:45:13.144225 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-540466f4-2b29-4aa4-8f70-dff1524054c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:13.252603 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1199/2430] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:45:13 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:45:13.267780 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131b913e-6cdf-4d92-a115-41533835c4a6 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:13.270010 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-131b913e-6cdf-4d92-a115-41533835c4a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:13.335154 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131b913e-6cdf-4d92-a115-41533835c4a6 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:13.339893 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efdcccd-3bd0-46a6-9d9d-db2483054092 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d1f7d0286745a396905aee50c9410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:13.340357 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efdcccd-3bd0-46a6-9d9d-db2483054092 service glance] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:13.342049 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efdcccd-3bd0-46a6-9d9d-db2483054092 service glance] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:13.342049 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efdcccd-3bd0-46a6-9d9d-db2483054092 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:13.351188 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efdcccd-3bd0-46a6-9d9d-db2483054092 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:13.352682 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efdcccd-3bd0-46a6-9d9d-db2483054092 service glance] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:13.366403 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1232/2431] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:45:13 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:45:23.248926 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=92,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:45:24.007072 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=27 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:45:42.682682 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540466f4-2b29-4aa4-8f70-dff1524054c9 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:42.745601 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540466f4-2b29-4aa4-8f70-dff1524054c9 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:42.750102 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc00cfb6-1ea3-4f8b-98b2-1ee05b2b3a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:42.750963 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00cfb6-1ea3-4f8b-98b2-1ee05b2b3a0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:42.753433 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00cfb6-1ea3-4f8b-98b2-1ee05b2b3a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:42.753433 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00cfb6-1ea3-4f8b-98b2-1ee05b2b3a0e admin admin] PATH_INFO: `/v3/users/937817b4560747868ef9b92c52376e44` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:42.753433 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc00cfb6-1ea3-4f8b-98b2-1ee05b2b3a0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=937817b4560747868ef9b92c52376e44)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:42.754829 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc00cfb6-1ea3-4f8b-98b2-1ee05b2b3a0e admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:42.940503 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-bc00cfb6-1ea3-4f8b-98b2-1ee05b2b3a0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '937817b4560747868ef9b92c52376e44'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:43.012457 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-bc00cfb6-1ea3-4f8b-98b2-1ee05b2b3a0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '937817b4560747868ef9b92c52376e44'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:43.013126 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-bc00cfb6-1ea3-4f8b-98b2-1ee05b2b3a0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '937817b4560747868ef9b92c52376e44'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:43.027609 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-bc00cfb6-1ea3-4f8b-98b2-1ee05b2b3a0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '937817b4560747868ef9b92c52376e44'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:43.036148 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-bc00cfb6-1ea3-4f8b-98b2-1ee05b2b3a0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '937817b4560747868ef9b92c52376e44'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:43.042390 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1200/2432] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:45:42 2022] DELETE /identity/v3/users/937817b4560747868ef9b92c52376e44 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:45:43.046955 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703aafd-3d6a-4cb7-be61-d6214aea1688 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:43.047465 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703aafd-3d6a-4cb7-be61-d6214aea1688 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:43.047572 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703aafd-3d6a-4cb7-be61-d6214aea1688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:43.064901 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-b703aafd-3d6a-4cb7-be61-d6214aea1688 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:45:43.066156 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-b703aafd-3d6a-4cb7-be61-d6214aea1688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:43.147417 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1233/2433] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:45:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:45:43.156941 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc00cfb6-1ea3-4f8b-98b2-1ee05b2b3a0e admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:43.158396 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-bc00cfb6-1ea3-4f8b-98b2-1ee05b2b3a0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:43.234638 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc00cfb6-1ea3-4f8b-98b2-1ee05b2b3a0e admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:43.240572 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509885a5-8e8e-4397-a47c-f9a59af254a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:43.241687 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509885a5-8e8e-4397-a47c-f9a59af254a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:43.242873 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509885a5-8e8e-4397-a47c-f9a59af254a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:43.243254 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509885a5-8e8e-4397-a47c-f9a59af254a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:43.256002 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509885a5-8e8e-4397-a47c-f9a59af254a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:43.257646 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509885a5-8e8e-4397-a47c-f9a59af254a5 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:43.267872 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1201/2434] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:45:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:45:43.717079 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b703aafd-3d6a-4cb7-be61-d6214aea1688 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:43.719802 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-b703aafd-3d6a-4cb7-be61-d6214aea1688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:43.732612 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b703aafd-3d6a-4cb7-be61-d6214aea1688 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:43.738695 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f4e0c-281d-47f8-9e64-0f31bdb4bdec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:43.739863 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f4e0c-281d-47f8-9e64-0f31bdb4bdec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:43.740338 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f4e0c-281d-47f8-9e64-0f31bdb4bdec admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:43.740456 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f4e0c-281d-47f8-9e64-0f31bdb4bdec admin admin] PATH_INFO: `/v3/projects/211ac4ac0f464a40805b2d7fb16e53c6` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:43.741879 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428f4e0c-281d-47f8-9e64-0f31bdb4bdec admin admin] RBAC: Authorizing `identity:delete_project(project_id=211ac4ac0f464a40805b2d7fb16e53c6)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:43.743767 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428f4e0c-281d-47f8-9e64-0f31bdb4bdec admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:43.881774 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-428f4e0c-281d-47f8-9e64-0f31bdb4bdec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '211ac4ac0f464a40805b2d7fb16e53c6', 'request_id': 'req-428f4e0c-281d-47f8-9e64-0f31bdb4bdec'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:43.887152 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-428f4e0c-281d-47f8-9e64-0f31bdb4bdec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '211ac4ac0f464a40805b2d7fb16e53c6', 'request_id': 'req-428f4e0c-281d-47f8-9e64-0f31bdb4bdec'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:43.893319 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-428f4e0c-281d-47f8-9e64-0f31bdb4bdec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '211ac4ac0f464a40805b2d7fb16e53c6', 'request_id': 'req-428f4e0c-281d-47f8-9e64-0f31bdb4bdec'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:43.992131 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-428f4e0c-281d-47f8-9e64-0f31bdb4bdec admin admin] The token cache is being invalidate because project 211ac4ac0f464a40805b2d7fb16e53c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80392) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:45:43.992423 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-428f4e0c-281d-47f8-9e64-0f31bdb4bdec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:43.993074 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-428f4e0c-281d-47f8-9e64-0f31bdb4bdec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:43.994623 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1234/2435] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:45:43 2022] DELETE /identity/v3/projects/211ac4ac0f464a40805b2d7fb16e53c6 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:45:43.999624 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6281c18-ba52-4a6e-b46b-b6771d70ed88 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:44.000081 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6281c18-ba52-4a6e-b46b-b6771d70ed88 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:44.000593 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6281c18-ba52-4a6e-b46b-b6771d70ed88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:44.018705 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-e6281c18-ba52-4a6e-b46b-b6771d70ed88 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:45:44.019937 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-e6281c18-ba52-4a6e-b46b-b6771d70ed88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:44.036272 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:45:44.078138 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1202/2436] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:45:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:45:44.087345 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf2720-5d78-46b3-8f1d-32f640d7f8e8 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:44.087866 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf2720-5d78-46b3-8f1d-32f640d7f8e8 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:44.087964 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf2720-5d78-46b3-8f1d-32f640d7f8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:44.107030 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-37bf2720-5d78-46b3-8f1d-32f640d7f8e8 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:45:44.108249 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-37bf2720-5d78-46b3-8f1d-32f640d7f8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:44.117641 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1235/2437] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:45:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:45:44.122100 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6281c18-ba52-4a6e-b46b-b6771d70ed88 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:44.133794 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6281c18-ba52-4a6e-b46b-b6771d70ed88 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:44.138366 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ca63e3-1039-42da-9efb-239ea6b6610b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:44.139143 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca63e3-1039-42da-9efb-239ea6b6610b admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:44.139428 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca63e3-1039-42da-9efb-239ea6b6610b admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:44.139714 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca63e3-1039-42da-9efb-239ea6b6610b admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:44.140448 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ca63e3-1039-42da-9efb-239ea6b6610b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:45:44.140777 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ca63e3-1039-42da-9efb-239ea6b6610b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:44.142413 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ca63e3-1039-42da-9efb-239ea6b6610b admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:44.154024 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1203/2438] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 10:45:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:45:44.158348 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf2720-5d78-46b3-8f1d-32f640d7f8e8 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:44.168370 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf2720-5d78-46b3-8f1d-32f640d7f8e8 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:44.172958 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb4624-1202-4851-aecb-51749cb254c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:44.173633 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb4624-1202-4851-aecb-51749cb254c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:44.173919 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb4624-1202-4851-aecb-51749cb254c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:44.174276 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb4624-1202-4851-aecb-51749cb254c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:44.175560 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb4624-1202-4851-aecb-51749cb254c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:44.177476 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb4624-1202-4851-aecb-51749cb254c5 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:44.295228 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1236/2439] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:45:44 2022] POST /identity/v3/projects => generated 375 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:45:44.296492 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ca63e3-1039-42da-9efb-239ea6b6610b admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:44.308167 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ca63e3-1039-42da-9efb-239ea6b6610b admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:44.376511 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27596e9-40fe-4c4c-9746-b949a8b08c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:44.377237 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27596e9-40fe-4c4c-9746-b949a8b08c96 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:44.377584 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27596e9-40fe-4c4c-9746-b949a8b08c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:44.377860 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27596e9-40fe-4c4c-9746-b949a8b08c96 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:44.378569 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27596e9-40fe-4c4c-9746-b949a8b08c96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:44.380474 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27596e9-40fe-4c4c-9746-b949a8b08c96 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:44.466938 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1204/2440] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:45:44 2022] POST /identity/v3/users => generated 288 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:45:44.471547 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb4624-1202-4851-aecb-51749cb254c5 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:44.482333 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb4624-1202-4851-aecb-51749cb254c5 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:44.487677 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5da1c6-da2d-45a1-b5c9-ba4542dbab82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:44.488453 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5da1c6-da2d-45a1-b5c9-ba4542dbab82 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:44.488735 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5da1c6-da2d-45a1-b5c9-ba4542dbab82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:44.489004 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5da1c6-da2d-45a1-b5c9-ba4542dbab82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:44.489807 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5da1c6-da2d-45a1-b5c9-ba4542dbab82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:44.491400 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5da1c6-da2d-45a1-b5c9-ba4542dbab82 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:44.501955 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1237/2441] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:45:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:45:44.506543 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27596e9-40fe-4c4c-9746-b949a8b08c96 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:44.516536 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27596e9-40fe-4c4c-9746-b949a8b08c96 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:44.521906 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dfa146-5ef1-46b5-9556-e5452498c9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:44.522501 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dfa146-5ef1-46b5-9556-e5452498c9d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:44.522782 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dfa146-5ef1-46b5-9556-e5452498c9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:44.523061 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dfa146-5ef1-46b5-9556-e5452498c9d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:44.523812 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dfa146-5ef1-46b5-9556-e5452498c9d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:44.525427 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dfa146-5ef1-46b5-9556-e5452498c9d3 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:44.535559 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1205/2442] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:45:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:45:44.539889 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5da1c6-da2d-45a1-b5c9-ba4542dbab82 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:44.550674 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5da1c6-da2d-45a1-b5c9-ba4542dbab82 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:44.555379 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca49ed5-dad9-4f04-a4f6-e19ce89e07f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:44.556267 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca49ed5-dad9-4f04-a4f6-e19ce89e07f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:44.556576 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca49ed5-dad9-4f04-a4f6-e19ce89e07f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:44.556850 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca49ed5-dad9-4f04-a4f6-e19ce89e07f8 admin admin] PATH_INFO: `/v3/projects/7f75506c41324dfdbc1872e753cb7550/users/092fd8cffdf24018b3732a5bfe5239ad/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:44.575036 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca49ed5-dad9-4f04-a4f6-e19ce89e07f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f75506c41324dfdbc1872e753cb7550, user_id=092fd8cffdf24018b3732a5bfe5239ad, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:44.578972 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca49ed5-dad9-4f04-a4f6-e19ce89e07f8 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:44.660396 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1238/2443] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:45:44 2022] PUT /identity/v3/projects/7f75506c41324dfdbc1872e753cb7550/users/092fd8cffdf24018b3732a5bfe5239ad/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:45:44.726268 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbfdb6c-a770-4bce-8308-7d3d51fe2b3d None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:44.726584 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbfdb6c-a770-4bce-8308-7d3d51fe2b3d None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:44.726865 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbfdb6c-a770-4bce-8308-7d3d51fe2b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:44.754945 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-4fbfdb6c-a770-4bce-8308-7d3d51fe2b3d None None] MFA Rules not processed for user `092fd8cffdf24018b3732a5bfe5239ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:45:44.756178 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-4fbfdb6c-a770-4bce-8308-7d3d51fe2b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:44.821282 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1206/2444] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:45:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:45:44.831963 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca49ed5-dad9-4f04-a4f6-e19ce89e07f8 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:44.833768 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-3ca49ed5-dad9-4f04-a4f6-e19ce89e07f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:44.855952 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:45:44.892123 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca49ed5-dad9-4f04-a4f6-e19ce89e07f8 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:44.897120 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70961b7b-2f61-4528-bba2-ac1452844b01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:44.897804 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70961b7b-2f61-4528-bba2-ac1452844b01 service cinder] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:44.898129 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70961b7b-2f61-4528-bba2-ac1452844b01 service cinder] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:44.898444 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70961b7b-2f61-4528-bba2-ac1452844b01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:44.906971 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70961b7b-2f61-4528-bba2-ac1452844b01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:44.908395 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70961b7b-2f61-4528-bba2-ac1452844b01 service cinder] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:44.918671 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1239/2445] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:45:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:45:49.141174 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2f660-598c-4b58-b10e-5af3f41107f6 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:49.141757 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2f660-598c-4b58-b10e-5af3f41107f6 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:49.141860 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2f660-598c-4b58-b10e-5af3f41107f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:49.170907 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-e1e2f660-598c-4b58-b10e-5af3f41107f6 None None] MFA Rules not processed for user `de532a6dce8247e79bd8285220297a50`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:45:49.172246 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-e1e2f660-598c-4b58-b10e-5af3f41107f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:49.188656 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:45:49.244333 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1207/2446] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:45:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:45:52.645173 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647cfa6c-3e63-49bc-a4b2-80064b933107 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:52.648345 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647cfa6c-3e63-49bc-a4b2-80064b933107 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:52.648345 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647cfa6c-3e63-49bc-a4b2-80064b933107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:52.678544 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-647cfa6c-3e63-49bc-a4b2-80064b933107 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:45:52.679913 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-647cfa6c-3e63-49bc-a4b2-80064b933107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:52.773151 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1240/2447] 10.222.0.61 () {58 vars in 1016 bytes} [Mon Jul 18 10:45:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:45:52.794342 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e2f660-598c-4b58-b10e-5af3f41107f6 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:52.796145 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-e1e2f660-598c-4b58-b10e-5af3f41107f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:52.918790 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e2f660-598c-4b58-b10e-5af3f41107f6 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:52.926188 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823de9f6-7f9f-41f0-a371-2f8f7588cab7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bbebf16219943879df84bdc9a900516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:52.926744 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823de9f6-7f9f-41f0-a371-2f8f7588cab7 service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:52.927127 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823de9f6-7f9f-41f0-a371-2f8f7588cab7 service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:52.927499 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823de9f6-7f9f-41f0-a371-2f8f7588cab7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:52.936762 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823de9f6-7f9f-41f0-a371-2f8f7588cab7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:52.938522 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823de9f6-7f9f-41f0-a371-2f8f7588cab7 service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:52.951257 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1208/2448] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:45:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:45:56.405739 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb5d7e-3ff6-45ec-a6f7-69ac8928b418 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:56.406294 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb5d7e-3ff6-45ec-a6f7-69ac8928b418 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:56.406294 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb5d7e-3ff6-45ec-a6f7-69ac8928b418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:56.426867 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-96eb5d7e-3ff6-45ec-a6f7-69ac8928b418 None None] MFA Rules not processed for user `b336af28da0742f5a66df010b8f5176a`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:45:56.429371 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-96eb5d7e-3ff6-45ec-a6f7-69ac8928b418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:56.519344 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1241/2449] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:45:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:45:57.234156 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823de9f6-7f9f-41f0-a371-2f8f7588cab7 service nova] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:57.263521 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823de9f6-7f9f-41f0-a371-2f8f7588cab7 service nova] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:57.268979 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7dadd1-b15f-4e7e-a6f8-80d03c8d90de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:57.270057 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7dadd1-b15f-4e7e-a6f8-80d03c8d90de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:57.270405 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7dadd1-b15f-4e7e-a6f8-80d03c8d90de admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:57.271873 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7dadd1-b15f-4e7e-a6f8-80d03c8d90de admin admin] PATH_INFO: `/v3/users/092fd8cffdf24018b3732a5bfe5239ad` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:57.273321 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7dadd1-b15f-4e7e-a6f8-80d03c8d90de admin admin] RBAC: Authorizing `identity:delete_user(user_id=092fd8cffdf24018b3732a5bfe5239ad)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:57.275644 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7dadd1-b15f-4e7e-a6f8-80d03c8d90de admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:57.485786 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-ab7dadd1-b15f-4e7e-a6f8-80d03c8d90de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '092fd8cffdf24018b3732a5bfe5239ad'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:57.586727 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-ab7dadd1-b15f-4e7e-a6f8-80d03c8d90de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '092fd8cffdf24018b3732a5bfe5239ad'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:57.587360 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-ab7dadd1-b15f-4e7e-a6f8-80d03c8d90de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '092fd8cffdf24018b3732a5bfe5239ad'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:57.618075 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-ab7dadd1-b15f-4e7e-a6f8-80d03c8d90de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '092fd8cffdf24018b3732a5bfe5239ad'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:57.626601 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-ab7dadd1-b15f-4e7e-a6f8-80d03c8d90de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '092fd8cffdf24018b3732a5bfe5239ad'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:57.634533 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1209/2450] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:45:57 2022] DELETE /identity/v3/users/092fd8cffdf24018b3732a5bfe5239ad => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:45:57.639207 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e161a1-fe88-472f-909c-ea96a402ce59 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:57.639619 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e161a1-fe88-472f-909c-ea96a402ce59 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:57.639841 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e161a1-fe88-472f-909c-ea96a402ce59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:57.667806 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-21e161a1-fe88-472f-909c-ea96a402ce59 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:45:57.669086 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-21e161a1-fe88-472f-909c-ea96a402ce59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:57.746977 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1242/2451] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:45:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:45:57.762170 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7dadd1-b15f-4e7e-a6f8-80d03c8d90de admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:57.765236 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-ab7dadd1-b15f-4e7e-a6f8-80d03c8d90de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:57.789893 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:45:57.854839 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7dadd1-b15f-4e7e-a6f8-80d03c8d90de admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:57.859300 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed306b-e14b-4948-97c7-ea1bdd99225a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:57.860185 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed306b-e14b-4948-97c7-ea1bdd99225a service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:57.860464 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed306b-e14b-4948-97c7-ea1bdd99225a service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:57.860789 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed306b-e14b-4948-97c7-ea1bdd99225a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:57.871398 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abed306b-e14b-4948-97c7-ea1bdd99225a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:57.872835 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abed306b-e14b-4948-97c7-ea1bdd99225a service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:57.885128 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1210/2452] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:45:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:45:58.077640 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817542dc-c986-40f5-87cb-9248e7bf84fd None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:58.077937 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817542dc-c986-40f5-87cb-9248e7bf84fd None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:58.078194 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817542dc-c986-40f5-87cb-9248e7bf84fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:58.128574 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-817542dc-c986-40f5-87cb-9248e7bf84fd None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:45:58.129871 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-817542dc-c986-40f5-87cb-9248e7bf84fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:58.139445 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1243/2453] 10.222.0.61 () {58 vars in 1016 bytes} [Mon Jul 18 10:45:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:45:58.163764 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed306b-e14b-4948-97c7-ea1bdd99225a service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:58.165374 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-abed306b-e14b-4948-97c7-ea1bdd99225a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:58.265776 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed306b-e14b-4948-97c7-ea1bdd99225a service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:58.272906 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b21b394-5e3a-46e8-9bdc-d3ba0a2319ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bbebf16219943879df84bdc9a900516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:58.273950 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21b394-5e3a-46e8-9bdc-d3ba0a2319ad service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:58.274265 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21b394-5e3a-46e8-9bdc-d3ba0a2319ad service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:58.274544 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21b394-5e3a-46e8-9bdc-d3ba0a2319ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:58.284072 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b21b394-5e3a-46e8-9bdc-d3ba0a2319ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:58.285714 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b21b394-5e3a-46e8-9bdc-d3ba0a2319ad service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:58.296666 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1211/2454] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:45:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:45:58.335963 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817542dc-c986-40f5-87cb-9248e7bf84fd None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:45:58.337436 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-817542dc-c986-40f5-87cb-9248e7bf84fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:45:58.344705 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:45:58.350634 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817542dc-c986-40f5-87cb-9248e7bf84fd None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:45:58.355967 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa04cfb-16f8-4238-8410-292764007996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:45:58.356843 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa04cfb-16f8-4238-8410-292764007996 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:45:58.357161 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa04cfb-16f8-4238-8410-292764007996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:45:58.357438 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa04cfb-16f8-4238-8410-292764007996 admin admin] PATH_INFO: `/v3/projects/7f75506c41324dfdbc1872e753cb7550` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:45:58.358648 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa04cfb-16f8-4238-8410-292764007996 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f75506c41324dfdbc1872e753cb7550)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:45:58.360656 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa04cfb-16f8-4238-8410-292764007996 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:45:58.533841 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-2aa04cfb-16f8-4238-8410-292764007996 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f75506c41324dfdbc1872e753cb7550', 'request_id': 'req-2aa04cfb-16f8-4238-8410-292764007996'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:58.543488 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-2aa04cfb-16f8-4238-8410-292764007996 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f75506c41324dfdbc1872e753cb7550', 'request_id': 'req-2aa04cfb-16f8-4238-8410-292764007996'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:58.550690 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-2aa04cfb-16f8-4238-8410-292764007996 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f75506c41324dfdbc1872e753cb7550', 'request_id': 'req-2aa04cfb-16f8-4238-8410-292764007996'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:58.669487 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-2aa04cfb-16f8-4238-8410-292764007996 admin admin] The token cache is being invalidate because project 7f75506c41324dfdbc1872e753cb7550 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80392) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:45:58.670143 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-2aa04cfb-16f8-4238-8410-292764007996 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:58.670479 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-2aa04cfb-16f8-4238-8410-292764007996 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:45:58.672075 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1244/2455] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:45:58 2022] DELETE /identity/v3/projects/7f75506c41324dfdbc1872e753cb7550 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:46:02.610632 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ab2f3-081c-4a47-8b5d-6ae14f442707 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:46:02.611178 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ab2f3-081c-4a47-8b5d-6ae14f442707 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:46:02.611178 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ab2f3-081c-4a47-8b5d-6ae14f442707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:46:02.629932 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-064ab2f3-081c-4a47-8b5d-6ae14f442707 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:46:02.632461 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-064ab2f3-081c-4a47-8b5d-6ae14f442707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:46:02.698065 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1212/2456] 10.222.0.61 () {58 vars in 1016 bytes} [Mon Jul 18 10:46:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:46:02.718364 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa04cfb-16f8-4238-8410-292764007996 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:46:02.719926 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-2aa04cfb-16f8-4238-8410-292764007996 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:46:02.803924 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa04cfb-16f8-4238-8410-292764007996 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:46:02.809919 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c3c0c-1441-4674-9ea8-81b4a3980fb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bbebf16219943879df84bdc9a900516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:46:02.810598 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c3c0c-1441-4674-9ea8-81b4a3980fb7 service nova] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:46:02.810883 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c3c0c-1441-4674-9ea8-81b4a3980fb7 service nova] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:46:02.811159 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c3c0c-1441-4674-9ea8-81b4a3980fb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:46:02.820823 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c3c0c-1441-4674-9ea8-81b4a3980fb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:46:02.822769 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c3c0c-1441-4674-9ea8-81b4a3980fb7 service nova] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:46:02.832564 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1245/2457] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:46:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:46:06.450432 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df211ef1-2010-4964-b7fe-9b83d2660073 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:46:06.451305 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df211ef1-2010-4964-b7fe-9b83d2660073 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:46:06.451305 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df211ef1-2010-4964-b7fe-9b83d2660073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:46:06.470558 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-df211ef1-2010-4964-b7fe-9b83d2660073 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:46:06.471762 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-df211ef1-2010-4964-b7fe-9b83d2660073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:46:06.479869 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1213/2458] 10.222.0.61 () {58 vars in 1016 bytes} [Mon Jul 18 10:46:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:46:06.502925 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c3c0c-1441-4674-9ea8-81b4a3980fb7 service nova] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:46:06.504382 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-d42c3c0c-1441-4674-9ea8-81b4a3980fb7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:46:06.520443 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c3c0c-1441-4674-9ea8-81b4a3980fb7 service nova] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:46:06.526468 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5088c-a9a6-4288-a215-a9e19104c5bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bbebf16219943879df84bdc9a900516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:46:06.527116 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5088c-a9a6-4288-a215-a9e19104c5bb service nova] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:46:06.527403 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5088c-a9a6-4288-a215-a9e19104c5bb service nova] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:46:06.527680 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5088c-a9a6-4288-a215-a9e19104c5bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:46:06.536030 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd5088c-a9a6-4288-a215-a9e19104c5bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:46:06.538314 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd5088c-a9a6-4288-a215-a9e19104c5bb service nova] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:46:06.548010 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1246/2459] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:46:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:46:10.727425 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe37603-6c64-4908-a706-458e5ceaed55 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:46:10.727987 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe37603-6c64-4908-a706-458e5ceaed55 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:46:10.728091 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe37603-6c64-4908-a706-458e5ceaed55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:46:10.746880 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-cfe37603-6c64-4908-a706-458e5ceaed55 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:46:10.748214 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-cfe37603-6c64-4908-a706-458e5ceaed55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:46:10.756088 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1214/2460] 10.222.0.61 () {58 vars in 1016 bytes} [Mon Jul 18 10:46:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:46:10.778483 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5088c-a9a6-4288-a215-a9e19104c5bb service nova] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:46:10.793179 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd5088c-a9a6-4288-a215-a9e19104c5bb service nova] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:46:10.800871 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb54720-55ba-439c-b013-5c835d0abf17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bbebf16219943879df84bdc9a900516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:46:10.801646 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb54720-55ba-439c-b013-5c835d0abf17 service nova] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:46:10.802017 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb54720-55ba-439c-b013-5c835d0abf17 service nova] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:46:10.802546 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb54720-55ba-439c-b013-5c835d0abf17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:46:10.812302 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb54720-55ba-439c-b013-5c835d0abf17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:46:10.814114 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb54720-55ba-439c-b013-5c835d0abf17 service nova] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:46:10.825269 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1247/2461] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:46:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:46:14.993653 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bcad89-96f1-4d03-9ccd-f82830e8cd46 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:46:14.994264 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bcad89-96f1-4d03-9ccd-f82830e8cd46 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:46:14.994264 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bcad89-96f1-4d03-9ccd-f82830e8cd46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:46:15.015130 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-20bcad89-96f1-4d03-9ccd-f82830e8cd46 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:46:15.016381 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-20bcad89-96f1-4d03-9ccd-f82830e8cd46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:46:15.024491 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1215/2462] 10.222.0.61 () {58 vars in 1016 bytes} [Mon Jul 18 10:46:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:46:15.045828 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb54720-55ba-439c-b013-5c835d0abf17 service nova] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:46:15.058369 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb54720-55ba-439c-b013-5c835d0abf17 service nova] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:46:15.064502 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c3a6fd-722f-49f4-b225-03e8b9971eb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bbebf16219943879df84bdc9a900516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:46:15.065209 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3a6fd-722f-49f4-b225-03e8b9971eb5 service nova] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:46:15.065525 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3a6fd-722f-49f4-b225-03e8b9971eb5 service nova] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:46:15.065804 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3a6fd-722f-49f4-b225-03e8b9971eb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:46:15.076322 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c3a6fd-722f-49f4-b225-03e8b9971eb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:46:15.078048 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c3a6fd-722f-49f4-b225-03e8b9971eb5 service nova] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:46:15.089447 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1248/2463] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:46:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:46:25.007800 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=87 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:46:25.083883 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=78,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:46:31.040306 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84673bd-5d59-48bd-bf0c-e0e0a359fd8c None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:46:31.040306 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84673bd-5d59-48bd-bf0c-e0e0a359fd8c None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:46:31.040306 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84673bd-5d59-48bd-bf0c-e0e0a359fd8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:46:31.058234 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-e84673bd-5d59-48bd-bf0c-e0e0a359fd8c None None] MFA Rules not processed for user `1c2bb5fd02ae445e8cec51351b2770a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:46:31.059878 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-e84673bd-5d59-48bd-bf0c-e0e0a359fd8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:46:31.122010 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1216/2464] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:46:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:46:41.117725 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=25 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:46:43.083344 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edaac07-4115-45ac-bd2c-688982e3e47d None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:46:43.083887 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edaac07-4115-45ac-bd2c-688982e3e47d None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:46:43.083887 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edaac07-4115-45ac-bd2c-688982e3e47d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:46:43.103129 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-0edaac07-4115-45ac-bd2c-688982e3e47d None None] MFA Rules not processed for user `f94ab499b0c8447c9e9e4165b342757b`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:46:43.105007 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-0edaac07-4115-45ac-bd2c-688982e3e47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:46:43.160650 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1249/2465] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:46:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:46:53.153437 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=25 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:46:57.807645 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c441ac-ce52-4ec9-b107-c8c990bd44ff None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:46:57.808480 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c441ac-ce52-4ec9-b107-c8c990bd44ff None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:46:57.808480 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c441ac-ce52-4ec9-b107-c8c990bd44ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:46:57.832081 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-d8c441ac-ce52-4ec9-b107-c8c990bd44ff None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:46:57.833349 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-d8c441ac-ce52-4ec9-b107-c8c990bd44ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:46:57.846811 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1217/2466] 10.222.0.61 () {58 vars in 1016 bytes} [Mon Jul 18 10:46:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:46:57.879366 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edaac07-4115-45ac-bd2c-688982e3e47d None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:46:57.898031 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edaac07-4115-45ac-bd2c-688982e3e47d None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:46:57.905699 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c81d8-1648-41d5-9f45-751ac4654ed5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bbebf16219943879df84bdc9a900516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:46:57.906627 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c81d8-1648-41d5-9f45-751ac4654ed5 service nova] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:46:57.906919 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c81d8-1648-41d5-9f45-751ac4654ed5 service nova] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:46:57.911610 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c81d8-1648-41d5-9f45-751ac4654ed5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:46:57.926749 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159c81d8-1648-41d5-9f45-751ac4654ed5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:46:57.926749 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159c81d8-1648-41d5-9f45-751ac4654ed5 service nova] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:46:57.934046 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1250/2467] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:46:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:47:00.171066 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c441ac-ce52-4ec9-b107-c8c990bd44ff None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:00.172783 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-d8c441ac-ce52-4ec9-b107-c8c990bd44ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:00.237994 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c441ac-ce52-4ec9-b107-c8c990bd44ff None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:00.247504 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8f1cc-5a65-4f39-b5c0-df06a13a0915 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:00.247504 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8f1cc-5a65-4f39-b5c0-df06a13a0915 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:00.247504 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8f1cc-5a65-4f39-b5c0-df06a13a0915 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:00.247504 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8f1cc-5a65-4f39-b5c0-df06a13a0915 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:00.248095 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-56e8f1cc-5a65-4f39-b5c0-df06a13a0915 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:00.257769 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e8f1cc-5a65-4f39-b5c0-df06a13a0915 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:00.259371 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e8f1cc-5a65-4f39-b5c0-df06a13a0915 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:00.269511 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1218/2468] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:47:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:47:01.324770 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61d903-106c-4498-b98a-fcd8bb519784 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:01.325371 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61d903-106c-4498-b98a-fcd8bb519784 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:01.325469 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61d903-106c-4498-b98a-fcd8bb519784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:01.344718 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-0a61d903-106c-4498-b98a-fcd8bb519784 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:47:01.346003 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-0a61d903-106c-4498-b98a-fcd8bb519784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:01.355148 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1251/2469] 10.222.0.61 () {58 vars in 1016 bytes} [Mon Jul 18 10:47:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:47:01.375403 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8f1cc-5a65-4f39-b5c0-df06a13a0915 service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:01.388753 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8f1cc-5a65-4f39-b5c0-df06a13a0915 service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:01.394506 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e4462-bd11-44a8-a45b-6c0f234db856 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bbebf16219943879df84bdc9a900516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:01.395173 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e4462-bd11-44a8-a45b-6c0f234db856 service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:01.395461 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e4462-bd11-44a8-a45b-6c0f234db856 service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:01.395763 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e4462-bd11-44a8-a45b-6c0f234db856 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:01.423094 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363e4462-bd11-44a8-a45b-6c0f234db856 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:01.424939 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363e4462-bd11-44a8-a45b-6c0f234db856 service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:01.435673 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1219/2470] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:47:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:47:03.305658 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a61d903-106c-4498-b98a-fcd8bb519784 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:03.316509 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a61d903-106c-4498-b98a-fcd8bb519784 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:03.323123 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a3de4-aa5c-4351-96c4-8b3c7e77d8d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:03.324947 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a3de4-aa5c-4351-96c4-8b3c7e77d8d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:03.326154 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a3de4-aa5c-4351-96c4-8b3c7e77d8d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:03.326154 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a3de4-aa5c-4351-96c4-8b3c7e77d8d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:03.335031 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-594a3de4-aa5c-4351-96c4-8b3c7e77d8d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:03.354306 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594a3de4-aa5c-4351-96c4-8b3c7e77d8d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:03.356004 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594a3de4-aa5c-4351-96c4-8b3c7e77d8d9 service neutron] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:03.377960 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1252/2471] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:47:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:47:05.267045 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800f925-5792-489b-8720-25f894809594 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:05.267892 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800f925-5792-489b-8720-25f894809594 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:05.268356 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800f925-5792-489b-8720-25f894809594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:05.288397 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-8800f925-5792-489b-8720-25f894809594 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:47:05.289667 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-8800f925-5792-489b-8720-25f894809594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:05.300515 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1220/2472] 10.222.0.61 () {58 vars in 1016 bytes} [Mon Jul 18 10:47:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:47:05.321626 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a3de4-aa5c-4351-96c4-8b3c7e77d8d9 service neutron] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:05.333332 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a3de4-aa5c-4351-96c4-8b3c7e77d8d9 service neutron] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:05.344271 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad16f9-b613-45da-ad64-b37e710149bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bbebf16219943879df84bdc9a900516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:05.345236 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad16f9-b613-45da-ad64-b37e710149bd service nova] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:05.345842 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad16f9-b613-45da-ad64-b37e710149bd service nova] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:05.346289 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad16f9-b613-45da-ad64-b37e710149bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:05.358081 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ad16f9-b613-45da-ad64-b37e710149bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:05.360838 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ad16f9-b613-45da-ad64-b37e710149bd service nova] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:05.381254 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1253/2473] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:47:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:47:05.396293 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8800f925-5792-489b-8720-25f894809594 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:05.396293 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-8800f925-5792-489b-8720-25f894809594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:05.410980 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8800f925-5792-489b-8720-25f894809594 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:05.419301 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d7320-d4bb-49fe-8922-8e88df419a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:05.429345 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d7320-d4bb-49fe-8922-8e88df419a2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:05.429345 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d7320-d4bb-49fe-8922-8e88df419a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:05.429345 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d7320-d4bb-49fe-8922-8e88df419a2f admin admin] PATH_INFO: `/v3/users/de532a6dce8247e79bd8285220297a50` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:05.429345 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500d7320-d4bb-49fe-8922-8e88df419a2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=de532a6dce8247e79bd8285220297a50)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:05.429345 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500d7320-d4bb-49fe-8922-8e88df419a2f admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:05.698690 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-500d7320-d4bb-49fe-8922-8e88df419a2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de532a6dce8247e79bd8285220297a50'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:05.771622 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-500d7320-d4bb-49fe-8922-8e88df419a2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de532a6dce8247e79bd8285220297a50'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:05.772489 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-500d7320-d4bb-49fe-8922-8e88df419a2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de532a6dce8247e79bd8285220297a50'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:05.787141 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-500d7320-d4bb-49fe-8922-8e88df419a2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de532a6dce8247e79bd8285220297a50'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:05.795533 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-500d7320-d4bb-49fe-8922-8e88df419a2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de532a6dce8247e79bd8285220297a50'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:05.803740 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1221/2474] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:47:05 2022] DELETE /identity/v3/users/de532a6dce8247e79bd8285220297a50 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:47:06.406942 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad16f9-b613-45da-ad64-b37e710149bd service nova] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:06.418321 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad16f9-b613-45da-ad64-b37e710149bd service nova] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:06.490760 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d7016-37de-4341-9caf-fba821d5ef1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:06.491646 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d7016-37de-4341-9caf-fba821d5ef1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:06.491936 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d7016-37de-4341-9caf-fba821d5ef1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:06.492243 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d7016-37de-4341-9caf-fba821d5ef1b admin admin] PATH_INFO: `/v3/projects/ad00644a97a94ecf9de9a14d8a8ad721` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:06.494876 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d7016-37de-4341-9caf-fba821d5ef1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad00644a97a94ecf9de9a14d8a8ad721)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:06.497757 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d7016-37de-4341-9caf-fba821d5ef1b admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:06.681754 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-994d7016-37de-4341-9caf-fba821d5ef1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad00644a97a94ecf9de9a14d8a8ad721', 'request_id': 'req-994d7016-37de-4341-9caf-fba821d5ef1b'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:06.694446 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-994d7016-37de-4341-9caf-fba821d5ef1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad00644a97a94ecf9de9a14d8a8ad721', 'request_id': 'req-994d7016-37de-4341-9caf-fba821d5ef1b'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:06.702053 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-994d7016-37de-4341-9caf-fba821d5ef1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad00644a97a94ecf9de9a14d8a8ad721', 'request_id': 'req-994d7016-37de-4341-9caf-fba821d5ef1b'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:06.754729 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-994d7016-37de-4341-9caf-fba821d5ef1b admin admin] The token cache is being invalidate because project ad00644a97a94ecf9de9a14d8a8ad721 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80392) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:47:06.755085 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-994d7016-37de-4341-9caf-fba821d5ef1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:06.756861 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-994d7016-37de-4341-9caf-fba821d5ef1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:06.765163 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1254/2475] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:47:06 2022] DELETE /identity/v3/projects/ad00644a97a94ecf9de9a14d8a8ad721 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:47:06.769395 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565c3ee-9fcc-42bf-ac84-3cbb8a073da9 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:06.769865 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565c3ee-9fcc-42bf-ac84-3cbb8a073da9 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:06.769970 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565c3ee-9fcc-42bf-ac84-3cbb8a073da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:06.793020 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-a565c3ee-9fcc-42bf-ac84-3cbb8a073da9 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:47:06.795006 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-a565c3ee-9fcc-42bf-ac84-3cbb8a073da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:06.853651 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:06.871293 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1222/2476] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:47:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:47:06.879424 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd6b52c-d545-46ba-83ca-dbc3227dd2fb None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:06.879700 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd6b52c-d545-46ba-83ca-dbc3227dd2fb None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:06.880007 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd6b52c-d545-46ba-83ca-dbc3227dd2fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:06.902235 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-dfd6b52c-d545-46ba-83ca-dbc3227dd2fb None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:47:06.903596 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-dfd6b52c-d545-46ba-83ca-dbc3227dd2fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:06.912394 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1255/2477] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:47:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:47:06.918764 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565c3ee-9fcc-42bf-ac84-3cbb8a073da9 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:06.928815 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565c3ee-9fcc-42bf-ac84-3cbb8a073da9 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:06.933797 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc64ac-59d1-4164-bcdd-7e4ef1034888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:06.934471 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc64ac-59d1-4164-bcdd-7e4ef1034888 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:06.934756 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc64ac-59d1-4164-bcdd-7e4ef1034888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:06.935038 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecc64ac-59d1-4164-bcdd-7e4ef1034888 admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:06.935820 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecc64ac-59d1-4164-bcdd-7e4ef1034888 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:47:06.936319 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecc64ac-59d1-4164-bcdd-7e4ef1034888 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:06.938181 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecc64ac-59d1-4164-bcdd-7e4ef1034888 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:06.950920 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1223/2478] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 10:47:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:47:06.955404 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd6b52c-d545-46ba-83ca-dbc3227dd2fb None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:06.970374 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd6b52c-d545-46ba-83ca-dbc3227dd2fb None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:06.975903 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487830c5-6422-467b-b472-bdf4e29f6b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:06.976563 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487830c5-6422-467b-b472-bdf4e29f6b48 admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:06.976851 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487830c5-6422-467b-b472-bdf4e29f6b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:06.977167 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487830c5-6422-467b-b472-bdf4e29f6b48 admin admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:06.978448 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487830c5-6422-467b-b472-bdf4e29f6b48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:06.981009 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487830c5-6422-467b-b472-bdf4e29f6b48 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:07.104617 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1256/2479] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:47:06 2022] POST /identity/v3/projects => generated 375 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:47:07.110324 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc64ac-59d1-4164-bcdd-7e4ef1034888 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:07.124498 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecc64ac-59d1-4164-bcdd-7e4ef1034888 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:07.195360 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed1d46-588d-47b3-bea1-3b373404adb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:07.196979 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed1d46-588d-47b3-bea1-3b373404adb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:07.197561 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed1d46-588d-47b3-bea1-3b373404adb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:07.199097 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed1d46-588d-47b3-bea1-3b373404adb3 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:07.200256 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bed1d46-588d-47b3-bea1-3b373404adb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:07.203742 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bed1d46-588d-47b3-bea1-3b373404adb3 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:07.316908 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1224/2480] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:47:07 2022] POST /identity/v3/users => generated 288 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:47:07.321185 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487830c5-6422-467b-b472-bdf4e29f6b48 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:07.336876 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487830c5-6422-467b-b472-bdf4e29f6b48 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:07.344294 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59f5577-39cb-48c0-bae1-54626d9c912a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:07.344963 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f5577-39cb-48c0-bae1-54626d9c912a admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:07.345298 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f5577-39cb-48c0-bae1-54626d9c912a admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:07.345580 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f5577-39cb-48c0-bae1-54626d9c912a admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:07.346321 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59f5577-39cb-48c0-bae1-54626d9c912a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:07.348006 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59f5577-39cb-48c0-bae1-54626d9c912a admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:07.374925 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1257/2481] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:47:07 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:47:07.379028 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed1d46-588d-47b3-bea1-3b373404adb3 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:07.395851 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed1d46-588d-47b3-bea1-3b373404adb3 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:07.402233 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc5d15-da55-4e4e-8c8b-f6fb1234f6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:07.402923 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc5d15-da55-4e4e-8c8b-f6fb1234f6b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:07.403215 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc5d15-da55-4e4e-8c8b-f6fb1234f6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:07.403491 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc5d15-da55-4e4e-8c8b-f6fb1234f6b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:07.404294 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcc5d15-da55-4e4e-8c8b-f6fb1234f6b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:07.405998 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcc5d15-da55-4e4e-8c8b-f6fb1234f6b7 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:07.421110 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1225/2482] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:47:07 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 10:47:07.426254 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59f5577-39cb-48c0-bae1-54626d9c912a admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:07.433703 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:07.438235 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59f5577-39cb-48c0-bae1-54626d9c912a admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:07.443452 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab0ef2-acc4-424d-90e6-a30a47c5335a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:07.444451 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab0ef2-acc4-424d-90e6-a30a47c5335a admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:07.444754 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab0ef2-acc4-424d-90e6-a30a47c5335a admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:07.445021 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab0ef2-acc4-424d-90e6-a30a47c5335a admin admin] PATH_INFO: `/v3/projects/c8e96a8743364f69bef3ab2ec866b0e7/users/937a78bc92c848749aa3e59f5f202c60/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:07.465296 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ab0ef2-acc4-424d-90e6-a30a47c5335a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8e96a8743364f69bef3ab2ec866b0e7, user_id=937a78bc92c848749aa3e59f5f202c60, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:07.467981 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ab0ef2-acc4-424d-90e6-a30a47c5335a admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:07.568496 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1258/2483] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:47:07 2022] PUT /identity/v3/projects/c8e96a8743364f69bef3ab2ec866b0e7/users/937a78bc92c848749aa3e59f5f202c60/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:47:07.580670 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a78c19-2b0b-4b48-85c7-7abeddc03594 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:07.581386 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a78c19-2b0b-4b48-85c7-7abeddc03594 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:07.581756 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a78c19-2b0b-4b48-85c7-7abeddc03594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:07.609730 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-f5a78c19-2b0b-4b48-85c7-7abeddc03594 None None] MFA Rules not processed for user `937a78bc92c848749aa3e59f5f202c60`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:47:07.610970 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-f5a78c19-2b0b-4b48-85c7-7abeddc03594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:07.709364 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1226/2484] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:47:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:47:07.726299 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab0ef2-acc4-424d-90e6-a30a47c5335a admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:07.729560 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-98ab0ef2-acc4-424d-90e6-a30a47c5335a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:07.864797 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab0ef2-acc4-424d-90e6-a30a47c5335a admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:07.872988 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea4726b-3b6a-42b6-ab5d-4a646a7b9408 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bbebf16219943879df84bdc9a900516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:07.873998 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea4726b-3b6a-42b6-ab5d-4a646a7b9408 service nova] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:07.874377 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea4726b-3b6a-42b6-ab5d-4a646a7b9408 service nova] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:07.874991 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea4726b-3b6a-42b6-ab5d-4a646a7b9408 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:07.885013 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea4726b-3b6a-42b6-ab5d-4a646a7b9408 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:07.887098 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea4726b-3b6a-42b6-ab5d-4a646a7b9408 service nova] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:07.899159 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1259/2485] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:47:07 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:47:08.164288 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a78c19-2b0b-4b48-85c7-7abeddc03594 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:08.216624 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:08.234243 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a78c19-2b0b-4b48-85c7-7abeddc03594 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:08.241623 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f779277-1fb6-4cef-a5fc-32ad47c0c4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:08.242506 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f779277-1fb6-4cef-a5fc-32ad47c0c4d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:08.242786 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f779277-1fb6-4cef-a5fc-32ad47c0c4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:08.243059 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f779277-1fb6-4cef-a5fc-32ad47c0c4d7 admin admin] PATH_INFO: `/v3/users/937a78bc92c848749aa3e59f5f202c60` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:08.245216 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f779277-1fb6-4cef-a5fc-32ad47c0c4d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=937a78bc92c848749aa3e59f5f202c60)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:08.247218 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f779277-1fb6-4cef-a5fc-32ad47c0c4d7 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:08.441685 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7f779277-1fb6-4cef-a5fc-32ad47c0c4d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '937a78bc92c848749aa3e59f5f202c60'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:08.502620 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20f462-5209-4a1f-9737-68ec74a15977 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:08.503299 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20f462-5209-4a1f-9737-68ec74a15977 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:08.503458 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7f779277-1fb6-4cef-a5fc-32ad47c0c4d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '937a78bc92c848749aa3e59f5f202c60'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:08.503601 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa20f462-5209-4a1f-9737-68ec74a15977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:08.504368 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7f779277-1fb6-4cef-a5fc-32ad47c0c4d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '937a78bc92c848749aa3e59f5f202c60'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:08.523949 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7f779277-1fb6-4cef-a5fc-32ad47c0c4d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '937a78bc92c848749aa3e59f5f202c60'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:08.530235 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-aa20f462-5209-4a1f-9737-68ec74a15977 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:47:08.531623 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-aa20f462-5209-4a1f-9737-68ec74a15977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:08.532904 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7f779277-1fb6-4cef-a5fc-32ad47c0c4d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '937a78bc92c848749aa3e59f5f202c60'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:08.539905 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1260/2486] 10.222.0.61 () {58 vars in 1016 bytes} [Mon Jul 18 10:47:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:47:08.542950 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1227/2487] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:47:08 2022] DELETE /identity/v3/users/937a78bc92c848749aa3e59f5f202c60 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:47:08.548011 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d332e948-f4e4-461e-b748-579b28969207 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:08.548299 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d332e948-f4e4-461e-b748-579b28969207 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:08.548600 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d332e948-f4e4-461e-b748-579b28969207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:08.564563 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f779277-1fb6-4cef-a5fc-32ad47c0c4d7 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:08.566304 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-7f779277-1fb6-4cef-a5fc-32ad47c0c4d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:08.567637 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-d332e948-f4e4-461e-b748-579b28969207 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:47:08.568827 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-d332e948-f4e4-461e-b748-579b28969207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:08.658518 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1261/2488] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:47:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:47:08.675520 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f779277-1fb6-4cef-a5fc-32ad47c0c4d7 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:08.677564 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d332e948-f4e4-461e-b748-579b28969207 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:08.679303 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-d332e948-f4e4-461e-b748-579b28969207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:08.686436 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b964f-ba2c-4984-ac14-c885b5addcdc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bbebf16219943879df84bdc9a900516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:08.686870 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b964f-ba2c-4984-ac14-c885b5addcdc service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:08.687331 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b964f-ba2c-4984-ac14-c885b5addcdc service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:08.687780 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b964f-ba2c-4984-ac14-c885b5addcdc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:08.701322 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6b964f-ba2c-4984-ac14-c885b5addcdc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:08.703981 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6b964f-ba2c-4984-ac14-c885b5addcdc service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:08.721297 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1228/2489] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:47:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:47:08.754112 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d332e948-f4e4-461e-b748-579b28969207 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:08.758388 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0029783-ced7-4582-a5b1-561282e331c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:08.759943 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0029783-ced7-4582-a5b1-561282e331c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:08.760237 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0029783-ced7-4582-a5b1-561282e331c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:08.760599 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0029783-ced7-4582-a5b1-561282e331c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:08.773185 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0029783-ced7-4582-a5b1-561282e331c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:08.775404 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0029783-ced7-4582-a5b1-561282e331c2 service neutron] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:08.787428 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1262/2490] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:47:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:47:09.264440 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b964f-ba2c-4984-ac14-c885b5addcdc service nova] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:09.267076 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-dd6b964f-ba2c-4984-ac14-c885b5addcdc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:09.283389 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b964f-ba2c-4984-ac14-c885b5addcdc service nova] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:09.288263 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7006b64f-c573-459b-9f23-c16e972f1829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:09.289203 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006b64f-c573-459b-9f23-c16e972f1829 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:09.289473 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006b64f-c573-459b-9f23-c16e972f1829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:09.289751 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006b64f-c573-459b-9f23-c16e972f1829 admin admin] PATH_INFO: `/v3/projects/c8e96a8743364f69bef3ab2ec866b0e7` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:09.291361 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7006b64f-c573-459b-9f23-c16e972f1829 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8e96a8743364f69bef3ab2ec866b0e7)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:09.293341 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7006b64f-c573-459b-9f23-c16e972f1829 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:09.449259 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:09.453569 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7006b64f-c573-459b-9f23-c16e972f1829 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8e96a8743364f69bef3ab2ec866b0e7', 'request_id': 'req-7006b64f-c573-459b-9f23-c16e972f1829'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:09.461282 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7006b64f-c573-459b-9f23-c16e972f1829 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8e96a8743364f69bef3ab2ec866b0e7', 'request_id': 'req-7006b64f-c573-459b-9f23-c16e972f1829'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:09.468558 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7006b64f-c573-459b-9f23-c16e972f1829 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8e96a8743364f69bef3ab2ec866b0e7', 'request_id': 'req-7006b64f-c573-459b-9f23-c16e972f1829'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:09.542376 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7006b64f-c573-459b-9f23-c16e972f1829 admin admin] The token cache is being invalidate because project c8e96a8743364f69bef3ab2ec866b0e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:47:09.550123 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7006b64f-c573-459b-9f23-c16e972f1829 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:09.550123 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7006b64f-c573-459b-9f23-c16e972f1829 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:09.550123 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1229/2491] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:47:09 2022] DELETE /identity/v3/projects/c8e96a8743364f69bef3ab2ec866b0e7 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:47:09.550433 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853fa20-084f-4cd1-9ae2-0fe8b69de3d1 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:09.550863 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853fa20-084f-4cd1-9ae2-0fe8b69de3d1 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:09.550863 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853fa20-084f-4cd1-9ae2-0fe8b69de3d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:09.558182 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:09.570773 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-8853fa20-084f-4cd1-9ae2-0fe8b69de3d1 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:47:09.572764 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-8853fa20-084f-4cd1-9ae2-0fe8b69de3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:09.636496 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1263/2492] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:47:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:47:09.645372 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb21ddc-87ba-4501-bd52-9c5e7892ce3f None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:09.645871 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb21ddc-87ba-4501-bd52-9c5e7892ce3f None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:09.646313 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb21ddc-87ba-4501-bd52-9c5e7892ce3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:09.665755 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-aeb21ddc-87ba-4501-bd52-9c5e7892ce3f None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:47:09.667240 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-aeb21ddc-87ba-4501-bd52-9c5e7892ce3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:09.675844 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1230/2493] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:47:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:47:09.680113 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853fa20-084f-4cd1-9ae2-0fe8b69de3d1 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:09.691100 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853fa20-084f-4cd1-9ae2-0fe8b69de3d1 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:09.695929 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680207c-655c-473d-aa0a-5056c0d8692a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:09.696612 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680207c-655c-473d-aa0a-5056c0d8692a admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:09.696892 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680207c-655c-473d-aa0a-5056c0d8692a admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:09.697189 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680207c-655c-473d-aa0a-5056c0d8692a admin admin] PATH_INFO: `/v3/domains` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:09.697923 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f680207c-655c-473d-aa0a-5056c0d8692a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:47:09.698231 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f680207c-655c-473d-aa0a-5056c0d8692a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:09.699854 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f680207c-655c-473d-aa0a-5056c0d8692a admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:09.712386 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1264/2494] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 10:47:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:47:09.717244 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb21ddc-87ba-4501-bd52-9c5e7892ce3f None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:09.727369 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb21ddc-87ba-4501-bd52-9c5e7892ce3f None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:09.733175 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fad2b4-bc34-429f-8f1c-65c8d1520f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:09.733838 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fad2b4-bc34-429f-8f1c-65c8d1520f59 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:09.734494 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fad2b4-bc34-429f-8f1c-65c8d1520f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:09.734494 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fad2b4-bc34-429f-8f1c-65c8d1520f59 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:09.735056 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fad2b4-bc34-429f-8f1c-65c8d1520f59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:09.736971 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fad2b4-bc34-429f-8f1c-65c8d1520f59 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:09.888492 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1231/2495] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:47:09 2022] POST /identity/v3/projects => generated 377 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:47:09.892656 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680207c-655c-473d-aa0a-5056c0d8692a admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:09.906432 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680207c-655c-473d-aa0a-5056c0d8692a admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:09.981807 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b0e9f6-784b-4170-952b-9f6cfb61e45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:09.982595 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0e9f6-784b-4170-952b-9f6cfb61e45d admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:09.982885 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0e9f6-784b-4170-952b-9f6cfb61e45d admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:09.983167 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0e9f6-784b-4170-952b-9f6cfb61e45d admin admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:09.983974 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b0e9f6-784b-4170-952b-9f6cfb61e45d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:09.985862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b0e9f6-784b-4170-952b-9f6cfb61e45d admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:10.131388 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1265/2496] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:47:09 2022] POST /identity/v3/users => generated 289 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:47:10.136216 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fad2b4-bc34-429f-8f1c-65c8d1520f59 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:10.146842 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fad2b4-bc34-429f-8f1c-65c8d1520f59 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:10.152475 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ddb4b2-14b7-44fc-ab54-c817663fc846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:10.153373 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ddb4b2-14b7-44fc-ab54-c817663fc846 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:10.153732 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ddb4b2-14b7-44fc-ab54-c817663fc846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:10.154660 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ddb4b2-14b7-44fc-ab54-c817663fc846 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:10.155484 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ddb4b2-14b7-44fc-ab54-c817663fc846 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:10.157132 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ddb4b2-14b7-44fc-ab54-c817663fc846 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:10.170620 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1232/2497] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:47:10.174953 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b0e9f6-784b-4170-952b-9f6cfb61e45d admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:10.185421 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b0e9f6-784b-4170-952b-9f6cfb61e45d admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:10.190262 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed8f8f-583b-495f-96f5-4df411d638ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:10.191133 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed8f8f-583b-495f-96f5-4df411d638ec admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:10.191419 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed8f8f-583b-495f-96f5-4df411d638ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:10.191696 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed8f8f-583b-495f-96f5-4df411d638ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:10.192963 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ed8f8f-583b-495f-96f5-4df411d638ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:10.194371 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ed8f8f-583b-495f-96f5-4df411d638ec admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:10.205760 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1266/2498] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:47:10.210219 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ddb4b2-14b7-44fc-ab54-c817663fc846 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:10.222392 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ddb4b2-14b7-44fc-ab54-c817663fc846 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:10.226982 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65eac9-ae94-44bb-a3be-2757f2160086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:10.228019 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65eac9-ae94-44bb-a3be-2757f2160086 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:10.228298 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65eac9-ae94-44bb-a3be-2757f2160086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:10.228572 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65eac9-ae94-44bb-a3be-2757f2160086 admin admin] PATH_INFO: `/v3/projects/599ea794dc214413a6fb89989176126b/users/f8738fea033e4b66b0f4e5f872f4c073/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:10.245504 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d65eac9-ae94-44bb-a3be-2757f2160086 admin admin] RBAC: Authorizing `identity:create_grant(project_id=599ea794dc214413a6fb89989176126b, user_id=f8738fea033e4b66b0f4e5f872f4c073, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:10.248775 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d65eac9-ae94-44bb-a3be-2757f2160086 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:10.350251 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1233/2499] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:47:10 2022] PUT /identity/v3/projects/599ea794dc214413a6fb89989176126b/users/f8738fea033e4b66b0f4e5f872f4c073/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:47:10.361332 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554b0b0-b4de-49b9-82b0-59c64d663141 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:10.361630 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554b0b0-b4de-49b9-82b0-59c64d663141 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:10.361914 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554b0b0-b4de-49b9-82b0-59c64d663141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:10.389490 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-b554b0b0-b4de-49b9-82b0-59c64d663141 None None] MFA Rules not processed for user `f8738fea033e4b66b0f4e5f872f4c073`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:47:10.390641 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-b554b0b0-b4de-49b9-82b0-59c64d663141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:10.456416 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:10.462156 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1267/2500] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:47:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:47:10.468127 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65eac9-ae94-44bb-a3be-2757f2160086 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:10.563593 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65eac9-ae94-44bb-a3be-2757f2160086 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:10.568301 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496152a1-5ecf-4e65-bcae-73133f0ca94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:10.568958 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496152a1-5ecf-4e65-bcae-73133f0ca94e admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:10.569280 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496152a1-5ecf-4e65-bcae-73133f0ca94e admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:10.569570 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496152a1-5ecf-4e65-bcae-73133f0ca94e admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:10.570290 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496152a1-5ecf-4e65-bcae-73133f0ca94e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:10.572269 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496152a1-5ecf-4e65-bcae-73133f0ca94e admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:10.684803 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1234/2501] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:47:10 2022] POST /identity/v3/projects => generated 381 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:47:10.686650 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b554b0b0-b4de-49b9-82b0-59c64d663141 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:10.698520 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b554b0b0-b4de-49b9-82b0-59c64d663141 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:10.755561 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cba589c-470a-4d37-9bca-94bc55684f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:10.756257 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba589c-470a-4d37-9bca-94bc55684f4e admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:10.756542 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba589c-470a-4d37-9bca-94bc55684f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:10.756817 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba589c-470a-4d37-9bca-94bc55684f4e admin admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:10.757537 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cba589c-470a-4d37-9bca-94bc55684f4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:10.759746 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cba589c-470a-4d37-9bca-94bc55684f4e admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:10.875011 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1268/2502] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:47:10 2022] POST /identity/v3/users => generated 297 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:47:10.880140 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496152a1-5ecf-4e65-bcae-73133f0ca94e admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:10.891384 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496152a1-5ecf-4e65-bcae-73133f0ca94e admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:10.896184 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dfdacb-af2b-4b14-be5a-d23334c41453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:10.896836 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dfdacb-af2b-4b14-be5a-d23334c41453 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:10.897154 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dfdacb-af2b-4b14-be5a-d23334c41453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:10.897430 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dfdacb-af2b-4b14-be5a-d23334c41453 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:10.898148 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dfdacb-af2b-4b14-be5a-d23334c41453 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:10.900275 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dfdacb-af2b-4b14-be5a-d23334c41453 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:10.912326 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1235/2503] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 10:47:10.917790 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cba589c-470a-4d37-9bca-94bc55684f4e admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:10.929809 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cba589c-470a-4d37-9bca-94bc55684f4e admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:10.936701 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2a7a4e-6d49-4287-b062-2dd34bef3d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:10.937627 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a7a4e-6d49-4287-b062-2dd34bef3d8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:10.937971 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a7a4e-6d49-4287-b062-2dd34bef3d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:10.938446 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a7a4e-6d49-4287-b062-2dd34bef3d8a admin admin] PATH_INFO: `/v3/projects/13d05ffe56da4d60b39b35254fd2b46a/users/37cc400c3eb1440fbf266cadcb668549/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:10.958274 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2a7a4e-6d49-4287-b062-2dd34bef3d8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=13d05ffe56da4d60b39b35254fd2b46a, user_id=37cc400c3eb1440fbf266cadcb668549, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:10.960552 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2a7a4e-6d49-4287-b062-2dd34bef3d8a admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:11.081975 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1269/2504] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:47:10 2022] PUT /identity/v3/projects/13d05ffe56da4d60b39b35254fd2b46a/users/37cc400c3eb1440fbf266cadcb668549/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:47:11.086633 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dfdacb-af2b-4b14-be5a-d23334c41453 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:11.102308 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dfdacb-af2b-4b14-be5a-d23334c41453 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:11.158347 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:11.182050 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561d4c9b-63d9-4e1e-b4a4-494755d0dc34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:11.182663 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d4c9b-63d9-4e1e-b4a4-494755d0dc34 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:11.182965 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d4c9b-63d9-4e1e-b4a4-494755d0dc34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:11.183232 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561d4c9b-63d9-4e1e-b4a4-494755d0dc34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:11.183958 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561d4c9b-63d9-4e1e-b4a4-494755d0dc34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:11.185602 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561d4c9b-63d9-4e1e-b4a4-494755d0dc34 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:11.204425 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1236/2505] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 10:47:11.208809 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2a7a4e-6d49-4287-b062-2dd34bef3d8a admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:11.223980 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2a7a4e-6d49-4287-b062-2dd34bef3d8a admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:11.228857 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387073d8-e6d3-41f5-9299-617cd97b2654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:11.229777 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387073d8-e6d3-41f5-9299-617cd97b2654 admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:11.230070 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387073d8-e6d3-41f5-9299-617cd97b2654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:11.230347 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387073d8-e6d3-41f5-9299-617cd97b2654 admin admin] PATH_INFO: `/v3/projects/13d05ffe56da4d60b39b35254fd2b46a/users/37cc400c3eb1440fbf266cadcb668549/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:11.232341 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387073d8-e6d3-41f5-9299-617cd97b2654 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13d05ffe56da4d60b39b35254fd2b46a, user_id=37cc400c3eb1440fbf266cadcb668549, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:11.235027 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387073d8-e6d3-41f5-9299-617cd97b2654 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:11.245887 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1270/2506] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:47:11 2022] PUT /identity/v3/projects/13d05ffe56da4d60b39b35254fd2b46a/users/37cc400c3eb1440fbf266cadcb668549/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:47:11.260214 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fec59a-dc05-4a81-a4e1-e765b8ec2483 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:11.260214 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fec59a-dc05-4a81-a4e1-e765b8ec2483 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:11.260583 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fec59a-dc05-4a81-a4e1-e765b8ec2483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:11.294857 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-d2fec59a-dc05-4a81-a4e1-e765b8ec2483 None None] MFA Rules not processed for user `37cc400c3eb1440fbf266cadcb668549`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:47:11.296082 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-d2fec59a-dc05-4a81-a4e1-e765b8ec2483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:11.403096 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1237/2507] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:47:11 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:47:11.414827 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387073d8-e6d3-41f5-9299-617cd97b2654 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:11.418774 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-387073d8-e6d3-41f5-9299-617cd97b2654 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:11.499697 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387073d8-e6d3-41f5-9299-617cd97b2654 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:11.503867 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a69e5-8c10-4f69-8c98-e2873a6ab686 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:11.504510 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a69e5-8c10-4f69-8c98-e2873a6ab686 service cinder] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:11.504791 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a69e5-8c10-4f69-8c98-e2873a6ab686 service cinder] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:11.505191 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a69e5-8c10-4f69-8c98-e2873a6ab686 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:11.520932 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20a69e5-8c10-4f69-8c98-e2873a6ab686 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:11.522531 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20a69e5-8c10-4f69-8c98-e2873a6ab686 service cinder] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:11.533341 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1271/2508] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:47:11 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:47:11.783242 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b64b2-b4d6-4299-b8e0-641ad5baf77f None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:11.783736 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b64b2-b4d6-4299-b8e0-641ad5baf77f None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:11.784227 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b64b2-b4d6-4299-b8e0-641ad5baf77f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:11.812071 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a69e5-8c10-4f69-8c98-e2873a6ab686 service cinder] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:11.814058 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-a20a69e5-8c10-4f69-8c98-e2873a6ab686 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:11.814860 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-ad7b64b2-b4d6-4299-b8e0-641ad5baf77f None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:47:11.816031 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-ad7b64b2-b4d6-4299-b8e0-641ad5baf77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:11.828090 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a69e5-8c10-4f69-8c98-e2873a6ab686 service cinder] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:11.832177 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85704815-d1ae-49b0-9147-bccac3816c26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:11.832819 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85704815-d1ae-49b0-9147-bccac3816c26 service cinder] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:11.833134 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85704815-d1ae-49b0-9147-bccac3816c26 service cinder] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:11.833409 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85704815-d1ae-49b0-9147-bccac3816c26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:11.890238 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:11.900924 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85704815-d1ae-49b0-9147-bccac3816c26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:11.902399 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85704815-d1ae-49b0-9147-bccac3816c26 service cinder] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:11.913078 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1272/2509] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:47:11 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:47:11.913948 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1238/2510] 10.222.0.61 () {58 vars in 1016 bytes} [Mon Jul 18 10:47:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:47:11.943895 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85704815-d1ae-49b0-9147-bccac3816c26 service cinder] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:11.946243 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-85704815-d1ae-49b0-9147-bccac3816c26 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:12.030117 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85704815-d1ae-49b0-9147-bccac3816c26 service cinder] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:12.035939 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0e3d6e-0589-4959-8910-30dde646bcf3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bbebf16219943879df84bdc9a900516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:12.036597 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e3d6e-0589-4959-8910-30dde646bcf3 service nova] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:12.036878 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e3d6e-0589-4959-8910-30dde646bcf3 service nova] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:12.037204 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e3d6e-0589-4959-8910-30dde646bcf3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:12.046915 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0e3d6e-0589-4959-8910-30dde646bcf3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:12.048526 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0e3d6e-0589-4959-8910-30dde646bcf3 service nova] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:12.059481 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1273/2511] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:47:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:47:12.163913 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7b64b2-b4d6-4299-b8e0-641ad5baf77f None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:12.165449 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-ad7b64b2-b4d6-4299-b8e0-641ad5baf77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:12.184224 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7b64b2-b4d6-4299-b8e0-641ad5baf77f None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:12.191263 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62253fd5-5b7c-4720-abda-5dad14672ba2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bbebf16219943879df84bdc9a900516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:12.191909 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62253fd5-5b7c-4720-abda-5dad14672ba2 service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:12.192188 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62253fd5-5b7c-4720-abda-5dad14672ba2 service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:12.192460 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62253fd5-5b7c-4720-abda-5dad14672ba2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:12.194220 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-62253fd5-5b7c-4720-abda-5dad14672ba2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:12.261861 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62253fd5-5b7c-4720-abda-5dad14672ba2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:12.263519 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62253fd5-5b7c-4720-abda-5dad14672ba2 service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:12.273970 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1239/2512] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:47:12 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:47:12.584409 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0e3d6e-0589-4959-8910-30dde646bcf3 service nova] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:12.585883 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-1b0e3d6e-0589-4959-8910-30dde646bcf3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:12.648767 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0e3d6e-0589-4959-8910-30dde646bcf3 service nova] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:12.653297 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207bdc5c-e99c-4016-aeb7-cd926538571f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:12.653947 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207bdc5c-e99c-4016-aeb7-cd926538571f service neutron] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:12.654231 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207bdc5c-e99c-4016-aeb7-cd926538571f service neutron] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:12.654521 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207bdc5c-e99c-4016-aeb7-cd926538571f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:12.656329 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-207bdc5c-e99c-4016-aeb7-cd926538571f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:12.670561 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207bdc5c-e99c-4016-aeb7-cd926538571f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:12.672009 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207bdc5c-e99c-4016-aeb7-cd926538571f service neutron] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:12.683567 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1274/2513] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:47:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:47:16.397873 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb37a9-55f5-4b25-89cc-7f628e4bd08f None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:16.398724 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb37a9-55f5-4b25-89cc-7f628e4bd08f None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:16.399025 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb37a9-55f5-4b25-89cc-7f628e4bd08f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:16.409127 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:16.427697 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-1deb37a9-55f5-4b25-89cc-7f628e4bd08f None None] MFA Rules not processed for user `88ad60446c5447a8bbd0096fa2133efb`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:47:16.432650 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-1deb37a9-55f5-4b25-89cc-7f628e4bd08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:16.532189 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1240/2514] 10.222.0.39 () {58 vars in 1009 bytes} [Mon Jul 18 10:47:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:47:16.723978 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207bdc5c-e99c-4016-aeb7-cd926538571f service neutron] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:16.725528 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-207bdc5c-e99c-4016-aeb7-cd926538571f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:16.814920 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207bdc5c-e99c-4016-aeb7-cd926538571f service neutron] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:16.820923 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876cbf27-b42f-46f2-af9c-05550eeda7cf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c548474a8d94591ba58dd40e40a28d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:16.821330 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876cbf27-b42f-46f2-af9c-05550eeda7cf service swift] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:16.822279 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876cbf27-b42f-46f2-af9c-05550eeda7cf service swift] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:16.822565 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876cbf27-b42f-46f2-af9c-05550eeda7cf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:16.832767 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876cbf27-b42f-46f2-af9c-05550eeda7cf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:16.834412 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876cbf27-b42f-46f2-af9c-05550eeda7cf service swift] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:16.843226 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1275/2515] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Jul 18 10:47:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 10:47:19.179120 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb37a9-55f5-4b25-89cc-7f628e4bd08f None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:19.179120 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb37a9-55f5-4b25-89cc-7f628e4bd08f None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:19.179120 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f70789-f534-4d84-ba93-e78a7a58b491 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:19.179120 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f70789-f534-4d84-ba93-e78a7a58b491 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:19.181950 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f70789-f534-4d84-ba93-e78a7a58b491 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:19.181950 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f70789-f534-4d84-ba93-e78a7a58b491 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:19.181950 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-00f70789-f534-4d84-ba93-e78a7a58b491 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:19.181950 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f70789-f534-4d84-ba93-e78a7a58b491 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:19.181950 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f70789-f534-4d84-ba93-e78a7a58b491 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:19.181950 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1241/2516] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:47:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:47:19.622923 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa9154-5de6-4c6f-afee-1f4c4c9a9cdc None None] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:19.624356 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa9154-5de6-4c6f-afee-1f4c4c9a9cdc None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:19.624870 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa9154-5de6-4c6f-afee-1f4c4c9a9cdc None None] PATH_INFO: `/` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:19.627223 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1276/2517] 10.222.0.39 () {54 vars in 921 bytes} [Mon Jul 18 10:47:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 10:47:19.640471 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f7f9cd-f98e-4fbe-a50c-66fd1e7e5e90 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:19.640471 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f7f9cd-f98e-4fbe-a50c-66fd1e7e5e90 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:19.640471 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f7f9cd-f98e-4fbe-a50c-66fd1e7e5e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:19.673237 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-e2f7f9cd-f98e-4fbe-a50c-66fd1e7e5e90 None None] MFA Rules not processed for user `2f88e3a2b95e477bae1cc98e9e18dc24`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:47:19.675837 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-e2f7f9cd-f98e-4fbe-a50c-66fd1e7e5e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:19.696017 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1242/2518] 10.222.0.39 () {58 vars in 1018 bytes} [Mon Jul 18 10:47:19 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:47:19.711355 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa9154-5de6-4c6f-afee-1f4c4c9a9cdc None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:19.714663 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-fcaa9154-5de6-4c6f-afee-1f4c4c9a9cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:19.764863 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa9154-5de6-4c6f-afee-1f4c4c9a9cdc None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:19.778658 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01cc3c9-304d-49e4-969e-5941c2b7fb54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:19.782767 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01cc3c9-304d-49e4-969e-5941c2b7fb54 service neutron] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:19.783604 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01cc3c9-304d-49e4-969e-5941c2b7fb54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:19.784303 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01cc3c9-304d-49e4-969e-5941c2b7fb54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:19.823728 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:19.825922 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01cc3c9-304d-49e4-969e-5941c2b7fb54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:19.828712 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01cc3c9-304d-49e4-969e-5941c2b7fb54 service neutron] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:19.847087 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1277/2519] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:47:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:47:20.007156 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a6bcf-64e8-482a-b534-85d59abe0f36 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:20.007520 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a6bcf-64e8-482a-b534-85d59abe0f36 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:20.007699 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a6bcf-64e8-482a-b534-85d59abe0f36 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:20.010091 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1243/2520] 10.222.0.39 () {54 vars in 921 bytes} [Mon Jul 18 10:47:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 10:47:20.022645 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5026921-9ce4-47f6-b3e3-10bcf574d42d None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:20.022645 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5026921-9ce4-47f6-b3e3-10bcf574d42d None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:20.022645 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5026921-9ce4-47f6-b3e3-10bcf574d42d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:20.043742 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-a5026921-9ce4-47f6-b3e3-10bcf574d42d None None] MFA Rules not processed for user `8bbebf16219943879df84bdc9a900516`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:47:20.045825 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-a5026921-9ce4-47f6-b3e3-10bcf574d42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:20.065495 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1278/2521] 10.222.0.39 () {58 vars in 1018 bytes} [Mon Jul 18 10:47:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:47:20.089344 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a6bcf-64e8-482a-b534-85d59abe0f36 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:20.107815 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a6bcf-64e8-482a-b534-85d59abe0f36 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:20.114490 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95519b1b-bc98-47b6-b83f-c7b44f762b8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:20.115284 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95519b1b-bc98-47b6-b83f-c7b44f762b8b service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:20.115621 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95519b1b-bc98-47b6-b83f-c7b44f762b8b service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:20.115966 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95519b1b-bc98-47b6-b83f-c7b44f762b8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:20.136686 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95519b1b-bc98-47b6-b83f-c7b44f762b8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:20.138426 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95519b1b-bc98-47b6-b83f-c7b44f762b8b service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:20.158373 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1244/2522] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:47:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:47:20.238559 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5026921-9ce4-47f6-b3e3-10bcf574d42d None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:20.240201 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-a5026921-9ce4-47f6-b3e3-10bcf574d42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:20.330024 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5026921-9ce4-47f6-b3e3-10bcf574d42d None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:20.335040 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d59b6-7ed4-44d5-b2f6-479eb2449f84 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2330638e80a941cd9aeeb2fd615900d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:20.335721 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d59b6-7ed4-44d5-b2f6-479eb2449f84 service placement] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:20.336009 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d59b6-7ed4-44d5-b2f6-479eb2449f84 service placement] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:20.336287 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d59b6-7ed4-44d5-b2f6-479eb2449f84 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:20.339528 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-ba2d59b6-7ed4-44d5-b2f6-479eb2449f84 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:20.364277 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2d59b6-7ed4-44d5-b2f6-479eb2449f84 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:20.365920 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2d59b6-7ed4-44d5-b2f6-479eb2449f84 service placement] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:20.387990 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1279/2523] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:47:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:47:21.903883 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95519b1b-bc98-47b6-b83f-c7b44f762b8b service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:21.915710 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95519b1b-bc98-47b6-b83f-c7b44f762b8b service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:21.925766 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cefe31-2c50-4133-9ba8-079cd909e92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:21.926716 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cefe31-2c50-4133-9ba8-079cd909e92f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:21.927207 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cefe31-2c50-4133-9ba8-079cd909e92f admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:21.927812 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cefe31-2c50-4133-9ba8-079cd909e92f admin admin] PATH_INFO: `/v3/users/f8738fea033e4b66b0f4e5f872f4c073` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:21.929131 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cefe31-2c50-4133-9ba8-079cd909e92f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8738fea033e4b66b0f4e5f872f4c073)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:21.932125 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cefe31-2c50-4133-9ba8-079cd909e92f admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:22.131706 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-75cefe31-2c50-4133-9ba8-079cd909e92f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8738fea033e4b66b0f4e5f872f4c073'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:22.210665 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-75cefe31-2c50-4133-9ba8-079cd909e92f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8738fea033e4b66b0f4e5f872f4c073'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:22.211655 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-75cefe31-2c50-4133-9ba8-079cd909e92f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8738fea033e4b66b0f4e5f872f4c073'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:22.229814 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-75cefe31-2c50-4133-9ba8-079cd909e92f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8738fea033e4b66b0f4e5f872f4c073'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:22.242359 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-75cefe31-2c50-4133-9ba8-079cd909e92f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8738fea033e4b66b0f4e5f872f4c073'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:22.260406 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1245/2524] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:47:21 2022] DELETE /identity/v3/users/f8738fea033e4b66b0f4e5f872f4c073 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:47:22.266520 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3c140-af85-46ff-9ed1-96b073ae2882 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:22.267078 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3c140-af85-46ff-9ed1-96b073ae2882 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:22.267199 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3c140-af85-46ff-9ed1-96b073ae2882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:22.298258 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-5dd3c140-af85-46ff-9ed1-96b073ae2882 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:47:22.299893 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-5dd3c140-af85-46ff-9ed1-96b073ae2882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:22.439242 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1280/2525] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:47:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:47:22.450721 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cefe31-2c50-4133-9ba8-079cd909e92f admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:22.452784 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-75cefe31-2c50-4133-9ba8-079cd909e92f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:22.539403 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:22.573390 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cefe31-2c50-4133-9ba8-079cd909e92f admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:22.582403 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62d550-08d1-419a-8d9d-30122923b446 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:22.583464 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62d550-08d1-419a-8d9d-30122923b446 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:22.583916 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62d550-08d1-419a-8d9d-30122923b446 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:22.584357 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62d550-08d1-419a-8d9d-30122923b446 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:22.609543 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f62d550-08d1-419a-8d9d-30122923b446 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:22.611871 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f62d550-08d1-419a-8d9d-30122923b446 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:22.633113 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1246/2526] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:47:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:47:23.325539 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd3c140-af85-46ff-9ed1-96b073ae2882 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:23.327155 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-5dd3c140-af85-46ff-9ed1-96b073ae2882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:23.343355 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd3c140-af85-46ff-9ed1-96b073ae2882 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:23.350485 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc566211-dcdc-4f33-8f17-19b42eab3d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:23.351701 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc566211-dcdc-4f33-8f17-19b42eab3d0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:23.352102 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc566211-dcdc-4f33-8f17-19b42eab3d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:23.352577 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc566211-dcdc-4f33-8f17-19b42eab3d0b admin admin] PATH_INFO: `/v3/projects/599ea794dc214413a6fb89989176126b` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:23.354205 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc566211-dcdc-4f33-8f17-19b42eab3d0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=599ea794dc214413a6fb89989176126b)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:23.357846 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc566211-dcdc-4f33-8f17-19b42eab3d0b admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:23.539027 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-cc566211-dcdc-4f33-8f17-19b42eab3d0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '599ea794dc214413a6fb89989176126b', 'request_id': 'req-cc566211-dcdc-4f33-8f17-19b42eab3d0b'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:23.559256 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-cc566211-dcdc-4f33-8f17-19b42eab3d0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '599ea794dc214413a6fb89989176126b', 'request_id': 'req-cc566211-dcdc-4f33-8f17-19b42eab3d0b'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:23.573505 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-cc566211-dcdc-4f33-8f17-19b42eab3d0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '599ea794dc214413a6fb89989176126b', 'request_id': 'req-cc566211-dcdc-4f33-8f17-19b42eab3d0b'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:24.240933 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-cc566211-dcdc-4f33-8f17-19b42eab3d0b admin admin] The token cache is being invalidate because project 599ea794dc214413a6fb89989176126b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80392) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:47:24.241281 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-cc566211-dcdc-4f33-8f17-19b42eab3d0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:24.247244 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-cc566211-dcdc-4f33-8f17-19b42eab3d0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:24.247244 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1281/2527] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:47:23 2022] DELETE /identity/v3/projects/599ea794dc214413a6fb89989176126b => generated 0 bytes in 919 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:47:24.248616 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62d550-08d1-419a-8d9d-30122923b446 service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:24.260103 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62d550-08d1-419a-8d9d-30122923b446 service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:24.324607 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bcd4d0-daed-4658-810e-33da876c4755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:24.326163 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bcd4d0-daed-4658-810e-33da876c4755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:24.326600 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bcd4d0-daed-4658-810e-33da876c4755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:24.327062 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bcd4d0-daed-4658-810e-33da876c4755 admin admin] PATH_INFO: `/v3/users/37cc400c3eb1440fbf266cadcb668549` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:24.328283 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bcd4d0-daed-4658-810e-33da876c4755 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37cc400c3eb1440fbf266cadcb668549)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:24.330397 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bcd4d0-daed-4658-810e-33da876c4755 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:24.690286 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-83bcd4d0-daed-4658-810e-33da876c4755 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37cc400c3eb1440fbf266cadcb668549'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:24.795927 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-83bcd4d0-daed-4658-810e-33da876c4755 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37cc400c3eb1440fbf266cadcb668549'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:24.796852 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-83bcd4d0-daed-4658-810e-33da876c4755 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37cc400c3eb1440fbf266cadcb668549'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:24.818190 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-83bcd4d0-daed-4658-810e-33da876c4755 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37cc400c3eb1440fbf266cadcb668549'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:24.834641 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-83bcd4d0-daed-4658-810e-33da876c4755 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37cc400c3eb1440fbf266cadcb668549'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:24.841396 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1247/2528] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:47:24 2022] DELETE /identity/v3/users/37cc400c3eb1440fbf266cadcb668549 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:47:25.516935 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc566211-dcdc-4f33-8f17-19b42eab3d0b admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:25.521891 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-cc566211-dcdc-4f33-8f17-19b42eab3d0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:25.535925 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:25.552052 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc566211-dcdc-4f33-8f17-19b42eab3d0b admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:25.644483 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee6bb1-5b63-4717-bc24-9503d577bc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:25.645597 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee6bb1-5b63-4717-bc24-9503d577bc7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:25.645974 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee6bb1-5b63-4717-bc24-9503d577bc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:25.646322 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee6bb1-5b63-4717-bc24-9503d577bc7c admin admin] PATH_INFO: `/v3/projects/13d05ffe56da4d60b39b35254fd2b46a` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:25.647623 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee6bb1-5b63-4717-bc24-9503d577bc7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=13d05ffe56da4d60b39b35254fd2b46a)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:25.650699 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fee6bb1-5b63-4717-bc24-9503d577bc7c admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:25.857817 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-3fee6bb1-5b63-4717-bc24-9503d577bc7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13d05ffe56da4d60b39b35254fd2b46a', 'request_id': 'req-3fee6bb1-5b63-4717-bc24-9503d577bc7c'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:25.865596 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-3fee6bb1-5b63-4717-bc24-9503d577bc7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13d05ffe56da4d60b39b35254fd2b46a', 'request_id': 'req-3fee6bb1-5b63-4717-bc24-9503d577bc7c'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:25.876995 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-3fee6bb1-5b63-4717-bc24-9503d577bc7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13d05ffe56da4d60b39b35254fd2b46a', 'request_id': 'req-3fee6bb1-5b63-4717-bc24-9503d577bc7c'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:25.983127 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-3fee6bb1-5b63-4717-bc24-9503d577bc7c admin admin] The token cache is being invalidate because project 13d05ffe56da4d60b39b35254fd2b46a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80392) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:47:25.985951 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-3fee6bb1-5b63-4717-bc24-9503d577bc7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:25.999701 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-3fee6bb1-5b63-4717-bc24-9503d577bc7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:25.999701 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1282/2529] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:47:25 2022] DELETE /identity/v3/projects/13d05ffe56da4d60b39b35254fd2b46a => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:47:25.999918 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7e416-14c4-419d-b854-5890355d100b None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:25.999918 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7e416-14c4-419d-b854-5890355d100b None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:25.999918 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e7e416-14c4-419d-b854-5890355d100b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:26.022051 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-e1e7e416-14c4-419d-b854-5890355d100b None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:47:26.023578 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-e1e7e416-14c4-419d-b854-5890355d100b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:26.117651 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1248/2530] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:47:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:47:26.119716 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6254b0e-24b8-4cce-851b-431b44a1351a None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:26.120240 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6254b0e-24b8-4cce-851b-431b44a1351a None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:26.120749 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6254b0e-24b8-4cce-851b-431b44a1351a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:26.154385 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-a6254b0e-24b8-4cce-851b-431b44a1351a None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:47:26.155756 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-a6254b0e-24b8-4cce-851b-431b44a1351a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:26.169224 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1283/2531] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:47:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:47:26.170219 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6254b0e-24b8-4cce-851b-431b44a1351a None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:26.170336 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e7e416-14c4-419d-b854-5890355d100b None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:26.171652 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-e1e7e416-14c4-419d-b854-5890355d100b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:26.181590 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6254b0e-24b8-4cce-851b-431b44a1351a None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:26.186015 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:26.187792 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe95a29-1ef9-4fad-9fbc-063ca690967b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:26.188597 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe95a29-1ef9-4fad-9fbc-063ca690967b admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:26.188946 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe95a29-1ef9-4fad-9fbc-063ca690967b admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:26.189342 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe95a29-1ef9-4fad-9fbc-063ca690967b admin admin] PATH_INFO: `/v3/domains` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:26.190277 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe95a29-1ef9-4fad-9fbc-063ca690967b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:47:26.190541 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe95a29-1ef9-4fad-9fbc-063ca690967b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:26.192441 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe95a29-1ef9-4fad-9fbc-063ca690967b admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:26.211449 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1284/2532] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 10:47:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:47:26.212764 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe95a29-1ef9-4fad-9fbc-063ca690967b admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:26.225081 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe95a29-1ef9-4fad-9fbc-063ca690967b admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:26.231159 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062846ac-0d38-48a8-9554-f798b7b33b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:26.232097 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062846ac-0d38-48a8-9554-f798b7b33b49 admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:26.232389 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062846ac-0d38-48a8-9554-f798b7b33b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:26.232669 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062846ac-0d38-48a8-9554-f798b7b33b49 admin admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:26.233444 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062846ac-0d38-48a8-9554-f798b7b33b49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:26.236580 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062846ac-0d38-48a8-9554-f798b7b33b49 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:26.255476 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e7e416-14c4-419d-b854-5890355d100b None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:26.264123 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d356b8-f11e-4013-b30e-147dbb5514fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:26.264808 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d356b8-f11e-4013-b30e-147dbb5514fd service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:26.265113 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d356b8-f11e-4013-b30e-147dbb5514fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:26.265385 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d356b8-f11e-4013-b30e-147dbb5514fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:26.267272 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-b6d356b8-f11e-4013-b30e-147dbb5514fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:26.280258 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d356b8-f11e-4013-b30e-147dbb5514fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:26.281728 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d356b8-f11e-4013-b30e-147dbb5514fd service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:26.314063 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1249/2533] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:47:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:47:26.382073 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d356b8-f11e-4013-b30e-147dbb5514fd service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:26.382728 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1285/2534] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:47:26 2022] POST /identity/v3/projects => generated 379 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:47:26.399061 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d356b8-f11e-4013-b30e-147dbb5514fd service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:26.579414 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b028cbf-8c0c-4a05-b79f-8554666425cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:26.579921 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b028cbf-8c0c-4a05-b79f-8554666425cb admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:26.580402 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b028cbf-8c0c-4a05-b79f-8554666425cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:26.580790 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b028cbf-8c0c-4a05-b79f-8554666425cb admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:26.581709 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b028cbf-8c0c-4a05-b79f-8554666425cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:26.586026 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b028cbf-8c0c-4a05-b79f-8554666425cb admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:26.691160 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1250/2535] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:47:26 2022] POST /identity/v3/users => generated 290 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:47:26.695586 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062846ac-0d38-48a8-9554-f798b7b33b49 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:26.711548 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062846ac-0d38-48a8-9554-f798b7b33b49 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:26.718648 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4169721c-218b-4863-b834-ffa2a904b6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:26.719644 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169721c-218b-4863-b834-ffa2a904b6c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:26.720122 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169721c-218b-4863-b834-ffa2a904b6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:26.720580 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4169721c-218b-4863-b834-ffa2a904b6c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:26.721582 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4169721c-218b-4863-b834-ffa2a904b6c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:26.723483 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4169721c-218b-4863-b834-ffa2a904b6c0 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:26.736372 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1286/2536] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:47:26 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:47:26.747584 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b028cbf-8c0c-4a05-b79f-8554666425cb admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:26.762246 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b028cbf-8c0c-4a05-b79f-8554666425cb admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:26.772160 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2876f855-51d9-40c0-8dd4-af5edd334eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:26.773183 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876f855-51d9-40c0-8dd4-af5edd334eac admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:26.775258 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876f855-51d9-40c0-8dd4-af5edd334eac admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:26.775908 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876f855-51d9-40c0-8dd4-af5edd334eac admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:26.778842 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2876f855-51d9-40c0-8dd4-af5edd334eac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:26.783074 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2876f855-51d9-40c0-8dd4-af5edd334eac admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:26.815866 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1251/2537] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:47:26 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:47:26.819938 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4169721c-218b-4863-b834-ffa2a904b6c0 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:26.834276 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4169721c-218b-4863-b834-ffa2a904b6c0 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:26.841463 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf32543-4128-41c1-a610-79aeaba601eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:26.842610 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf32543-4128-41c1-a610-79aeaba601eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:26.842954 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf32543-4128-41c1-a610-79aeaba601eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:26.843347 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf32543-4128-41c1-a610-79aeaba601eb admin admin] PATH_INFO: `/v3/projects/19f4f3d0dcb14d06b9afd59c6689435e/users/6b003c4c5fd2414b98c08256cda4d545/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:26.865360 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf32543-4128-41c1-a610-79aeaba601eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=19f4f3d0dcb14d06b9afd59c6689435e, user_id=6b003c4c5fd2414b98c08256cda4d545, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:26.868375 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf32543-4128-41c1-a610-79aeaba601eb admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:26.996569 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1287/2538] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:47:26 2022] PUT /identity/v3/projects/19f4f3d0dcb14d06b9afd59c6689435e/users/6b003c4c5fd2414b98c08256cda4d545/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:47:27.008016 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8575e-4216-479a-b0fc-3e1f591ef5c6 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:27.008617 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8575e-4216-479a-b0fc-3e1f591ef5c6 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:27.009219 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8575e-4216-479a-b0fc-3e1f591ef5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:27.064832 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-19d8575e-4216-479a-b0fc-3e1f591ef5c6 None None] MFA Rules not processed for user `6b003c4c5fd2414b98c08256cda4d545`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:47:27.066193 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-19d8575e-4216-479a-b0fc-3e1f591ef5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:27.194781 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1252/2539] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:47:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:47:27.199392 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf32543-4128-41c1-a610-79aeaba601eb admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:27.232257 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:27.293147 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf32543-4128-41c1-a610-79aeaba601eb admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:27.300651 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14afe228-e22e-4eb0-ab68-08f3d2fd62a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:27.300651 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14afe228-e22e-4eb0-ab68-08f3d2fd62a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:27.300651 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14afe228-e22e-4eb0-ab68-08f3d2fd62a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:27.300651 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14afe228-e22e-4eb0-ab68-08f3d2fd62a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:27.305067 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14afe228-e22e-4eb0-ab68-08f3d2fd62a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:27.305067 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14afe228-e22e-4eb0-ab68-08f3d2fd62a3 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:27.401089 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1288/2540] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:47:27 2022] POST /identity/v3/projects => generated 381 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:47:27.405482 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d8575e-4216-479a-b0fc-3e1f591ef5c6 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:27.417354 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d8575e-4216-479a-b0fc-3e1f591ef5c6 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:27.437723 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:27.490336 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda23a84-7b4f-4fc1-b8eb-0c9630a35a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:27.491023 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda23a84-7b4f-4fc1-b8eb-0c9630a35a13 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:27.491309 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda23a84-7b4f-4fc1-b8eb-0c9630a35a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:27.491585 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda23a84-7b4f-4fc1-b8eb-0c9630a35a13 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:27.492285 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda23a84-7b4f-4fc1-b8eb-0c9630a35a13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:27.495158 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda23a84-7b4f-4fc1-b8eb-0c9630a35a13 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:27.572286 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1253/2541] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:47:27 2022] POST /identity/v3/users => generated 297 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:47:27.576553 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14afe228-e22e-4eb0-ab68-08f3d2fd62a3 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:27.589023 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14afe228-e22e-4eb0-ab68-08f3d2fd62a3 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:27.594973 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161d50e-de8e-412d-8ac4-5472251802e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:27.595678 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161d50e-de8e-412d-8ac4-5472251802e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:27.595969 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161d50e-de8e-412d-8ac4-5472251802e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:27.596246 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161d50e-de8e-412d-8ac4-5472251802e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:27.596986 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1161d50e-de8e-412d-8ac4-5472251802e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:27.598716 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1161d50e-de8e-412d-8ac4-5472251802e1 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:27.612786 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1289/2542] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:47:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:47:27.616887 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda23a84-7b4f-4fc1-b8eb-0c9630a35a13 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:27.629405 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda23a84-7b4f-4fc1-b8eb-0c9630a35a13 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:27.635021 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb185b-0452-442c-91ca-9943cdf77908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:27.636072 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb185b-0452-442c-91ca-9943cdf77908 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:27.636360 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb185b-0452-442c-91ca-9943cdf77908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:27.636757 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb185b-0452-442c-91ca-9943cdf77908 admin admin] PATH_INFO: `/v3/projects/9382df1742c34cbea538ba580ada5679/users/2958c81453de432faabcaf472c3cfc01/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:27.663786 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb185b-0452-442c-91ca-9943cdf77908 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9382df1742c34cbea538ba580ada5679, user_id=2958c81453de432faabcaf472c3cfc01, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:27.667767 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb185b-0452-442c-91ca-9943cdf77908 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:28.344174 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1254/2543] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:47:27 2022] PUT /identity/v3/projects/9382df1742c34cbea538ba580ada5679/users/2958c81453de432faabcaf472c3cfc01/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 728 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:47:28.348393 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161d50e-de8e-412d-8ac4-5472251802e1 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:28.359376 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161d50e-de8e-412d-8ac4-5472251802e1 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:28.434234 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e29b42a-e5e4-44ca-aded-d8f70eae751b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:28.434926 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29b42a-e5e4-44ca-aded-d8f70eae751b admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:28.435204 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29b42a-e5e4-44ca-aded-d8f70eae751b admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:28.435489 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e29b42a-e5e4-44ca-aded-d8f70eae751b admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:28.436221 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e29b42a-e5e4-44ca-aded-d8f70eae751b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:28.438112 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e29b42a-e5e4-44ca-aded-d8f70eae751b admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:28.449955 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1290/2544] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:47:28.454052 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb185b-0452-442c-91ca-9943cdf77908 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:28.468113 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb185b-0452-442c-91ca-9943cdf77908 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:28.474411 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf5c6e-3ec7-4d45-ba3f-6574cf3209d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:28.475310 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf5c6e-3ec7-4d45-ba3f-6574cf3209d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:28.475659 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf5c6e-3ec7-4d45-ba3f-6574cf3209d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:28.475935 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf5c6e-3ec7-4d45-ba3f-6574cf3209d4 admin admin] PATH_INFO: `/v3/projects/9382df1742c34cbea538ba580ada5679/users/2958c81453de432faabcaf472c3cfc01/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:28.478862 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecf5c6e-3ec7-4d45-ba3f-6574cf3209d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9382df1742c34cbea538ba580ada5679, user_id=2958c81453de432faabcaf472c3cfc01, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:28.481742 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecf5c6e-3ec7-4d45-ba3f-6574cf3209d4 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:28.505610 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1255/2545] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:47:28 2022] PUT /identity/v3/projects/9382df1742c34cbea538ba580ada5679/users/2958c81453de432faabcaf472c3cfc01/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:47:28.516445 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1f841-9362-47ba-ac83-9a615b34b665 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:28.517161 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1f841-9362-47ba-ac83-9a615b34b665 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:28.517537 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b1f841-9362-47ba-ac83-9a615b34b665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:28.552867 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-11b1f841-9362-47ba-ac83-9a615b34b665 None None] MFA Rules not processed for user `2958c81453de432faabcaf472c3cfc01`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:47:28.554407 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-11b1f841-9362-47ba-ac83-9a615b34b665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:28.647023 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1291/2546] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:47:28 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:47:28.660804 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf5c6e-3ec7-4d45-ba3f-6574cf3209d4 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:28.662651 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-6ecf5c6e-3ec7-4d45-ba3f-6574cf3209d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:28.732309 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf5c6e-3ec7-4d45-ba3f-6574cf3209d4 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:28.736296 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47ac1a0-70bd-478b-b001-28adf9d9a8dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:28.737019 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ac1a0-70bd-478b-b001-28adf9d9a8dd service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:28.737395 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ac1a0-70bd-478b-b001-28adf9d9a8dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:28.737675 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ac1a0-70bd-478b-b001-28adf9d9a8dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:28.749395 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47ac1a0-70bd-478b-b001-28adf9d9a8dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:28.751106 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47ac1a0-70bd-478b-b001-28adf9d9a8dd service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:28.768158 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1256/2547] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:47:28 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:47:30.140677 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b1f841-9362-47ba-ac83-9a615b34b665 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:30.165928 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b1f841-9362-47ba-ac83-9a615b34b665 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:30.171442 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee5181-4939-41f7-8dbb-891fa04279d0 tempest-VolumeQuotaClassesTest-1043345554 tempest-VolumeQuotaClassesTest-1043345554-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2958c81453de432faabcaf472c3cfc01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9382df1742c34cbea538ba580ada5679', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:30.172167 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee5181-4939-41f7-8dbb-891fa04279d0 tempest-VolumeQuotaClassesTest-1043345554 tempest-VolumeQuotaClassesTest-1043345554-project-admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:30.172665 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee5181-4939-41f7-8dbb-891fa04279d0 tempest-VolumeQuotaClassesTest-1043345554 tempest-VolumeQuotaClassesTest-1043345554-project-admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:30.173158 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee5181-4939-41f7-8dbb-891fa04279d0 tempest-VolumeQuotaClassesTest-1043345554 tempest-VolumeQuotaClassesTest-1043345554-project-admin] PATH_INFO: `/v3/domains` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:30.174186 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ee5181-4939-41f7-8dbb-891fa04279d0 tempest-VolumeQuotaClassesTest-1043345554 tempest-VolumeQuotaClassesTest-1043345554-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:47:30.174549 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ee5181-4939-41f7-8dbb-891fa04279d0 tempest-VolumeQuotaClassesTest-1043345554 tempest-VolumeQuotaClassesTest-1043345554-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:30.176297 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ee5181-4939-41f7-8dbb-891fa04279d0 tempest-VolumeQuotaClassesTest-1043345554 tempest-VolumeQuotaClassesTest-1043345554-project-admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:30.190313 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:30.196802 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1292/2548] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 10:47:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:47:30.201453 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47ac1a0-70bd-478b-b001-28adf9d9a8dd service cinder] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:30.210975 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47ac1a0-70bd-478b-b001-28adf9d9a8dd service cinder] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:30.216633 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87cdf6c-73bd-4944-b171-d14186c9df31 tempest-VolumeQuotaClassesTest-1043345554 tempest-VolumeQuotaClassesTest-1043345554-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2958c81453de432faabcaf472c3cfc01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9382df1742c34cbea538ba580ada5679', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:30.217417 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87cdf6c-73bd-4944-b171-d14186c9df31 tempest-VolumeQuotaClassesTest-1043345554 tempest-VolumeQuotaClassesTest-1043345554-project-admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:30.217783 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87cdf6c-73bd-4944-b171-d14186c9df31 tempest-VolumeQuotaClassesTest-1043345554 tempest-VolumeQuotaClassesTest-1043345554-project-admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:30.218134 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87cdf6c-73bd-4944-b171-d14186c9df31 tempest-VolumeQuotaClassesTest-1043345554 tempest-VolumeQuotaClassesTest-1043345554-project-admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:30.218934 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87cdf6c-73bd-4944-b171-d14186c9df31 tempest-VolumeQuotaClassesTest-1043345554 tempest-VolumeQuotaClassesTest-1043345554-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:30.220774 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87cdf6c-73bd-4944-b171-d14186c9df31 tempest-VolumeQuotaClassesTest-1043345554 tempest-VolumeQuotaClassesTest-1043345554-project-admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:30.396321 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1257/2549] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:47:30 2022] POST /identity/v3/projects => generated 354 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:47:30.401679 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee5181-4939-41f7-8dbb-891fa04279d0 tempest-VolumeQuotaClassesTest-1043345554 tempest-VolumeQuotaClassesTest-1043345554-project-admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:30.411613 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee5181-4939-41f7-8dbb-891fa04279d0 tempest-VolumeQuotaClassesTest-1043345554 tempest-VolumeQuotaClassesTest-1043345554-project-admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:30.472639 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b17b8-6aaa-4d6c-87fc-4b4424eaa7f1 tempest-VolumeQuotaClassesTest-1043345554 tempest-VolumeQuotaClassesTest-1043345554-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2958c81453de432faabcaf472c3cfc01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9382df1742c34cbea538ba580ada5679', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:30.473540 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b17b8-6aaa-4d6c-87fc-4b4424eaa7f1 tempest-VolumeQuotaClassesTest-1043345554 tempest-VolumeQuotaClassesTest-1043345554-project-admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:30.476527 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b17b8-6aaa-4d6c-87fc-4b4424eaa7f1 tempest-VolumeQuotaClassesTest-1043345554 tempest-VolumeQuotaClassesTest-1043345554-project-admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:30.476527 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b17b8-6aaa-4d6c-87fc-4b4424eaa7f1 tempest-VolumeQuotaClassesTest-1043345554 tempest-VolumeQuotaClassesTest-1043345554-project-admin] PATH_INFO: `/v3/domains` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:30.476527 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66b17b8-6aaa-4d6c-87fc-4b4424eaa7f1 tempest-VolumeQuotaClassesTest-1043345554 tempest-VolumeQuotaClassesTest-1043345554-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:47:30.476527 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66b17b8-6aaa-4d6c-87fc-4b4424eaa7f1 tempest-VolumeQuotaClassesTest-1043345554 tempest-VolumeQuotaClassesTest-1043345554-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:30.477014 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66b17b8-6aaa-4d6c-87fc-4b4424eaa7f1 tempest-VolumeQuotaClassesTest-1043345554 tempest-VolumeQuotaClassesTest-1043345554-project-admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:30.493424 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1293/2550] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 10:47:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:47:30.529997 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87cdf6c-73bd-4944-b171-d14186c9df31 tempest-VolumeQuotaClassesTest-1043345554 tempest-VolumeQuotaClassesTest-1043345554-project-admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:30.541891 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87cdf6c-73bd-4944-b171-d14186c9df31 tempest-VolumeQuotaClassesTest-1043345554 tempest-VolumeQuotaClassesTest-1043345554-project-admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:30.548092 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891af2b8-e966-411e-8db4-a3c265ac7cd6 tempest-VolumeQuotaClassesTest-1043345554 tempest-VolumeQuotaClassesTest-1043345554-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2958c81453de432faabcaf472c3cfc01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9382df1742c34cbea538ba580ada5679', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:30.549467 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891af2b8-e966-411e-8db4-a3c265ac7cd6 tempest-VolumeQuotaClassesTest-1043345554 tempest-VolumeQuotaClassesTest-1043345554-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:30.549864 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891af2b8-e966-411e-8db4-a3c265ac7cd6 tempest-VolumeQuotaClassesTest-1043345554 tempest-VolumeQuotaClassesTest-1043345554-project-admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:30.550245 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891af2b8-e966-411e-8db4-a3c265ac7cd6 tempest-VolumeQuotaClassesTest-1043345554 tempest-VolumeQuotaClassesTest-1043345554-project-admin] PATH_INFO: `/v3/projects/6d9cb3f079e0455baeb037b028cc1350` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:30.551584 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891af2b8-e966-411e-8db4-a3c265ac7cd6 tempest-VolumeQuotaClassesTest-1043345554 tempest-VolumeQuotaClassesTest-1043345554-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6d9cb3f079e0455baeb037b028cc1350)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:30.553724 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891af2b8-e966-411e-8db4-a3c265ac7cd6 tempest-VolumeQuotaClassesTest-1043345554 tempest-VolumeQuotaClassesTest-1043345554-project-admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:30.741977 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=90,keystone:INSERT=6,keystone:DELETE=4 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:30.745851 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-891af2b8-e966-411e-8db4-a3c265ac7cd6 tempest-VolumeQuotaClassesTest-1043345554 tempest-VolumeQuotaClassesTest-1043345554-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d9cb3f079e0455baeb037b028cc1350', 'request_id': 'req-891af2b8-e966-411e-8db4-a3c265ac7cd6'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:30.752460 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-891af2b8-e966-411e-8db4-a3c265ac7cd6 tempest-VolumeQuotaClassesTest-1043345554 tempest-VolumeQuotaClassesTest-1043345554-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d9cb3f079e0455baeb037b028cc1350', 'request_id': 'req-891af2b8-e966-411e-8db4-a3c265ac7cd6'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:30.758078 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-891af2b8-e966-411e-8db4-a3c265ac7cd6 tempest-VolumeQuotaClassesTest-1043345554 tempest-VolumeQuotaClassesTest-1043345554-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d9cb3f079e0455baeb037b028cc1350', 'request_id': 'req-891af2b8-e966-411e-8db4-a3c265ac7cd6'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:30.931237 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-891af2b8-e966-411e-8db4-a3c265ac7cd6 tempest-VolumeQuotaClassesTest-1043345554 tempest-VolumeQuotaClassesTest-1043345554-project-admin] The token cache is being invalidate because project 6d9cb3f079e0455baeb037b028cc1350 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:47:30.931476 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-891af2b8-e966-411e-8db4-a3c265ac7cd6 tempest-VolumeQuotaClassesTest-1043345554 tempest-VolumeQuotaClassesTest-1043345554-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:30.932202 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-891af2b8-e966-411e-8db4-a3c265ac7cd6 tempest-VolumeQuotaClassesTest-1043345554 tempest-VolumeQuotaClassesTest-1043345554-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:30.933950 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1258/2551] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:47:30 2022] DELETE /identity/v3/projects/6d9cb3f079e0455baeb037b028cc1350 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:47:31.674603 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b17b8-6aaa-4d6c-87fc-4b4424eaa7f1 tempest-VolumeQuotaClassesTest-1043345554 tempest-VolumeQuotaClassesTest-1043345554-project-admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:31.676647 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-c66b17b8-6aaa-4d6c-87fc-4b4424eaa7f1 tempest-VolumeQuotaClassesTest-1043345554 tempest-VolumeQuotaClassesTest-1043345554-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:31.747390 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b17b8-6aaa-4d6c-87fc-4b4424eaa7f1 tempest-VolumeQuotaClassesTest-1043345554 tempest-VolumeQuotaClassesTest-1043345554-project-admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:31.809531 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8538f360-4154-4404-88d9-50026c69e9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:31.810425 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538f360-4154-4404-88d9-50026c69e9f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:31.810703 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538f360-4154-4404-88d9-50026c69e9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:31.810974 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538f360-4154-4404-88d9-50026c69e9f9 admin admin] PATH_INFO: `/v3/users/6b003c4c5fd2414b98c08256cda4d545` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:31.812207 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8538f360-4154-4404-88d9-50026c69e9f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b003c4c5fd2414b98c08256cda4d545)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:31.814202 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8538f360-4154-4404-88d9-50026c69e9f9 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:32.141438 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:32.146412 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-8538f360-4154-4404-88d9-50026c69e9f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b003c4c5fd2414b98c08256cda4d545'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:32.245097 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-8538f360-4154-4404-88d9-50026c69e9f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b003c4c5fd2414b98c08256cda4d545'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:32.245738 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-8538f360-4154-4404-88d9-50026c69e9f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b003c4c5fd2414b98c08256cda4d545'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:32.259909 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-8538f360-4154-4404-88d9-50026c69e9f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b003c4c5fd2414b98c08256cda4d545'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:32.266425 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-8538f360-4154-4404-88d9-50026c69e9f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b003c4c5fd2414b98c08256cda4d545'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:32.272689 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1294/2552] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:47:31 2022] DELETE /identity/v3/users/6b003c4c5fd2414b98c08256cda4d545 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:47:32.278085 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb88c129-c03d-4284-9474-adee9dd5a984 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:32.278572 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb88c129-c03d-4284-9474-adee9dd5a984 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:32.278682 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb88c129-c03d-4284-9474-adee9dd5a984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:32.299682 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-bb88c129-c03d-4284-9474-adee9dd5a984 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:47:32.301207 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-bb88c129-c03d-4284-9474-adee9dd5a984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:32.363421 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1259/2553] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:47:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:47:32.377182 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8538f360-4154-4404-88d9-50026c69e9f9 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:32.379192 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-8538f360-4154-4404-88d9-50026c69e9f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:32.439939 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8538f360-4154-4404-88d9-50026c69e9f9 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:32.443619 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae65b02-671d-47df-8c9d-5444d4803941 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:32.444550 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae65b02-671d-47df-8c9d-5444d4803941 service neutron] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:32.445115 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae65b02-671d-47df-8c9d-5444d4803941 service neutron] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:32.445469 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae65b02-671d-47df-8c9d-5444d4803941 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:32.456387 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae65b02-671d-47df-8c9d-5444d4803941 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:32.457879 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae65b02-671d-47df-8c9d-5444d4803941 service neutron] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:32.472688 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1295/2554] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:47:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:47:33.073660 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb88c129-c03d-4284-9474-adee9dd5a984 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:33.073660 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-bb88c129-c03d-4284-9474-adee9dd5a984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:33.094147 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb88c129-c03d-4284-9474-adee9dd5a984 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:33.099661 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b7519-f254-4321-9030-0f486792532b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:33.100926 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b7519-f254-4321-9030-0f486792532b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:33.102282 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b7519-f254-4321-9030-0f486792532b admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:33.102282 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b7519-f254-4321-9030-0f486792532b admin admin] PATH_INFO: `/v3/projects/19f4f3d0dcb14d06b9afd59c6689435e` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:33.105002 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5b7519-f254-4321-9030-0f486792532b admin admin] RBAC: Authorizing `identity:delete_project(project_id=19f4f3d0dcb14d06b9afd59c6689435e)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:33.119986 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5b7519-f254-4321-9030-0f486792532b admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:33.273498 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-4c5b7519-f254-4321-9030-0f486792532b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19f4f3d0dcb14d06b9afd59c6689435e', 'request_id': 'req-4c5b7519-f254-4321-9030-0f486792532b'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:33.284751 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-4c5b7519-f254-4321-9030-0f486792532b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19f4f3d0dcb14d06b9afd59c6689435e', 'request_id': 'req-4c5b7519-f254-4321-9030-0f486792532b'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:33.291970 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-4c5b7519-f254-4321-9030-0f486792532b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19f4f3d0dcb14d06b9afd59c6689435e', 'request_id': 'req-4c5b7519-f254-4321-9030-0f486792532b'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:33.416562 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-4c5b7519-f254-4321-9030-0f486792532b admin admin] The token cache is being invalidate because project 19f4f3d0dcb14d06b9afd59c6689435e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:47:33.416826 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-4c5b7519-f254-4321-9030-0f486792532b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:33.417504 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-4c5b7519-f254-4321-9030-0f486792532b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:33.419066 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1260/2555] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:47:33 2022] DELETE /identity/v3/projects/19f4f3d0dcb14d06b9afd59c6689435e => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:47:33.423242 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae65b02-671d-47df-8c9d-5444d4803941 service neutron] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:33.438572 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae65b02-671d-47df-8c9d-5444d4803941 service neutron] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:33.502604 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa24372a-9187-4e58-b7c5-4ef93c435e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:33.503470 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24372a-9187-4e58-b7c5-4ef93c435e0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:33.503754 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24372a-9187-4e58-b7c5-4ef93c435e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:33.504026 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24372a-9187-4e58-b7c5-4ef93c435e0a admin admin] PATH_INFO: `/v3/users/2958c81453de432faabcaf472c3cfc01` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:33.505260 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa24372a-9187-4e58-b7c5-4ef93c435e0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2958c81453de432faabcaf472c3cfc01)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:33.507190 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa24372a-9187-4e58-b7c5-4ef93c435e0a admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:33.907307 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-fa24372a-9187-4e58-b7c5-4ef93c435e0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2958c81453de432faabcaf472c3cfc01'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:34.051248 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-fa24372a-9187-4e58-b7c5-4ef93c435e0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2958c81453de432faabcaf472c3cfc01'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:34.052407 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-fa24372a-9187-4e58-b7c5-4ef93c435e0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2958c81453de432faabcaf472c3cfc01'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:34.063403 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:34.069642 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-fa24372a-9187-4e58-b7c5-4ef93c435e0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2958c81453de432faabcaf472c3cfc01'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:34.079909 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-fa24372a-9187-4e58-b7c5-4ef93c435e0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2958c81453de432faabcaf472c3cfc01'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:34.088515 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1296/2556] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:47:33 2022] DELETE /identity/v3/users/2958c81453de432faabcaf472c3cfc01 => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:47:34.619722 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b7519-f254-4321-9030-0f486792532b admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:34.621818 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-4c5b7519-f254-4321-9030-0f486792532b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:34.652200 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b7519-f254-4321-9030-0f486792532b admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:34.738876 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0aeab2-2c71-4894-be29-b03ffa2b6d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:34.739783 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0aeab2-2c71-4894-be29-b03ffa2b6d82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:34.740089 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0aeab2-2c71-4894-be29-b03ffa2b6d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:34.740329 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0aeab2-2c71-4894-be29-b03ffa2b6d82 admin admin] PATH_INFO: `/v3/projects/9382df1742c34cbea538ba580ada5679` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:34.741599 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0aeab2-2c71-4894-be29-b03ffa2b6d82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9382df1742c34cbea538ba580ada5679)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:34.745101 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0aeab2-2c71-4894-be29-b03ffa2b6d82 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:34.746818 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:34.915164 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-5a0aeab2-2c71-4894-be29-b03ffa2b6d82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9382df1742c34cbea538ba580ada5679', 'request_id': 'req-5a0aeab2-2c71-4894-be29-b03ffa2b6d82'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:34.921428 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-5a0aeab2-2c71-4894-be29-b03ffa2b6d82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9382df1742c34cbea538ba580ada5679', 'request_id': 'req-5a0aeab2-2c71-4894-be29-b03ffa2b6d82'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:34.927487 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-5a0aeab2-2c71-4894-be29-b03ffa2b6d82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9382df1742c34cbea538ba580ada5679', 'request_id': 'req-5a0aeab2-2c71-4894-be29-b03ffa2b6d82'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:35.069818 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-5a0aeab2-2c71-4894-be29-b03ffa2b6d82 admin admin] The token cache is being invalidate because project 9382df1742c34cbea538ba580ada5679 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:47:35.070119 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-5a0aeab2-2c71-4894-be29-b03ffa2b6d82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:35.070779 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-5a0aeab2-2c71-4894-be29-b03ffa2b6d82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:35.073055 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1261/2557] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:47:34 2022] DELETE /identity/v3/projects/9382df1742c34cbea538ba580ada5679 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:47:35.077985 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33ed97-ad97-40d2-9aa7-81e88c9db23f None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:35.078533 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33ed97-ad97-40d2-9aa7-81e88c9db23f None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:35.078533 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f33ed97-ad97-40d2-9aa7-81e88c9db23f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:35.103588 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-5f33ed97-ad97-40d2-9aa7-81e88c9db23f None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:47:35.104834 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-5f33ed97-ad97-40d2-9aa7-81e88c9db23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:35.166768 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1297/2558] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:47:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:47:35.175282 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c97229-a246-4076-af2a-f6fa69d2f76b None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:35.175700 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c97229-a246-4076-af2a-f6fa69d2f76b None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:35.176067 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c97229-a246-4076-af2a-f6fa69d2f76b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:35.196931 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-48c97229-a246-4076-af2a-f6fa69d2f76b None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:47:35.198232 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-48c97229-a246-4076-af2a-f6fa69d2f76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:35.206613 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1262/2559] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:47:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:47:35.210968 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33ed97-ad97-40d2-9aa7-81e88c9db23f None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:35.221610 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f33ed97-ad97-40d2-9aa7-81e88c9db23f None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:35.226271 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73334a96-828d-443f-a299-3cfb80009357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:35.226929 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73334a96-828d-443f-a299-3cfb80009357 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:35.227734 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73334a96-828d-443f-a299-3cfb80009357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:35.228638 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73334a96-828d-443f-a299-3cfb80009357 admin admin] PATH_INFO: `/v3/domains` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:35.229402 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73334a96-828d-443f-a299-3cfb80009357 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:47:35.229713 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73334a96-828d-443f-a299-3cfb80009357 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:35.231366 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73334a96-828d-443f-a299-3cfb80009357 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:35.245333 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1298/2560] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 10:47:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:47:35.249634 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c97229-a246-4076-af2a-f6fa69d2f76b None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:35.259875 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c97229-a246-4076-af2a-f6fa69d2f76b None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:35.269035 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f880a4-e2bf-4299-9c87-d05a42b8e90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:35.269900 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f880a4-e2bf-4299-9c87-d05a42b8e90e admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:35.270359 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f880a4-e2bf-4299-9c87-d05a42b8e90e admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:35.270769 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f880a4-e2bf-4299-9c87-d05a42b8e90e admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:35.271709 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f880a4-e2bf-4299-9c87-d05a42b8e90e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:35.274023 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f880a4-e2bf-4299-9c87-d05a42b8e90e admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:35.426710 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1263/2561] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:47:35 2022] POST /identity/v3/projects => generated 389 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:47:35.430614 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73334a96-828d-443f-a299-3cfb80009357 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:35.441667 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73334a96-828d-443f-a299-3cfb80009357 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:35.501372 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64827782-c92c-41c6-adad-1e82132d089d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:35.502077 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64827782-c92c-41c6-adad-1e82132d089d admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:35.502366 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64827782-c92c-41c6-adad-1e82132d089d admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:35.502640 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64827782-c92c-41c6-adad-1e82132d089d admin admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:35.503327 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64827782-c92c-41c6-adad-1e82132d089d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:35.505272 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64827782-c92c-41c6-adad-1e82132d089d admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:35.674800 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1299/2562] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:47:35 2022] POST /identity/v3/users => generated 295 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:47:35.678948 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f880a4-e2bf-4299-9c87-d05a42b8e90e admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:35.690506 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f880a4-e2bf-4299-9c87-d05a42b8e90e admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:35.695148 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a2f5ef-9047-430e-8a73-56935eb6a841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:35.695814 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2f5ef-9047-430e-8a73-56935eb6a841 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:35.696748 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2f5ef-9047-430e-8a73-56935eb6a841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:35.697595 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2f5ef-9047-430e-8a73-56935eb6a841 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:35.698338 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a2f5ef-9047-430e-8a73-56935eb6a841 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:35.699949 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a2f5ef-9047-430e-8a73-56935eb6a841 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:35.714832 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1264/2563] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:47:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:47:35.719167 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64827782-c92c-41c6-adad-1e82132d089d admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:35.733484 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64827782-c92c-41c6-adad-1e82132d089d admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:35.739062 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9002c6-d732-4de0-99cd-3f94385a8bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:35.739736 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9002c6-d732-4de0-99cd-3f94385a8bc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:35.740020 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9002c6-d732-4de0-99cd-3f94385a8bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:35.740298 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9002c6-d732-4de0-99cd-3f94385a8bc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:35.741178 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9002c6-d732-4de0-99cd-3f94385a8bc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:35.742725 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9002c6-d732-4de0-99cd-3f94385a8bc6 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:35.753689 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1300/2564] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:47:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:47:35.757804 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a2f5ef-9047-430e-8a73-56935eb6a841 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:35.768740 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a2f5ef-9047-430e-8a73-56935eb6a841 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:35.773483 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e22e084-418d-4a5e-a4ce-e90d958fbbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:35.775659 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22e084-418d-4a5e-a4ce-e90d958fbbf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:35.775944 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22e084-418d-4a5e-a4ce-e90d958fbbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:35.776224 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22e084-418d-4a5e-a4ce-e90d958fbbf3 admin admin] PATH_INFO: `/v3/projects/09725c1d51274669a9b87843588575aa/users/97e725c49efc4c6c9253673aac7225d9/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:35.796731 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e22e084-418d-4a5e-a4ce-e90d958fbbf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09725c1d51274669a9b87843588575aa, user_id=97e725c49efc4c6c9253673aac7225d9, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:35.799921 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e22e084-418d-4a5e-a4ce-e90d958fbbf3 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:35.926099 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1265/2565] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:47:35 2022] PUT /identity/v3/projects/09725c1d51274669a9b87843588575aa/users/97e725c49efc4c6c9253673aac7225d9/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:47:35.937560 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd994e5f-8bf2-4069-8fc2-b291b9a9beed None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:35.937853 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd994e5f-8bf2-4069-8fc2-b291b9a9beed None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:35.938133 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd994e5f-8bf2-4069-8fc2-b291b9a9beed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:35.968254 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-bd994e5f-8bf2-4069-8fc2-b291b9a9beed None None] MFA Rules not processed for user `97e725c49efc4c6c9253673aac7225d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:47:35.976774 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-bd994e5f-8bf2-4069-8fc2-b291b9a9beed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:36.004788 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:36.043720 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1301/2566] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:47:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:47:36.048245 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e22e084-418d-4a5e-a4ce-e90d958fbbf3 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:36.129511 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e22e084-418d-4a5e-a4ce-e90d958fbbf3 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:36.136002 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74205d5-8c48-48fe-ba23-2f7967fb0e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:36.136741 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74205d5-8c48-48fe-ba23-2f7967fb0e9a admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:36.137113 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74205d5-8c48-48fe-ba23-2f7967fb0e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:36.137470 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74205d5-8c48-48fe-ba23-2f7967fb0e9a admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:36.139134 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74205d5-8c48-48fe-ba23-2f7967fb0e9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:36.140314 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74205d5-8c48-48fe-ba23-2f7967fb0e9a admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:36.292774 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1266/2567] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:47:36 2022] POST /identity/v3/projects => generated 389 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:47:36.297221 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd994e5f-8bf2-4069-8fc2-b291b9a9beed None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:36.309301 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd994e5f-8bf2-4069-8fc2-b291b9a9beed None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:36.369648 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101331b1-09a5-4f3a-a480-2a5559be65e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:36.370391 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101331b1-09a5-4f3a-a480-2a5559be65e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:36.371142 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101331b1-09a5-4f3a-a480-2a5559be65e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:36.371142 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101331b1-09a5-4f3a-a480-2a5559be65e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:36.371823 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101331b1-09a5-4f3a-a480-2a5559be65e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:36.373891 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101331b1-09a5-4f3a-a480-2a5559be65e9 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:36.546560 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1302/2568] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:47:36 2022] POST /identity/v3/users => generated 301 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:47:36.548142 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74205d5-8c48-48fe-ba23-2f7967fb0e9a admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:36.559780 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74205d5-8c48-48fe-ba23-2f7967fb0e9a admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:36.565109 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c518c-4e3d-41b0-b95b-b5632ad1233f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:36.565962 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c518c-4e3d-41b0-b95b-b5632ad1233f admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:36.566249 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c518c-4e3d-41b0-b95b-b5632ad1233f admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:36.566925 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c518c-4e3d-41b0-b95b-b5632ad1233f admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:36.567237 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c518c-4e3d-41b0-b95b-b5632ad1233f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:36.568902 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c518c-4e3d-41b0-b95b-b5632ad1233f admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:36.575445 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:36.584579 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1267/2569] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:47:36 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:47:36.594321 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101331b1-09a5-4f3a-a480-2a5559be65e9 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:36.612363 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101331b1-09a5-4f3a-a480-2a5559be65e9 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:36.616074 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a46f436-aa1e-46d2-8346-117fb4293416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:36.617162 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a46f436-aa1e-46d2-8346-117fb4293416 admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:36.617591 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a46f436-aa1e-46d2-8346-117fb4293416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:36.618922 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a46f436-aa1e-46d2-8346-117fb4293416 admin admin] PATH_INFO: `/v3/projects/88b98671cd71429ba1063d19a23adbdf/users/92b572fb071945d1b23af2c4c5272adc/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:36.636567 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a46f436-aa1e-46d2-8346-117fb4293416 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88b98671cd71429ba1063d19a23adbdf, user_id=92b572fb071945d1b23af2c4c5272adc, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:36.647381 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a46f436-aa1e-46d2-8346-117fb4293416 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:36.765442 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1303/2570] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:47:36 2022] PUT /identity/v3/projects/88b98671cd71429ba1063d19a23adbdf/users/92b572fb071945d1b23af2c4c5272adc/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:47:36.770650 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c518c-4e3d-41b0-b95b-b5632ad1233f admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:36.782325 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c518c-4e3d-41b0-b95b-b5632ad1233f admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:36.847684 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32be7529-4537-438b-95c1-c59b934e71dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:36.848358 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be7529-4537-438b-95c1-c59b934e71dc admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:36.848669 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be7529-4537-438b-95c1-c59b934e71dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:36.848941 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be7529-4537-438b-95c1-c59b934e71dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:36.849815 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32be7529-4537-438b-95c1-c59b934e71dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:36.851392 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32be7529-4537-438b-95c1-c59b934e71dc admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:36.864365 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1268/2571] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:47:36 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:47:36.869658 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a46f436-aa1e-46d2-8346-117fb4293416 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:36.880786 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a46f436-aa1e-46d2-8346-117fb4293416 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:36.886873 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b401a3-3cf5-4743-b309-fbdffcecb6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:36.888010 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b401a3-3cf5-4743-b309-fbdffcecb6e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:36.888351 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b401a3-3cf5-4743-b309-fbdffcecb6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:36.888858 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b401a3-3cf5-4743-b309-fbdffcecb6e2 admin admin] PATH_INFO: `/v3/projects/88b98671cd71429ba1063d19a23adbdf/users/92b572fb071945d1b23af2c4c5272adc/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:36.891603 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b401a3-3cf5-4743-b309-fbdffcecb6e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88b98671cd71429ba1063d19a23adbdf, user_id=92b572fb071945d1b23af2c4c5272adc, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:36.895272 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b401a3-3cf5-4743-b309-fbdffcecb6e2 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:36.908342 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1304/2572] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:47:36 2022] PUT /identity/v3/projects/88b98671cd71429ba1063d19a23adbdf/users/92b572fb071945d1b23af2c4c5272adc/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:47:36.919689 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a8b724-1042-4924-aef1-99da099ff59c None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:36.919978 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a8b724-1042-4924-aef1-99da099ff59c None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:36.920259 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a8b724-1042-4924-aef1-99da099ff59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:36.950168 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-22a8b724-1042-4924-aef1-99da099ff59c None None] MFA Rules not processed for user `92b572fb071945d1b23af2c4c5272adc`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:47:36.951404 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-22a8b724-1042-4924-aef1-99da099ff59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:37.022947 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1269/2573] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:47:36 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:47:37.034408 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b401a3-3cf5-4743-b309-fbdffcecb6e2 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:37.036215 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-64b401a3-3cf5-4743-b309-fbdffcecb6e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:37.112385 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b401a3-3cf5-4743-b309-fbdffcecb6e2 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:37.116747 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea2b149-cf6f-4fa0-9347-3373fdae4f44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:37.117797 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2b149-cf6f-4fa0-9347-3373fdae4f44 service cinder] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:37.118228 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2b149-cf6f-4fa0-9347-3373fdae4f44 service cinder] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:37.118925 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2b149-cf6f-4fa0-9347-3373fdae4f44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:37.131018 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea2b149-cf6f-4fa0-9347-3373fdae4f44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:37.132642 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea2b149-cf6f-4fa0-9347-3373fdae4f44 service cinder] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:37.144304 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1305/2574] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:47:37 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:47:37.298967 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a8b724-1042-4924-aef1-99da099ff59c None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:37.367492 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a8b724-1042-4924-aef1-99da099ff59c None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:37.372891 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a770e-8224-43d7-a23c-81463c64f1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:37.373792 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a770e-8224-43d7-a23c-81463c64f1e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:37.374110 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a770e-8224-43d7-a23c-81463c64f1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:37.374380 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a770e-8224-43d7-a23c-81463c64f1e1 admin admin] PATH_INFO: `/v3/users/97e725c49efc4c6c9253673aac7225d9` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:37.375575 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5a770e-8224-43d7-a23c-81463c64f1e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97e725c49efc4c6c9253673aac7225d9)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:37.377532 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5a770e-8224-43d7-a23c-81463c64f1e1 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:37.402741 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:37.635303 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7c5a770e-8224-43d7-a23c-81463c64f1e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97e725c49efc4c6c9253673aac7225d9'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:37.765650 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7c5a770e-8224-43d7-a23c-81463c64f1e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97e725c49efc4c6c9253673aac7225d9'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:37.766722 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7c5a770e-8224-43d7-a23c-81463c64f1e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97e725c49efc4c6c9253673aac7225d9'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:37.780935 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7c5a770e-8224-43d7-a23c-81463c64f1e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97e725c49efc4c6c9253673aac7225d9'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:37.788600 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7c5a770e-8224-43d7-a23c-81463c64f1e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97e725c49efc4c6c9253673aac7225d9'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:37.795845 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1270/2575] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:47:37 2022] DELETE /identity/v3/users/97e725c49efc4c6c9253673aac7225d9 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:47:37.801846 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d0437-d6ac-4548-862d-cb3979badf03 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:37.802373 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d0437-d6ac-4548-862d-cb3979badf03 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:37.802651 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d0437-d6ac-4548-862d-cb3979badf03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:37.821502 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-619d0437-d6ac-4548-862d-cb3979badf03 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:47:37.822822 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-619d0437-d6ac-4548-862d-cb3979badf03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:37.850076 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:37.886755 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1306/2576] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:47:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:47:37.897644 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a770e-8224-43d7-a23c-81463c64f1e1 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:37.899760 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-7c5a770e-8224-43d7-a23c-81463c64f1e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:37.966565 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a770e-8224-43d7-a23c-81463c64f1e1 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:37.970343 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8c94c-065b-4047-96ed-2730b3382f87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:37.971078 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8c94c-065b-4047-96ed-2730b3382f87 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:37.971358 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8c94c-065b-4047-96ed-2730b3382f87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:37.971655 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8c94c-065b-4047-96ed-2730b3382f87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:37.981335 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8c94c-065b-4047-96ed-2730b3382f87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:37.983805 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8c94c-065b-4047-96ed-2730b3382f87 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:37.994836 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1271/2577] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:47:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:47:38.658259 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619d0437-d6ac-4548-862d-cb3979badf03 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:38.658259 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-619d0437-d6ac-4548-862d-cb3979badf03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:38.670037 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619d0437-d6ac-4548-862d-cb3979badf03 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:38.678127 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aaf4b9-866a-424a-9ca5-e6f2043ec0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:38.679057 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aaf4b9-866a-424a-9ca5-e6f2043ec0f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:38.679357 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aaf4b9-866a-424a-9ca5-e6f2043ec0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:38.679617 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aaf4b9-866a-424a-9ca5-e6f2043ec0f5 admin admin] PATH_INFO: `/v3/projects/09725c1d51274669a9b87843588575aa` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:38.681812 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aaf4b9-866a-424a-9ca5-e6f2043ec0f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09725c1d51274669a9b87843588575aa)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:38.683870 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aaf4b9-866a-424a-9ca5-e6f2043ec0f5 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:38.909473 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-b1aaf4b9-866a-424a-9ca5-e6f2043ec0f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09725c1d51274669a9b87843588575aa', 'request_id': 'req-b1aaf4b9-866a-424a-9ca5-e6f2043ec0f5'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:38.915168 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-b1aaf4b9-866a-424a-9ca5-e6f2043ec0f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09725c1d51274669a9b87843588575aa', 'request_id': 'req-b1aaf4b9-866a-424a-9ca5-e6f2043ec0f5'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:38.921555 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-b1aaf4b9-866a-424a-9ca5-e6f2043ec0f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09725c1d51274669a9b87843588575aa', 'request_id': 'req-b1aaf4b9-866a-424a-9ca5-e6f2043ec0f5'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:39.011507 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-b1aaf4b9-866a-424a-9ca5-e6f2043ec0f5 admin admin] The token cache is being invalidate because project 09725c1d51274669a9b87843588575aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80392) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:47:39.011835 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-b1aaf4b9-866a-424a-9ca5-e6f2043ec0f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:39.012523 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-b1aaf4b9-866a-424a-9ca5-e6f2043ec0f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:39.014400 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1307/2578] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:47:38 2022] DELETE /identity/v3/projects/09725c1d51274669a9b87843588575aa => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:47:39.018423 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8c94c-065b-4047-96ed-2730b3382f87 service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:39.029192 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8c94c-065b-4047-96ed-2730b3382f87 service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:39.218454 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47f04ec-52ac-4eea-8b1d-6e2e8a2e23f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:39.219437 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f04ec-52ac-4eea-8b1d-6e2e8a2e23f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:39.219757 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f04ec-52ac-4eea-8b1d-6e2e8a2e23f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:39.220031 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f04ec-52ac-4eea-8b1d-6e2e8a2e23f3 admin admin] PATH_INFO: `/v3/users/92b572fb071945d1b23af2c4c5272adc` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:39.221327 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47f04ec-52ac-4eea-8b1d-6e2e8a2e23f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92b572fb071945d1b23af2c4c5272adc)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:39.223268 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47f04ec-52ac-4eea-8b1d-6e2e8a2e23f3 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:39.613506 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:39.615618 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-b47f04ec-52ac-4eea-8b1d-6e2e8a2e23f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92b572fb071945d1b23af2c4c5272adc'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:39.760869 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-b47f04ec-52ac-4eea-8b1d-6e2e8a2e23f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92b572fb071945d1b23af2c4c5272adc'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:39.762066 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-b47f04ec-52ac-4eea-8b1d-6e2e8a2e23f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92b572fb071945d1b23af2c4c5272adc'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:39.779103 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-b47f04ec-52ac-4eea-8b1d-6e2e8a2e23f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92b572fb071945d1b23af2c4c5272adc'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:39.787554 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-b47f04ec-52ac-4eea-8b1d-6e2e8a2e23f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92b572fb071945d1b23af2c4c5272adc'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:39.794961 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1272/2579] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:47:39 2022] DELETE /identity/v3/users/92b572fb071945d1b23af2c4c5272adc => generated 0 bytes in 777 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:47:40.483165 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aaf4b9-866a-424a-9ca5-e6f2043ec0f5 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:40.490914 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-b1aaf4b9-866a-424a-9ca5-e6f2043ec0f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:40.506127 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aaf4b9-866a-424a-9ca5-e6f2043ec0f5 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:40.596209 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20eb7e1-c764-497a-b792-e3af36b9e80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:40.597341 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20eb7e1-c764-497a-b792-e3af36b9e80e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:40.597730 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20eb7e1-c764-497a-b792-e3af36b9e80e admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:40.598125 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20eb7e1-c764-497a-b792-e3af36b9e80e admin admin] PATH_INFO: `/v3/projects/88b98671cd71429ba1063d19a23adbdf` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:40.599532 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20eb7e1-c764-497a-b792-e3af36b9e80e admin admin] RBAC: Authorizing `identity:delete_project(project_id=88b98671cd71429ba1063d19a23adbdf)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:40.616189 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20eb7e1-c764-497a-b792-e3af36b9e80e admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:40.902518 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-d20eb7e1-c764-497a-b792-e3af36b9e80e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88b98671cd71429ba1063d19a23adbdf', 'request_id': 'req-d20eb7e1-c764-497a-b792-e3af36b9e80e'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:40.907574 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:40.909082 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-d20eb7e1-c764-497a-b792-e3af36b9e80e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88b98671cd71429ba1063d19a23adbdf', 'request_id': 'req-d20eb7e1-c764-497a-b792-e3af36b9e80e'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:40.916392 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-d20eb7e1-c764-497a-b792-e3af36b9e80e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88b98671cd71429ba1063d19a23adbdf', 'request_id': 'req-d20eb7e1-c764-497a-b792-e3af36b9e80e'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:41.036384 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-d20eb7e1-c764-497a-b792-e3af36b9e80e admin admin] The token cache is being invalidate because project 88b98671cd71429ba1063d19a23adbdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80392) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:47:41.036384 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-d20eb7e1-c764-497a-b792-e3af36b9e80e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:41.036384 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-d20eb7e1-c764-497a-b792-e3af36b9e80e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:41.036384 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1308/2580] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:47:40 2022] DELETE /identity/v3/projects/88b98671cd71429ba1063d19a23adbdf => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:47:41.040829 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551c481-cf8b-4e34-b4e3-85de491648b7 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:41.040829 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551c481-cf8b-4e34-b4e3-85de491648b7 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:41.040829 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551c481-cf8b-4e34-b4e3-85de491648b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:41.061611 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-8551c481-cf8b-4e34-b4e3-85de491648b7 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:47:41.063281 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-8551c481-cf8b-4e34-b4e3-85de491648b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:41.172275 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1273/2581] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:47:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:47:41.188245 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac3b23-b6a1-47dd-9d1c-5c77d00b3737 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:41.188666 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac3b23-b6a1-47dd-9d1c-5c77d00b3737 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:41.189129 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac3b23-b6a1-47dd-9d1c-5c77d00b3737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:41.214625 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-39ac3b23-b6a1-47dd-9d1c-5c77d00b3737 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:47:41.219186 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-39ac3b23-b6a1-47dd-9d1c-5c77d00b3737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:41.238786 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1309/2582] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:47:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:47:41.238880 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5bbc60-d1c8-4782-8fd8-5267a87ef1c2 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:41.238880 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5bbc60-d1c8-4782-8fd8-5267a87ef1c2 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:41.238880 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5bbc60-d1c8-4782-8fd8-5267a87ef1c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:41.239108 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ac3b23-b6a1-47dd-9d1c-5c77d00b3737 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:41.245109 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ac3b23-b6a1-47dd-9d1c-5c77d00b3737 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:41.253015 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57801079-3246-4ca8-af0a-aec519e6bc4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:41.253946 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57801079-3246-4ca8-af0a-aec519e6bc4f admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:41.254228 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57801079-3246-4ca8-af0a-aec519e6bc4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:41.254508 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57801079-3246-4ca8-af0a-aec519e6bc4f admin admin] PATH_INFO: `/v3/domains` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:41.255330 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57801079-3246-4ca8-af0a-aec519e6bc4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:47:41.255636 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57801079-3246-4ca8-af0a-aec519e6bc4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:41.257280 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57801079-3246-4ca8-af0a-aec519e6bc4f admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:41.259662 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-af5bbc60-d1c8-4782-8fd8-5267a87ef1c2 None None] MFA Rules not processed for user `88ad60446c5447a8bbd0096fa2133efb`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:47:41.261096 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-af5bbc60-d1c8-4782-8fd8-5267a87ef1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:41.272032 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1310/2583] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 10:47:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:47:41.277463 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57801079-3246-4ca8-af0a-aec519e6bc4f admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:41.288967 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57801079-3246-4ca8-af0a-aec519e6bc4f admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:41.294627 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db047ab-a506-43ca-aae2-fa9420518989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:41.295038 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db047ab-a506-43ca-aae2-fa9420518989 admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:41.295321 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db047ab-a506-43ca-aae2-fa9420518989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:41.295601 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db047ab-a506-43ca-aae2-fa9420518989 admin admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:41.296288 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db047ab-a506-43ca-aae2-fa9420518989 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:41.298271 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db047ab-a506-43ca-aae2-fa9420518989 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:41.324398 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1274/2584] 10.222.0.39 () {58 vars in 1009 bytes} [Mon Jul 18 10:47:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:47:41.337028 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5bbc60-d1c8-4782-8fd8-5267a87ef1c2 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:41.338552 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-af5bbc60-d1c8-4782-8fd8-5267a87ef1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:41.411707 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1311/2585] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:47:41 2022] POST /identity/v3/projects => generated 409 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:47:41.416958 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db047ab-a506-43ca-aae2-fa9420518989 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:41.424185 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5bbc60-d1c8-4782-8fd8-5267a87ef1c2 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:41.434584 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:41.490162 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db047ab-a506-43ca-aae2-fa9420518989 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:41.496453 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e86c23-1f7f-4eb8-8324-f511f3cfc249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:41.496957 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e86c23-1f7f-4eb8-8324-f511f3cfc249 admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:41.497276 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e86c23-1f7f-4eb8-8324-f511f3cfc249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:41.497552 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e86c23-1f7f-4eb8-8324-f511f3cfc249 admin admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:41.498262 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e86c23-1f7f-4eb8-8324-f511f3cfc249 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:41.500228 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e86c23-1f7f-4eb8-8324-f511f3cfc249 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:41.505232 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791b96a8-6ced-4fd6-a2af-9ee2ab7f0629 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c548474a8d94591ba58dd40e40a28d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:41.506070 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b96a8-6ced-4fd6-a2af-9ee2ab7f0629 service swift] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:41.506439 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b96a8-6ced-4fd6-a2af-9ee2ab7f0629 service swift] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:41.506751 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b96a8-6ced-4fd6-a2af-9ee2ab7f0629 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:41.565808 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791b96a8-6ced-4fd6-a2af-9ee2ab7f0629 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:41.567425 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791b96a8-6ced-4fd6-a2af-9ee2ab7f0629 service swift] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:41.578906 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1275/2586] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Jul 18 10:47:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 18 10:47:41.725376 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1312/2587] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:47:41 2022] POST /identity/v3/users => generated 305 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:47:41.730277 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791b96a8-6ced-4fd6-a2af-9ee2ab7f0629 service swift] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:41.740601 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791b96a8-6ced-4fd6-a2af-9ee2ab7f0629 service swift] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:41.745916 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1037695-c16b-4149-8490-274f11e89935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:41.746666 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1037695-c16b-4149-8490-274f11e89935 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:41.746889 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1037695-c16b-4149-8490-274f11e89935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:41.747163 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1037695-c16b-4149-8490-274f11e89935 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:41.747883 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1037695-c16b-4149-8490-274f11e89935 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:41.749500 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1037695-c16b-4149-8490-274f11e89935 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:41.760308 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1276/2588] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:47:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:47:41.770550 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e86c23-1f7f-4eb8-8324-f511f3cfc249 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:41.781687 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e86c23-1f7f-4eb8-8324-f511f3cfc249 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:41.786575 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84815c86-fbf6-4be2-a30a-d0a410fec962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:41.787252 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84815c86-fbf6-4be2-a30a-d0a410fec962 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:41.787540 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84815c86-fbf6-4be2-a30a-d0a410fec962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:41.787817 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84815c86-fbf6-4be2-a30a-d0a410fec962 admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:41.788582 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84815c86-fbf6-4be2-a30a-d0a410fec962 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:41.790798 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84815c86-fbf6-4be2-a30a-d0a410fec962 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:41.802454 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1313/2589] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:47:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:47:41.807302 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1037695-c16b-4149-8490-274f11e89935 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:41.817708 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1037695-c16b-4149-8490-274f11e89935 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:41.822502 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce7384-d89e-4664-9a6a-12dab53e7e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:41.823346 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce7384-d89e-4664-9a6a-12dab53e7e71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:41.823621 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce7384-d89e-4664-9a6a-12dab53e7e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:41.823892 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce7384-d89e-4664-9a6a-12dab53e7e71 admin admin] PATH_INFO: `/v3/projects/983c29ef5c384d1984a1eb0154943f43/users/5943eac753f543cca1f5db96e89d88a5/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:41.845533 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ce7384-d89e-4664-9a6a-12dab53e7e71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=983c29ef5c384d1984a1eb0154943f43, user_id=5943eac753f543cca1f5db96e89d88a5, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:41.848484 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ce7384-d89e-4664-9a6a-12dab53e7e71 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:41.958712 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1277/2590] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:47:41 2022] PUT /identity/v3/projects/983c29ef5c384d1984a1eb0154943f43/users/5943eac753f543cca1f5db96e89d88a5/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:47:41.959074 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ced72e-c38c-4950-b039-286c5b74eef8 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:41.959441 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ced72e-c38c-4950-b039-286c5b74eef8 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:41.959835 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ced72e-c38c-4950-b039-286c5b74eef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:41.961228 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce7384-d89e-4664-9a6a-12dab53e7e71 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:41.964941 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-57ce7384-d89e-4664-9a6a-12dab53e7e71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:42.006274 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-13ced72e-c38c-4950-b039-286c5b74eef8 None None] MFA Rules not processed for user `5943eac753f543cca1f5db96e89d88a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:47:42.008002 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-13ced72e-c38c-4950-b039-286c5b74eef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:42.137501 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1314/2591] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:47:41 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:47:42.143296 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce7384-d89e-4664-9a6a-12dab53e7e71 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:42.151617 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ced72e-c38c-4950-b039-286c5b74eef8 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:42.152981 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de54bd84-645d-4f00-ad4f-278bcede05a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bbebf16219943879df84bdc9a900516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:42.154200 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54bd84-645d-4f00-ad4f-278bcede05a0 service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:42.156405 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54bd84-645d-4f00-ad4f-278bcede05a0 service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:42.156405 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54bd84-645d-4f00-ad4f-278bcede05a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:42.158685 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-de54bd84-645d-4f00-ad4f-278bcede05a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:42.198708 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:42.227963 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:42.264251 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de54bd84-645d-4f00-ad4f-278bcede05a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:42.266308 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de54bd84-645d-4f00-ad4f-278bcede05a0 service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:42.293090 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1278/2592] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:47:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:47:42.364799 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ced72e-c38c-4950-b039-286c5b74eef8 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:42.375550 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c676c714-985d-4439-a31f-29f72f062cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:42.376360 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676c714-985d-4439-a31f-29f72f062cb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:42.376743 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676c714-985d-4439-a31f-29f72f062cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:42.377117 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676c714-985d-4439-a31f-29f72f062cb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:42.378053 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c676c714-985d-4439-a31f-29f72f062cb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:42.381824 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c676c714-985d-4439-a31f-29f72f062cb8 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:42.537835 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1315/2593] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:47:42 2022] POST /identity/v3/projects => generated 405 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:47:42.538668 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de54bd84-645d-4f00-ad4f-278bcede05a0 service nova] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:42.558789 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de54bd84-645d-4f00-ad4f-278bcede05a0 service nova] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:42.676340 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ce6d7-6958-4ce8-90fe-3fd224d5d01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:42.677805 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ce6d7-6958-4ce8-90fe-3fd224d5d01b admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:42.678393 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ce6d7-6958-4ce8-90fe-3fd224d5d01b admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:42.679181 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ce6d7-6958-4ce8-90fe-3fd224d5d01b admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:42.681435 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ce6d7-6958-4ce8-90fe-3fd224d5d01b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:42.684637 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ce6d7-6958-4ce8-90fe-3fd224d5d01b admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:42.804962 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1279/2594] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:47:42 2022] POST /identity/v3/users => generated 309 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:47:42.807074 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c676c714-985d-4439-a31f-29f72f062cb8 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:42.819637 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c676c714-985d-4439-a31f-29f72f062cb8 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:42.828475 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db791c-4fd4-4f6c-9952-294783a98945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:42.835951 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db791c-4fd4-4f6c-9952-294783a98945 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:42.835951 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db791c-4fd4-4f6c-9952-294783a98945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:42.835951 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db791c-4fd4-4f6c-9952-294783a98945 admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:42.837094 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1db791c-4fd4-4f6c-9952-294783a98945 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:42.838596 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1db791c-4fd4-4f6c-9952-294783a98945 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:42.851101 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1316/2595] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:47:42 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 10:47:42.856618 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ce6d7-6958-4ce8-90fe-3fd224d5d01b admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:42.873758 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ce6d7-6958-4ce8-90fe-3fd224d5d01b admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:42.880650 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6438f0-5995-431e-94a0-f9cfca1806b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:42.890051 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6438f0-5995-431e-94a0-f9cfca1806b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:42.891051 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6438f0-5995-431e-94a0-f9cfca1806b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:42.891404 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6438f0-5995-431e-94a0-f9cfca1806b5 admin admin] PATH_INFO: `/v3/projects/18cae7ca213147d3b642fd12b7f4929b/users/81911632edc846f9a7b6bea81c86327b/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:42.933102 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6438f0-5995-431e-94a0-f9cfca1806b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18cae7ca213147d3b642fd12b7f4929b, user_id=81911632edc846f9a7b6bea81c86327b, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:42.938420 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6438f0-5995-431e-94a0-f9cfca1806b5 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:43.058987 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1280/2596] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:47:42 2022] PUT /identity/v3/projects/18cae7ca213147d3b642fd12b7f4929b/users/81911632edc846f9a7b6bea81c86327b/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:47:43.060161 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db791c-4fd4-4f6c-9952-294783a98945 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:43.071994 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db791c-4fd4-4f6c-9952-294783a98945 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:43.189879 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7223698-079a-4092-9dba-bfae4e0872a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:43.191673 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7223698-079a-4092-9dba-bfae4e0872a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:43.191673 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7223698-079a-4092-9dba-bfae4e0872a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:43.191673 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7223698-079a-4092-9dba-bfae4e0872a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:43.192632 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7223698-079a-4092-9dba-bfae4e0872a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:43.194379 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7223698-079a-4092-9dba-bfae4e0872a7 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:43.210818 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1317/2597] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:47:43.223697 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6438f0-5995-431e-94a0-f9cfca1806b5 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:43.253251 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6438f0-5995-431e-94a0-f9cfca1806b5 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:43.263001 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b577e-7da1-4123-a4dc-82d08f6d50be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:43.264576 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b577e-7da1-4123-a4dc-82d08f6d50be admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:43.264763 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b577e-7da1-4123-a4dc-82d08f6d50be admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:43.266739 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b577e-7da1-4123-a4dc-82d08f6d50be admin admin] PATH_INFO: `/v3/projects/18cae7ca213147d3b642fd12b7f4929b/users/81911632edc846f9a7b6bea81c86327b/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:43.268522 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440b577e-7da1-4123-a4dc-82d08f6d50be admin admin] RBAC: Authorizing `identity:create_grant(project_id=18cae7ca213147d3b642fd12b7f4929b, user_id=81911632edc846f9a7b6bea81c86327b, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:43.272207 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440b577e-7da1-4123-a4dc-82d08f6d50be admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:43.293093 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1281/2598] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:47:43 2022] PUT /identity/v3/projects/18cae7ca213147d3b642fd12b7f4929b/users/81911632edc846f9a7b6bea81c86327b/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:47:43.301253 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce69292-044f-4e90-8f85-e28694fb9e41 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:43.301607 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce69292-044f-4e90-8f85-e28694fb9e41 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:43.301973 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce69292-044f-4e90-8f85-e28694fb9e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:43.355702 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-5ce69292-044f-4e90-8f85-e28694fb9e41 None None] MFA Rules not processed for user `81911632edc846f9a7b6bea81c86327b`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:47:43.365793 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-5ce69292-044f-4e90-8f85-e28694fb9e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:43.464423 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1318/2599] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:47:43 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:47:43.478472 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b577e-7da1-4123-a4dc-82d08f6d50be admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:43.480758 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-440b577e-7da1-4123-a4dc-82d08f6d50be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:43.591188 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b577e-7da1-4123-a4dc-82d08f6d50be admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:43.603811 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323084ee-a493-4f31-b7ae-014f5a156a6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:43.604576 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323084ee-a493-4f31-b7ae-014f5a156a6c service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:43.605233 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323084ee-a493-4f31-b7ae-014f5a156a6c service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:43.605519 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323084ee-a493-4f31-b7ae-014f5a156a6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:43.632437 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323084ee-a493-4f31-b7ae-014f5a156a6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:43.634867 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323084ee-a493-4f31-b7ae-014f5a156a6c service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:43.655887 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1282/2600] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:47:43 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:47:44.426762 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce69292-044f-4e90-8f85-e28694fb9e41 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:44.459721 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce69292-044f-4e90-8f85-e28694fb9e41 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:44.464843 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0087247c-0743-458e-b388-942bc474abc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:44.465634 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087247c-0743-458e-b388-942bc474abc1 service cinder] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:44.465976 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087247c-0743-458e-b388-942bc474abc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:44.466313 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087247c-0743-458e-b388-942bc474abc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:44.471664 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:44.549015 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0087247c-0743-458e-b388-942bc474abc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:44.550558 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0087247c-0743-458e-b388-942bc474abc1 service cinder] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:44.563057 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1319/2601] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:47:44 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:47:53.646289 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=91,keystone:INSERT=5 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:54.013030 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323084ee-a493-4f31-b7ae-014f5a156a6c service cinder] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:54.014898 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-323084ee-a493-4f31-b7ae-014f5a156a6c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:54.108410 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323084ee-a493-4f31-b7ae-014f5a156a6c service cinder] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:54.113531 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158bbaaa-d039-4426-ba7e-24ff376dcc96 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2330638e80a941cd9aeeb2fd615900d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:54.114182 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158bbaaa-d039-4426-ba7e-24ff376dcc96 service placement] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:54.114468 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158bbaaa-d039-4426-ba7e-24ff376dcc96 service placement] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:54.114745 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158bbaaa-d039-4426-ba7e-24ff376dcc96 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:54.116551 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-158bbaaa-d039-4426-ba7e-24ff376dcc96 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:54.129119 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158bbaaa-d039-4426-ba7e-24ff376dcc96 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:54.130781 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158bbaaa-d039-4426-ba7e-24ff376dcc96 service placement] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:54.141415 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1283/2602] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:47:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:47:54.253606 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0087247c-0743-458e-b388-942bc474abc1 service cinder] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:54.253606 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-0087247c-0743-458e-b388-942bc474abc1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:54.315003 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0087247c-0743-458e-b388-942bc474abc1 service cinder] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:54.319526 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a7559b-5150-4c29-9c52-13b6dd313824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:54.320392 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7559b-5150-4c29-9c52-13b6dd313824 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:54.321374 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7559b-5150-4c29-9c52-13b6dd313824 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:54.321650 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7559b-5150-4c29-9c52-13b6dd313824 admin admin] PATH_INFO: `/v3/users/1c2bb5fd02ae445e8cec51351b2770a4` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:54.322852 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a7559b-5150-4c29-9c52-13b6dd313824 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c2bb5fd02ae445e8cec51351b2770a4)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:54.324792 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a7559b-5150-4c29-9c52-13b6dd313824 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:54.716769 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158bbaaa-d039-4426-ba7e-24ff376dcc96 service placement] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:54.731350 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-14a7559b-5150-4c29-9c52-13b6dd313824 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c2bb5fd02ae445e8cec51351b2770a4'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:54.789963 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158bbaaa-d039-4426-ba7e-24ff376dcc96 service placement] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:54.795538 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6396915-66d8-4d78-a77e-42add4f5fb02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bbebf16219943879df84bdc9a900516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:54.796178 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6396915-66d8-4d78-a77e-42add4f5fb02 service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:54.796457 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6396915-66d8-4d78-a77e-42add4f5fb02 service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:54.796731 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6396915-66d8-4d78-a77e-42add4f5fb02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:54.798840 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-b6396915-66d8-4d78-a77e-42add4f5fb02 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:54.811669 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6396915-66d8-4d78-a77e-42add4f5fb02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:54.813241 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6396915-66d8-4d78-a77e-42add4f5fb02 service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:54.824289 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1284/2603] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:47:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:47:54.861789 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-14a7559b-5150-4c29-9c52-13b6dd313824 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c2bb5fd02ae445e8cec51351b2770a4'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:54.862423 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-14a7559b-5150-4c29-9c52-13b6dd313824 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c2bb5fd02ae445e8cec51351b2770a4'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:54.877157 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-14a7559b-5150-4c29-9c52-13b6dd313824 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c2bb5fd02ae445e8cec51351b2770a4'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:54.884319 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-14a7559b-5150-4c29-9c52-13b6dd313824 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c2bb5fd02ae445e8cec51351b2770a4'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:54.890640 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1320/2604] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:47:54 2022] DELETE /identity/v3/users/1c2bb5fd02ae445e8cec51351b2770a4 => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:47:55.300282 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6396915-66d8-4d78-a77e-42add4f5fb02 service nova] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:55.312580 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6396915-66d8-4d78-a77e-42add4f5fb02 service nova] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:55.376643 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1fab87-eb68-46ae-bfc0-00cf2356dc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:55.380550 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1fab87-eb68-46ae-bfc0-00cf2356dc57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:55.380550 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1fab87-eb68-46ae-bfc0-00cf2356dc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:55.380550 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1fab87-eb68-46ae-bfc0-00cf2356dc57 admin admin] PATH_INFO: `/v3/projects/84a71dacbe884c0b9021ad955ad5ff55` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:55.380550 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1fab87-eb68-46ae-bfc0-00cf2356dc57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84a71dacbe884c0b9021ad955ad5ff55)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:55.381183 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1fab87-eb68-46ae-bfc0-00cf2356dc57 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:55.401821 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:55.465871 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a7559b-5150-4c29-9c52-13b6dd313824 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:55.467500 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-14a7559b-5150-4c29-9c52-13b6dd313824 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:55.483254 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a7559b-5150-4c29-9c52-13b6dd313824 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:55.488564 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669ddb0-0819-4c58-9783-1b78e88e1783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:55.489642 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669ddb0-0819-4c58-9783-1b78e88e1783 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:55.490033 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669ddb0-0819-4c58-9783-1b78e88e1783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:55.490409 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669ddb0-0819-4c58-9783-1b78e88e1783 admin admin] PATH_INFO: `/v3/users/5943eac753f543cca1f5db96e89d88a5` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:55.491805 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5669ddb0-0819-4c58-9783-1b78e88e1783 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5943eac753f543cca1f5db96e89d88a5)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:55.494705 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5669ddb0-0819-4c58-9783-1b78e88e1783 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:55.518429 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:55.526915 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-bb1fab87-eb68-46ae-bfc0-00cf2356dc57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84a71dacbe884c0b9021ad955ad5ff55', 'request_id': 'req-bb1fab87-eb68-46ae-bfc0-00cf2356dc57'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:55.533252 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-bb1fab87-eb68-46ae-bfc0-00cf2356dc57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84a71dacbe884c0b9021ad955ad5ff55', 'request_id': 'req-bb1fab87-eb68-46ae-bfc0-00cf2356dc57'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:55.540998 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-bb1fab87-eb68-46ae-bfc0-00cf2356dc57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84a71dacbe884c0b9021ad955ad5ff55', 'request_id': 'req-bb1fab87-eb68-46ae-bfc0-00cf2356dc57'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:55.759847 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-bb1fab87-eb68-46ae-bfc0-00cf2356dc57 admin admin] The token cache is being invalidate because project 84a71dacbe884c0b9021ad955ad5ff55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:47:55.760426 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-bb1fab87-eb68-46ae-bfc0-00cf2356dc57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:55.771874 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-bb1fab87-eb68-46ae-bfc0-00cf2356dc57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:55.771874 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1285/2605] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:47:55 2022] DELETE /identity/v3/projects/84a71dacbe884c0b9021ad955ad5ff55 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:47:55.812962 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-5669ddb0-0819-4c58-9783-1b78e88e1783 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5943eac753f543cca1f5db96e89d88a5'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:55.941558 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-5669ddb0-0819-4c58-9783-1b78e88e1783 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5943eac753f543cca1f5db96e89d88a5'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:55.942421 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-5669ddb0-0819-4c58-9783-1b78e88e1783 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5943eac753f543cca1f5db96e89d88a5'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:55.965481 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-5669ddb0-0819-4c58-9783-1b78e88e1783 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5943eac753f543cca1f5db96e89d88a5'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:55.973465 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-5669ddb0-0819-4c58-9783-1b78e88e1783 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5943eac753f543cca1f5db96e89d88a5'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:55.980419 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1321/2606] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:47:55 2022] DELETE /identity/v3/users/5943eac753f543cca1f5db96e89d88a5 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:47:55.985005 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f5cf42-9063-4993-a3c9-e58d92e3b81f None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:55.985386 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f5cf42-9063-4993-a3c9-e58d92e3b81f None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:55.985728 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f5cf42-9063-4993-a3c9-e58d92e3b81f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:56.004174 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-e3f5cf42-9063-4993-a3c9-e58d92e3b81f None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:47:56.005434 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-e3f5cf42-9063-4993-a3c9-e58d92e3b81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:56.068283 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1286/2607] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:47:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:47:56.078561 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669ddb0-0819-4c58-9783-1b78e88e1783 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:56.080116 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-5669ddb0-0819-4c58-9783-1b78e88e1783 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:56.138520 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669ddb0-0819-4c58-9783-1b78e88e1783 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:56.142148 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9753815a-4125-47c4-8dac-85d2d093b786 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:56.142790 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9753815a-4125-47c4-8dac-85d2d093b786 service neutron] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:56.143071 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9753815a-4125-47c4-8dac-85d2d093b786 service neutron] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:56.143341 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9753815a-4125-47c4-8dac-85d2d093b786 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:56.153238 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9753815a-4125-47c4-8dac-85d2d093b786 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:56.154666 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9753815a-4125-47c4-8dac-85d2d093b786 service neutron] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:56.164429 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1322/2608] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:47:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:47:56.657286 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd971bb6-f7a4-4051-a058-48a503768d5d None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:56.657574 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd971bb6-f7a4-4051-a058-48a503768d5d None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:56.657851 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd971bb6-f7a4-4051-a058-48a503768d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:56.683382 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-bd971bb6-f7a4-4051-a058-48a503768d5d None None] MFA Rules not processed for user `88ad60446c5447a8bbd0096fa2133efb`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:47:56.684601 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-bd971bb6-f7a4-4051-a058-48a503768d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:56.738061 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9753815a-4125-47c4-8dac-85d2d093b786 service neutron] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:56.739645 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-9753815a-4125-47c4-8dac-85d2d093b786 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:56.742323 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1287/2609] 10.222.0.39 () {58 vars in 967 bytes} [Mon Jul 18 10:47:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:47:56.756536 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9753815a-4125-47c4-8dac-85d2d093b786 service neutron] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:56.758958 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd971bb6-f7a4-4051-a058-48a503768d5d None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:56.760627 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-bd971bb6-f7a4-4051-a058-48a503768d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:56.768153 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51b2492-e899-48e8-a2db-4f9e56dce407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:56.769223 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b2492-e899-48e8-a2db-4f9e56dce407 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:56.769333 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b2492-e899-48e8-a2db-4f9e56dce407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:56.769758 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b2492-e899-48e8-a2db-4f9e56dce407 admin admin] PATH_INFO: `/v3/projects/983c29ef5c384d1984a1eb0154943f43` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:56.770991 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51b2492-e899-48e8-a2db-4f9e56dce407 admin admin] RBAC: Authorizing `identity:delete_project(project_id=983c29ef5c384d1984a1eb0154943f43)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:56.772951 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51b2492-e899-48e8-a2db-4f9e56dce407 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:56.843272 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:56.869933 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd971bb6-f7a4-4051-a058-48a503768d5d None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:56.877224 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b196cd2-1e4a-4379-8915-27969facfa86 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c548474a8d94591ba58dd40e40a28d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:56.878747 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b196cd2-1e4a-4379-8915-27969facfa86 service swift] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:56.879035 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b196cd2-1e4a-4379-8915-27969facfa86 service swift] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:56.879315 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b196cd2-1e4a-4379-8915-27969facfa86 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:56.891174 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b196cd2-1e4a-4379-8915-27969facfa86 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:56.892966 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b196cd2-1e4a-4379-8915-27969facfa86 service swift] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:56.908033 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1288/2610] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Jul 18 10:47:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 18 10:47:56.964850 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-d51b2492-e899-48e8-a2db-4f9e56dce407 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '983c29ef5c384d1984a1eb0154943f43', 'request_id': 'req-d51b2492-e899-48e8-a2db-4f9e56dce407'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:56.978647 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-d51b2492-e899-48e8-a2db-4f9e56dce407 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '983c29ef5c384d1984a1eb0154943f43', 'request_id': 'req-d51b2492-e899-48e8-a2db-4f9e56dce407'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:56.986994 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-d51b2492-e899-48e8-a2db-4f9e56dce407 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '983c29ef5c384d1984a1eb0154943f43', 'request_id': 'req-d51b2492-e899-48e8-a2db-4f9e56dce407'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:57.199121 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-d51b2492-e899-48e8-a2db-4f9e56dce407 admin admin] The token cache is being invalidate because project 983c29ef5c384d1984a1eb0154943f43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80392) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:47:57.203882 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-d51b2492-e899-48e8-a2db-4f9e56dce407 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:57.203882 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-d51b2492-e899-48e8-a2db-4f9e56dce407 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:57.203882 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1323/2611] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:47:56 2022] DELETE /identity/v3/projects/983c29ef5c384d1984a1eb0154943f43 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:47:57.206054 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b196cd2-1e4a-4379-8915-27969facfa86 service swift] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:57.217315 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b196cd2-1e4a-4379-8915-27969facfa86 service swift] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:57.276819 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5dd86-4537-4e15-b791-8bc07cbf77e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:57.277728 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5dd86-4537-4e15-b791-8bc07cbf77e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:57.278022 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5dd86-4537-4e15-b791-8bc07cbf77e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:57.278321 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5dd86-4537-4e15-b791-8bc07cbf77e6 admin admin] PATH_INFO: `/v3/users/81911632edc846f9a7b6bea81c86327b` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:57.279602 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd5dd86-4537-4e15-b791-8bc07cbf77e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81911632edc846f9a7b6bea81c86327b)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:57.281648 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd5dd86-4537-4e15-b791-8bc07cbf77e6 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:57.646944 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-4fd5dd86-4537-4e15-b791-8bc07cbf77e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81911632edc846f9a7b6bea81c86327b'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:57.827445 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-4fd5dd86-4537-4e15-b791-8bc07cbf77e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81911632edc846f9a7b6bea81c86327b'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:57.828066 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-4fd5dd86-4537-4e15-b791-8bc07cbf77e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81911632edc846f9a7b6bea81c86327b'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:57.840443 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-4fd5dd86-4537-4e15-b791-8bc07cbf77e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81911632edc846f9a7b6bea81c86327b'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:57.847209 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-4fd5dd86-4537-4e15-b791-8bc07cbf77e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81911632edc846f9a7b6bea81c86327b'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:57.853145 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1289/2612] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:47:57 2022] DELETE /identity/v3/users/81911632edc846f9a7b6bea81c86327b => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:47:58.419085 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51b2492-e899-48e8-a2db-4f9e56dce407 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:58.422892 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-d51b2492-e899-48e8-a2db-4f9e56dce407 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:58.436255 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51b2492-e899-48e8-a2db-4f9e56dce407 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:58.456376 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:58.494468 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f4617-b4e4-4b84-98cb-a3a002ea5b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:58.495332 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f4617-b4e4-4b84-98cb-a3a002ea5b10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:58.495617 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f4617-b4e4-4b84-98cb-a3a002ea5b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:58.495894 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f4617-b4e4-4b84-98cb-a3a002ea5b10 admin admin] PATH_INFO: `/v3/projects/18cae7ca213147d3b642fd12b7f4929b` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:58.497103 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47f4617-b4e4-4b84-98cb-a3a002ea5b10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18cae7ca213147d3b642fd12b7f4929b)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:58.499007 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47f4617-b4e4-4b84-98cb-a3a002ea5b10 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:58.707216 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-e47f4617-b4e4-4b84-98cb-a3a002ea5b10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18cae7ca213147d3b642fd12b7f4929b', 'request_id': 'req-e47f4617-b4e4-4b84-98cb-a3a002ea5b10'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:58.713304 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-e47f4617-b4e4-4b84-98cb-a3a002ea5b10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18cae7ca213147d3b642fd12b7f4929b', 'request_id': 'req-e47f4617-b4e4-4b84-98cb-a3a002ea5b10'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:58.719559 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-e47f4617-b4e4-4b84-98cb-a3a002ea5b10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18cae7ca213147d3b642fd12b7f4929b', 'request_id': 'req-e47f4617-b4e4-4b84-98cb-a3a002ea5b10'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:58.902071 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-e47f4617-b4e4-4b84-98cb-a3a002ea5b10 admin admin] The token cache is being invalidate because project 18cae7ca213147d3b642fd12b7f4929b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80392) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:47:58.902364 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-e47f4617-b4e4-4b84-98cb-a3a002ea5b10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:58.902986 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-e47f4617-b4e4-4b84-98cb-a3a002ea5b10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:47:58.904541 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1324/2613] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:47:58 2022] DELETE /identity/v3/projects/18cae7ca213147d3b642fd12b7f4929b => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:47:58.909608 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bcb4ff-b252-42f8-b576-e152181d6a0e None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:58.914822 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bcb4ff-b252-42f8-b576-e152181d6a0e None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:58.914822 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bcb4ff-b252-42f8-b576-e152181d6a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:58.929859 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-47bcb4ff-b252-42f8-b576-e152181d6a0e None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:47:58.931084 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-47bcb4ff-b252-42f8-b576-e152181d6a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:58.987036 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:58.996888 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1290/2614] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:47:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:47:59.062232 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8943f10-b742-458a-aa35-b392f6fbacdd None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:59.062534 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8943f10-b742-458a-aa35-b392f6fbacdd None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:59.062814 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8943f10-b742-458a-aa35-b392f6fbacdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:59.081925 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-f8943f10-b742-458a-aa35-b392f6fbacdd None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:47:59.083437 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-f8943f10-b742-458a-aa35-b392f6fbacdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:59.092576 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1325/2615] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:47:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:47:59.097386 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bcb4ff-b252-42f8-b576-e152181d6a0e None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:59.107223 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bcb4ff-b252-42f8-b576-e152181d6a0e None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:59.111964 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ea9f4-a87a-4690-b18f-28dd356f5c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:59.112618 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ea9f4-a87a-4690-b18f-28dd356f5c51 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:59.112903 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ea9f4-a87a-4690-b18f-28dd356f5c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:59.113208 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ea9f4-a87a-4690-b18f-28dd356f5c51 admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:59.113931 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56ea9f4-a87a-4690-b18f-28dd356f5c51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:47:59.114233 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56ea9f4-a87a-4690-b18f-28dd356f5c51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:59.115800 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56ea9f4-a87a-4690-b18f-28dd356f5c51 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:59.128504 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1291/2616] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 10:47:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 10:47:59.132827 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8943f10-b742-458a-aa35-b392f6fbacdd None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:59.143291 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8943f10-b742-458a-aa35-b392f6fbacdd None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:59.147832 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b9ebf-4f3e-4ab4-b792-e71ddcee429a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:59.148526 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b9ebf-4f3e-4ab4-b792-e71ddcee429a admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:59.149530 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b9ebf-4f3e-4ab4-b792-e71ddcee429a admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:59.149883 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b9ebf-4f3e-4ab4-b792-e71ddcee429a admin admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:59.150677 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812b9ebf-4f3e-4ab4-b792-e71ddcee429a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:59.152568 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812b9ebf-4f3e-4ab4-b792-e71ddcee429a admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:59.275176 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1326/2617] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:47:59 2022] POST /identity/v3/projects => generated 379 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:47:59.279620 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ea9f4-a87a-4690-b18f-28dd356f5c51 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:59.289781 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ea9f4-a87a-4690-b18f-28dd356f5c51 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:59.353966 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c320615-4bb7-4a81-928a-5a1ef1bd2cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:59.354705 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c320615-4bb7-4a81-928a-5a1ef1bd2cfb admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:59.354991 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c320615-4bb7-4a81-928a-5a1ef1bd2cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:59.355274 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c320615-4bb7-4a81-928a-5a1ef1bd2cfb admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:59.355961 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c320615-4bb7-4a81-928a-5a1ef1bd2cfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:59.357912 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c320615-4bb7-4a81-928a-5a1ef1bd2cfb admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:59.554138 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1292/2618] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:47:59 2022] POST /identity/v3/users => generated 290 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:47:59.559225 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b9ebf-4f3e-4ab4-b792-e71ddcee429a admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:59.571214 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b9ebf-4f3e-4ab4-b792-e71ddcee429a admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:59.576360 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefa6193-8972-43ba-b0f4-1c22736c9ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:59.577064 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa6193-8972-43ba-b0f4-1c22736c9ef2 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:59.577356 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa6193-8972-43ba-b0f4-1c22736c9ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:59.577633 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa6193-8972-43ba-b0f4-1c22736c9ef2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:59.578368 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefa6193-8972-43ba-b0f4-1c22736c9ef2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:59.580929 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefa6193-8972-43ba-b0f4-1c22736c9ef2 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:59.591422 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1327/2619] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 10:47:59.595649 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c320615-4bb7-4a81-928a-5a1ef1bd2cfb admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:59.605641 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c320615-4bb7-4a81-928a-5a1ef1bd2cfb admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:59.610706 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec4049-0d32-452c-acff-47f38fbd816d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:59.611374 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec4049-0d32-452c-acff-47f38fbd816d admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:59.611659 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec4049-0d32-452c-acff-47f38fbd816d admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:59.611938 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec4049-0d32-452c-acff-47f38fbd816d admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:59.612666 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dec4049-0d32-452c-acff-47f38fbd816d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:59.614294 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dec4049-0d32-452c-acff-47f38fbd816d admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:59.628320 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1293/2620] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:47:59.629634 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefa6193-8972-43ba-b0f4-1c22736c9ef2 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:59.640655 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefa6193-8972-43ba-b0f4-1c22736c9ef2 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:59.645358 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cac374-9ee6-4070-8076-b20143d6aa03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:59.650070 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cac374-9ee6-4070-8076-b20143d6aa03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:59.650070 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cac374-9ee6-4070-8076-b20143d6aa03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:59.650070 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cac374-9ee6-4070-8076-b20143d6aa03 admin admin] PATH_INFO: `/v3/projects/6d92b2846bd348338c957fe14b093eaa/users/80a01d0e6df147bf8365f1598b0888ff/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:59.666035 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cac374-9ee6-4070-8076-b20143d6aa03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d92b2846bd348338c957fe14b093eaa, user_id=80a01d0e6df147bf8365f1598b0888ff, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:59.668723 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cac374-9ee6-4070-8076-b20143d6aa03 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:47:59.800419 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1328/2621] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:47:59 2022] PUT /identity/v3/projects/6d92b2846bd348338c957fe14b093eaa/users/80a01d0e6df147bf8365f1598b0888ff/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:47:59.811624 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec0a11-a2b5-4545-8231-de35aac51500 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:59.811920 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec0a11-a2b5-4545-8231-de35aac51500 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:59.812197 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec0a11-a2b5-4545-8231-de35aac51500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:59.842011 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-74ec0a11-a2b5-4545-8231-de35aac51500 None None] MFA Rules not processed for user `80a01d0e6df147bf8365f1598b0888ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:47:59.843230 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-74ec0a11-a2b5-4545-8231-de35aac51500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:47:59.908381 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1294/2622] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:47:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:47:59.912849 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cac374-9ee6-4070-8076-b20143d6aa03 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:47:59.977876 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cac374-9ee6-4070-8076-b20143d6aa03 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:47:59.982689 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdcdb05-ddb5-4a30-bafe-3f5405926137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:47:59.983353 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdcdb05-ddb5-4a30-bafe-3f5405926137 admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:47:59.983639 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdcdb05-ddb5-4a30-bafe-3f5405926137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:47:59.983925 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdcdb05-ddb5-4a30-bafe-3f5405926137 admin admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:47:59.984630 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdcdb05-ddb5-4a30-bafe-3f5405926137 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:47:59.987253 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdcdb05-ddb5-4a30-bafe-3f5405926137 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:00.132352 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1329/2623] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:47:59 2022] POST /identity/v3/projects => generated 379 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:48:00.136906 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ec0a11-a2b5-4545-8231-de35aac51500 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:00.148162 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ec0a11-a2b5-4545-8231-de35aac51500 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:00.204213 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e797b2-55bc-4da7-b0b1-3e23baa8d7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:00.204885 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e797b2-55bc-4da7-b0b1-3e23baa8d7a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:00.205211 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e797b2-55bc-4da7-b0b1-3e23baa8d7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:00.205501 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e797b2-55bc-4da7-b0b1-3e23baa8d7a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:00.206176 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e797b2-55bc-4da7-b0b1-3e23baa8d7a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:00.208083 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e797b2-55bc-4da7-b0b1-3e23baa8d7a6 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:00.312882 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1295/2624] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:48:00 2022] POST /identity/v3/users => generated 290 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:48:00.316825 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdcdb05-ddb5-4a30-bafe-3f5405926137 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:00.327883 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdcdb05-ddb5-4a30-bafe-3f5405926137 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:00.332818 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68fe30e-0434-4e55-9a46-c9e2eb796d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:00.333534 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68fe30e-0434-4e55-9a46-c9e2eb796d38 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:00.333819 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68fe30e-0434-4e55-9a46-c9e2eb796d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:00.334171 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68fe30e-0434-4e55-9a46-c9e2eb796d38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:00.334901 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68fe30e-0434-4e55-9a46-c9e2eb796d38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:00.337086 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68fe30e-0434-4e55-9a46-c9e2eb796d38 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:00.348245 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1330/2625] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:48:00.353201 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e797b2-55bc-4da7-b0b1-3e23baa8d7a6 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:00.363216 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e797b2-55bc-4da7-b0b1-3e23baa8d7a6 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:00.367977 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81791c9b-9cf5-49b5-9a7a-5f056614b58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:00.368637 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81791c9b-9cf5-49b5-9a7a-5f056614b58d admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:00.368918 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81791c9b-9cf5-49b5-9a7a-5f056614b58d admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:00.369229 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81791c9b-9cf5-49b5-9a7a-5f056614b58d admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:00.370013 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81791c9b-9cf5-49b5-9a7a-5f056614b58d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:00.371596 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81791c9b-9cf5-49b5-9a7a-5f056614b58d admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:00.382398 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1296/2626] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:48:00.386568 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68fe30e-0434-4e55-9a46-c9e2eb796d38 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:00.397217 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68fe30e-0434-4e55-9a46-c9e2eb796d38 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:00.405541 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6193d071-c2a2-43b8-8d04-685fa383ff4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:00.406440 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6193d071-c2a2-43b8-8d04-685fa383ff4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:00.406739 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6193d071-c2a2-43b8-8d04-685fa383ff4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:00.407013 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6193d071-c2a2-43b8-8d04-685fa383ff4a admin admin] PATH_INFO: `/v3/projects/ab8c86d7d709401a928e58e082cfa69e/users/70d1ee85495f46f4906eac365d262803/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:00.419497 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:00.425264 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6193d071-c2a2-43b8-8d04-685fa383ff4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab8c86d7d709401a928e58e082cfa69e, user_id=70d1ee85495f46f4906eac365d262803, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:00.427960 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6193d071-c2a2-43b8-8d04-685fa383ff4a admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:00.536692 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1331/2627] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:48:00 2022] PUT /identity/v3/projects/ab8c86d7d709401a928e58e082cfa69e/users/70d1ee85495f46f4906eac365d262803/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:48:00.547362 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf03d2-de21-4e9b-81dd-8d59485bd380 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:00.547944 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf03d2-de21-4e9b-81dd-8d59485bd380 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:00.548702 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf03d2-de21-4e9b-81dd-8d59485bd380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:00.551301 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:00.576787 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-ecbf03d2-de21-4e9b-81dd-8d59485bd380 None None] MFA Rules not processed for user `70d1ee85495f46f4906eac365d262803`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:48:00.578048 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-ecbf03d2-de21-4e9b-81dd-8d59485bd380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:00.641513 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1297/2628] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:48:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:48:00.646011 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6193d071-c2a2-43b8-8d04-685fa383ff4a admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:00.710403 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6193d071-c2a2-43b8-8d04-685fa383ff4a admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:00.716041 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dfc6cc-a45d-458f-b036-de75dd47e775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:00.716714 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dfc6cc-a45d-458f-b036-de75dd47e775 admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:00.717001 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dfc6cc-a45d-458f-b036-de75dd47e775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:00.717332 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dfc6cc-a45d-458f-b036-de75dd47e775 admin admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:00.718041 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dfc6cc-a45d-458f-b036-de75dd47e775 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:00.720029 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dfc6cc-a45d-458f-b036-de75dd47e775 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:00.858230 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1332/2629] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:48:00 2022] POST /identity/v3/projects => generated 379 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:48:00.862522 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf03d2-de21-4e9b-81dd-8d59485bd380 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:00.873812 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf03d2-de21-4e9b-81dd-8d59485bd380 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:00.932410 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef5a5ed-9b21-4dec-b41a-e1bc0e500ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:00.933017 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5a5ed-9b21-4dec-b41a-e1bc0e500ba8 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:00.933407 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5a5ed-9b21-4dec-b41a-e1bc0e500ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:00.933580 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5a5ed-9b21-4dec-b41a-e1bc0e500ba8 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:00.934270 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef5a5ed-9b21-4dec-b41a-e1bc0e500ba8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:00.941401 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef5a5ed-9b21-4dec-b41a-e1bc0e500ba8 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:01.096298 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1298/2630] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:48:00 2022] POST /identity/v3/users => generated 296 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:48:01.100209 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dfc6cc-a45d-458f-b036-de75dd47e775 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:01.111052 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dfc6cc-a45d-458f-b036-de75dd47e775 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:01.115712 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da328f79-fb3f-4c2e-a62a-0e93a3254b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:01.116397 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da328f79-fb3f-4c2e-a62a-0e93a3254b4a admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:01.116685 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da328f79-fb3f-4c2e-a62a-0e93a3254b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:01.116965 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da328f79-fb3f-4c2e-a62a-0e93a3254b4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:01.118302 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da328f79-fb3f-4c2e-a62a-0e93a3254b4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:01.119931 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da328f79-fb3f-4c2e-a62a-0e93a3254b4a admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:01.130823 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1333/2631] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 10:48:01.139129 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef5a5ed-9b21-4dec-b41a-e1bc0e500ba8 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:01.149557 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef5a5ed-9b21-4dec-b41a-e1bc0e500ba8 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:01.154534 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f83da-38c9-488b-a289-1537bb91cb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:01.155376 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f83da-38c9-488b-a289-1537bb91cb37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:01.155684 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f83da-38c9-488b-a289-1537bb91cb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:01.155964 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f83da-38c9-488b-a289-1537bb91cb37 admin admin] PATH_INFO: `/v3/projects/a6d10256486a4cf583eff0a4e30c7c00/users/a7eb405f5ddd4aeaa606d46ad0312aa4/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:01.172944 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3f83da-38c9-488b-a289-1537bb91cb37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6d10256486a4cf583eff0a4e30c7c00, user_id=a7eb405f5ddd4aeaa606d46ad0312aa4, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:01.176112 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3f83da-38c9-488b-a289-1537bb91cb37 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:01.268454 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1299/2632] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:48:01 2022] PUT /identity/v3/projects/a6d10256486a4cf583eff0a4e30c7c00/users/a7eb405f5ddd4aeaa606d46ad0312aa4/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:48:01.272457 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da328f79-fb3f-4c2e-a62a-0e93a3254b4a admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:01.282710 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da328f79-fb3f-4c2e-a62a-0e93a3254b4a admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:01.341055 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64298396-25ed-4a82-a321-5b37ecbd568b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:01.341747 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64298396-25ed-4a82-a321-5b37ecbd568b admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:01.342034 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64298396-25ed-4a82-a321-5b37ecbd568b admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:01.342315 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64298396-25ed-4a82-a321-5b37ecbd568b admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:01.343096 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64298396-25ed-4a82-a321-5b37ecbd568b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:01.344694 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64298396-25ed-4a82-a321-5b37ecbd568b admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:01.356316 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1334/2633] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:48:01.360192 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f83da-38c9-488b-a289-1537bb91cb37 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:01.371541 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f83da-38c9-488b-a289-1537bb91cb37 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:01.376790 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96390aa-f0f7-43b0-9f4c-d7bbc22aad63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:01.377710 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96390aa-f0f7-43b0-9f4c-d7bbc22aad63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:01.377992 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96390aa-f0f7-43b0-9f4c-d7bbc22aad63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:01.378273 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96390aa-f0f7-43b0-9f4c-d7bbc22aad63 admin admin] PATH_INFO: `/v3/projects/a6d10256486a4cf583eff0a4e30c7c00/users/a7eb405f5ddd4aeaa606d46ad0312aa4/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:01.380270 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96390aa-f0f7-43b0-9f4c-d7bbc22aad63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6d10256486a4cf583eff0a4e30c7c00, user_id=a7eb405f5ddd4aeaa606d46ad0312aa4, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:01.383003 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96390aa-f0f7-43b0-9f4c-d7bbc22aad63 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:01.393932 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1300/2634] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:48:01 2022] PUT /identity/v3/projects/a6d10256486a4cf583eff0a4e30c7c00/users/a7eb405f5ddd4aeaa606d46ad0312aa4/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:48:01.405778 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610d3cb-b4b8-41dc-8859-1788f8039881 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:01.406074 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610d3cb-b4b8-41dc-8859-1788f8039881 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:01.406358 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610d3cb-b4b8-41dc-8859-1788f8039881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:01.426728 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:01.436368 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-1610d3cb-b4b8-41dc-8859-1788f8039881 None None] MFA Rules not processed for user `a7eb405f5ddd4aeaa606d46ad0312aa4`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:48:01.437676 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-1610d3cb-b4b8-41dc-8859-1788f8039881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:01.511841 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1335/2635] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:48:01 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:48:01.523526 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96390aa-f0f7-43b0-9f4c-d7bbc22aad63 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:01.525502 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-d96390aa-f0f7-43b0-9f4c-d7bbc22aad63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:01.545151 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:01.586617 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96390aa-f0f7-43b0-9f4c-d7bbc22aad63 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:01.590338 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43679cb-3608-4e06-b3f6-a5b7fd213501 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:01.590984 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43679cb-3608-4e06-b3f6-a5b7fd213501 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:01.591266 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43679cb-3608-4e06-b3f6-a5b7fd213501 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:01.591710 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43679cb-3608-4e06-b3f6-a5b7fd213501 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:01.601231 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43679cb-3608-4e06-b3f6-a5b7fd213501 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:01.603510 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43679cb-3608-4e06-b3f6-a5b7fd213501 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:01.612740 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1301/2636] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:48:01 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:48:01.738471 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1610d3cb-b4b8-41dc-8859-1788f8039881 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:01.739850 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-1610d3cb-b4b8-41dc-8859-1788f8039881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:01.752144 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1610d3cb-b4b8-41dc-8859-1788f8039881 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:01.755679 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c29c7da-a890-426c-9e13-a85b2b794153 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:01.756310 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c29c7da-a890-426c-9e13-a85b2b794153 service cinder] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:01.756597 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c29c7da-a890-426c-9e13-a85b2b794153 service cinder] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:01.756871 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c29c7da-a890-426c-9e13-a85b2b794153 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:01.813017 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c29c7da-a890-426c-9e13-a85b2b794153 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:01.814480 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c29c7da-a890-426c-9e13-a85b2b794153 service cinder] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:01.823392 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1336/2637] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:48:01 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:48:06.585012 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43679cb-3608-4e06-b3f6-a5b7fd213501 service cinder] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:06.648781 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43679cb-3608-4e06-b3f6-a5b7fd213501 service cinder] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:06.653580 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f60c4c5-9979-43d5-8b29-a9ad10cf4eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:06.654447 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f60c4c5-9979-43d5-8b29-a9ad10cf4eea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:06.654718 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f60c4c5-9979-43d5-8b29-a9ad10cf4eea admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:06.654988 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f60c4c5-9979-43d5-8b29-a9ad10cf4eea admin admin] PATH_INFO: `/v3/users/80a01d0e6df147bf8365f1598b0888ff` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:06.656150 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f60c4c5-9979-43d5-8b29-a9ad10cf4eea admin admin] RBAC: Authorizing `identity:delete_user(user_id=80a01d0e6df147bf8365f1598b0888ff)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:06.658084 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f60c4c5-9979-43d5-8b29-a9ad10cf4eea admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:06.892421 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-0f60c4c5-9979-43d5-8b29-a9ad10cf4eea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80a01d0e6df147bf8365f1598b0888ff'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:06.964514 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-0f60c4c5-9979-43d5-8b29-a9ad10cf4eea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80a01d0e6df147bf8365f1598b0888ff'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:06.965281 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-0f60c4c5-9979-43d5-8b29-a9ad10cf4eea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80a01d0e6df147bf8365f1598b0888ff'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:06.979774 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-0f60c4c5-9979-43d5-8b29-a9ad10cf4eea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80a01d0e6df147bf8365f1598b0888ff'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:06.988179 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-0f60c4c5-9979-43d5-8b29-a9ad10cf4eea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80a01d0e6df147bf8365f1598b0888ff'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:06.995136 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1302/2638] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:48:06 2022] DELETE /identity/v3/users/80a01d0e6df147bf8365f1598b0888ff => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:48:06.999963 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50edb5-1009-403d-a59f-18fe9bd34dfb None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:07.000467 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50edb5-1009-403d-a59f-18fe9bd34dfb None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:07.000575 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50edb5-1009-403d-a59f-18fe9bd34dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:07.019010 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-fe50edb5-1009-403d-a59f-18fe9bd34dfb None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:48:07.020303 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-fe50edb5-1009-403d-a59f-18fe9bd34dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:07.115823 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1337/2639] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:48:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:48:07.126314 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f60c4c5-9979-43d5-8b29-a9ad10cf4eea admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:07.127708 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-0f60c4c5-9979-43d5-8b29-a9ad10cf4eea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:07.173699 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:07.189802 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f60c4c5-9979-43d5-8b29-a9ad10cf4eea admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:07.193702 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e4550-4cda-4d6c-b3ec-93f0e9aa0384 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:07.194379 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e4550-4cda-4d6c-b3ec-93f0e9aa0384 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:07.194663 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e4550-4cda-4d6c-b3ec-93f0e9aa0384 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:07.194942 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e4550-4cda-4d6c-b3ec-93f0e9aa0384 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:07.205626 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1e4550-4cda-4d6c-b3ec-93f0e9aa0384 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:07.207161 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1e4550-4cda-4d6c-b3ec-93f0e9aa0384 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:07.219038 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1303/2640] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:48:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:48:07.691822 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe50edb5-1009-403d-a59f-18fe9bd34dfb None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:07.696707 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-fe50edb5-1009-403d-a59f-18fe9bd34dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:07.706418 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe50edb5-1009-403d-a59f-18fe9bd34dfb None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:07.710983 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d669bc0-747f-4c38-87a5-f7688c1375ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:07.711915 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d669bc0-747f-4c38-87a5-f7688c1375ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:07.712220 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d669bc0-747f-4c38-87a5-f7688c1375ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:07.712610 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d669bc0-747f-4c38-87a5-f7688c1375ae admin admin] PATH_INFO: `/v3/projects/6d92b2846bd348338c957fe14b093eaa` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:07.713943 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d669bc0-747f-4c38-87a5-f7688c1375ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d92b2846bd348338c957fe14b093eaa)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:07.715963 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d669bc0-747f-4c38-87a5-f7688c1375ae admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:07.841511 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:07.857743 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-9d669bc0-747f-4c38-87a5-f7688c1375ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d92b2846bd348338c957fe14b093eaa', 'request_id': 'req-9d669bc0-747f-4c38-87a5-f7688c1375ae'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:07.862887 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-9d669bc0-747f-4c38-87a5-f7688c1375ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d92b2846bd348338c957fe14b093eaa', 'request_id': 'req-9d669bc0-747f-4c38-87a5-f7688c1375ae'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:07.870257 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-9d669bc0-747f-4c38-87a5-f7688c1375ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d92b2846bd348338c957fe14b093eaa', 'request_id': 'req-9d669bc0-747f-4c38-87a5-f7688c1375ae'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:07.964628 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-9d669bc0-747f-4c38-87a5-f7688c1375ae admin admin] The token cache is being invalidate because project 6d92b2846bd348338c957fe14b093eaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80392) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:48:07.964843 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-9d669bc0-747f-4c38-87a5-f7688c1375ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:07.965595 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-9d669bc0-747f-4c38-87a5-f7688c1375ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:07.967466 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1338/2641] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:48:07 2022] DELETE /identity/v3/projects/6d92b2846bd348338c957fe14b093eaa => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:48:07.971397 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e4550-4cda-4d6c-b3ec-93f0e9aa0384 service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:07.981775 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e4550-4cda-4d6c-b3ec-93f0e9aa0384 service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:08.039290 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7490fd-459f-479a-a841-322ede842a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:08.040719 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7490fd-459f-479a-a841-322ede842a34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:08.041027 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7490fd-459f-479a-a841-322ede842a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:08.041332 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7490fd-459f-479a-a841-322ede842a34 admin admin] PATH_INFO: `/v3/users/70d1ee85495f46f4906eac365d262803` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:08.042526 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7490fd-459f-479a-a841-322ede842a34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70d1ee85495f46f4906eac365d262803)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:08.044445 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7490fd-459f-479a-a841-322ede842a34 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:08.372872 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-8a7490fd-459f-479a-a841-322ede842a34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70d1ee85495f46f4906eac365d262803'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:08.495779 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-8a7490fd-459f-479a-a841-322ede842a34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70d1ee85495f46f4906eac365d262803'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:08.496407 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-8a7490fd-459f-479a-a841-322ede842a34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70d1ee85495f46f4906eac365d262803'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:08.509166 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-8a7490fd-459f-479a-a841-322ede842a34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70d1ee85495f46f4906eac365d262803'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:08.515948 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-8a7490fd-459f-479a-a841-322ede842a34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70d1ee85495f46f4906eac365d262803'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:08.522178 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1304/2642] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:48:07 2022] DELETE /identity/v3/users/70d1ee85495f46f4906eac365d262803 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:48:09.029983 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d669bc0-747f-4c38-87a5-f7688c1375ae admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:09.032031 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-9d669bc0-747f-4c38-87a5-f7688c1375ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:09.055709 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d669bc0-747f-4c38-87a5-f7688c1375ae admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:09.121678 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab5e89-ad09-422e-b569-3a657cc86fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:09.122557 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab5e89-ad09-422e-b569-3a657cc86fd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:09.122841 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab5e89-ad09-422e-b569-3a657cc86fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:09.123491 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab5e89-ad09-422e-b569-3a657cc86fd8 admin admin] PATH_INFO: `/v3/projects/ab8c86d7d709401a928e58e082cfa69e` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:09.124468 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab5e89-ad09-422e-b569-3a657cc86fd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab8c86d7d709401a928e58e082cfa69e)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:09.126458 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab5e89-ad09-422e-b569-3a657cc86fd8 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:09.251607 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-c9ab5e89-ad09-422e-b569-3a657cc86fd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab8c86d7d709401a928e58e082cfa69e', 'request_id': 'req-c9ab5e89-ad09-422e-b569-3a657cc86fd8'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:09.257347 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-c9ab5e89-ad09-422e-b569-3a657cc86fd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab8c86d7d709401a928e58e082cfa69e', 'request_id': 'req-c9ab5e89-ad09-422e-b569-3a657cc86fd8'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:09.264672 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-c9ab5e89-ad09-422e-b569-3a657cc86fd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab8c86d7d709401a928e58e082cfa69e', 'request_id': 'req-c9ab5e89-ad09-422e-b569-3a657cc86fd8'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:09.364777 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-c9ab5e89-ad09-422e-b569-3a657cc86fd8 admin admin] The token cache is being invalidate because project ab8c86d7d709401a928e58e082cfa69e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80392) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:48:09.364976 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-c9ab5e89-ad09-422e-b569-3a657cc86fd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:09.365765 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-c9ab5e89-ad09-422e-b569-3a657cc86fd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:09.367320 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1339/2643] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:48:09 2022] DELETE /identity/v3/projects/ab8c86d7d709401a928e58e082cfa69e => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:48:09.372002 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7490fd-459f-479a-a841-322ede842a34 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:09.373481 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-8a7490fd-459f-479a-a841-322ede842a34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:09.386781 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7490fd-459f-479a-a841-322ede842a34 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:09.445216 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c06eb91-68ed-4bd0-9656-df2c8596877f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:09.446397 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06eb91-68ed-4bd0-9656-df2c8596877f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:09.446703 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06eb91-68ed-4bd0-9656-df2c8596877f admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:09.447042 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06eb91-68ed-4bd0-9656-df2c8596877f admin admin] PATH_INFO: `/v3/users/a7eb405f5ddd4aeaa606d46ad0312aa4` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:09.448297 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c06eb91-68ed-4bd0-9656-df2c8596877f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7eb405f5ddd4aeaa606d46ad0312aa4)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:09.450236 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c06eb91-68ed-4bd0-9656-df2c8596877f admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:09.451819 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:09.693774 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-3c06eb91-68ed-4bd0-9656-df2c8596877f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7eb405f5ddd4aeaa606d46ad0312aa4'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:09.753048 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-3c06eb91-68ed-4bd0-9656-df2c8596877f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7eb405f5ddd4aeaa606d46ad0312aa4'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:09.753802 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-3c06eb91-68ed-4bd0-9656-df2c8596877f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7eb405f5ddd4aeaa606d46ad0312aa4'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:09.766663 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-3c06eb91-68ed-4bd0-9656-df2c8596877f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7eb405f5ddd4aeaa606d46ad0312aa4'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:09.773677 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-3c06eb91-68ed-4bd0-9656-df2c8596877f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7eb405f5ddd4aeaa606d46ad0312aa4'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:09.780091 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1305/2644] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:48:09 2022] DELETE /identity/v3/users/a7eb405f5ddd4aeaa606d46ad0312aa4 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:48:10.219664 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab5e89-ad09-422e-b569-3a657cc86fd8 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:10.221326 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-c9ab5e89-ad09-422e-b569-3a657cc86fd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:10.239610 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab5e89-ad09-422e-b569-3a657cc86fd8 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:10.299450 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:10.314185 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b96face-c81b-40cc-9d62-94c6305ecc01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:10.316827 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96face-c81b-40cc-9d62-94c6305ecc01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:10.317297 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96face-c81b-40cc-9d62-94c6305ecc01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:10.317733 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96face-c81b-40cc-9d62-94c6305ecc01 admin admin] PATH_INFO: `/v3/projects/a6d10256486a4cf583eff0a4e30c7c00` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:10.319058 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b96face-c81b-40cc-9d62-94c6305ecc01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6d10256486a4cf583eff0a4e30c7c00)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:10.321563 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b96face-c81b-40cc-9d62-94c6305ecc01 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:10.446755 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-5b96face-c81b-40cc-9d62-94c6305ecc01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6d10256486a4cf583eff0a4e30c7c00', 'request_id': 'req-5b96face-c81b-40cc-9d62-94c6305ecc01'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:10.453103 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-5b96face-c81b-40cc-9d62-94c6305ecc01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6d10256486a4cf583eff0a4e30c7c00', 'request_id': 'req-5b96face-c81b-40cc-9d62-94c6305ecc01'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:10.459929 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-5b96face-c81b-40cc-9d62-94c6305ecc01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6d10256486a4cf583eff0a4e30c7c00', 'request_id': 'req-5b96face-c81b-40cc-9d62-94c6305ecc01'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:10.627253 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-5b96face-c81b-40cc-9d62-94c6305ecc01 admin admin] The token cache is being invalidate because project a6d10256486a4cf583eff0a4e30c7c00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80392) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:48:10.627460 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-5b96face-c81b-40cc-9d62-94c6305ecc01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:10.628088 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-5b96face-c81b-40cc-9d62-94c6305ecc01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:10.629716 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1340/2645] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:48:10 2022] DELETE /identity/v3/projects/a6d10256486a4cf583eff0a4e30c7c00 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:48:10.638375 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e0a3d-3a5a-4aaf-b9a4-bf7a7f270db6 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:10.638873 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e0a3d-3a5a-4aaf-b9a4-bf7a7f270db6 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:10.638978 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e0a3d-3a5a-4aaf-b9a4-bf7a7f270db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:10.658621 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-008e0a3d-3a5a-4aaf-b9a4-bf7a7f270db6 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:48:10.660048 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-008e0a3d-3a5a-4aaf-b9a4-bf7a7f270db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:10.733287 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1306/2646] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:48:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:48:10.741977 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066cd7b-cd74-4e72-9a95-e711fad01fba None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:10.743192 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066cd7b-cd74-4e72-9a95-e711fad01fba None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:10.744013 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066cd7b-cd74-4e72-9a95-e711fad01fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:10.764459 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-3066cd7b-cd74-4e72-9a95-e711fad01fba None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:48:10.765748 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-3066cd7b-cd74-4e72-9a95-e711fad01fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:10.774011 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1341/2647] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:48:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:48:10.778298 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008e0a3d-3a5a-4aaf-b9a4-bf7a7f270db6 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:10.788761 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008e0a3d-3a5a-4aaf-b9a4-bf7a7f270db6 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:10.793781 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9ddfec-087f-48e4-a663-b54fc6be500d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:10.794444 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ddfec-087f-48e4-a663-b54fc6be500d admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:10.794725 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ddfec-087f-48e4-a663-b54fc6be500d admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:10.795000 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ddfec-087f-48e4-a663-b54fc6be500d admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:10.795729 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9ddfec-087f-48e4-a663-b54fc6be500d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:48:10.796037 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9ddfec-087f-48e4-a663-b54fc6be500d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:10.797675 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9ddfec-087f-48e4-a663-b54fc6be500d admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:10.810882 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1307/2648] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 10:48:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:48:10.815965 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066cd7b-cd74-4e72-9a95-e711fad01fba None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:10.826075 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066cd7b-cd74-4e72-9a95-e711fad01fba None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:10.830924 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53271339-6312-4d14-9f83-b20874060b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:10.831765 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53271339-6312-4d14-9f83-b20874060b06 admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:10.832050 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53271339-6312-4d14-9f83-b20874060b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:10.832323 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53271339-6312-4d14-9f83-b20874060b06 admin admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:10.833030 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53271339-6312-4d14-9f83-b20874060b06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:10.835111 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53271339-6312-4d14-9f83-b20874060b06 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:10.931976 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1342/2649] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:48:10 2022] POST /identity/v3/projects => generated 383 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:48:10.932177 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9ddfec-087f-48e4-a663-b54fc6be500d admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:10.943175 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9ddfec-087f-48e4-a663-b54fc6be500d admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:10.997683 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53271339-6312-4d14-9f83-b20874060b06 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:10.999408 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-53271339-6312-4d14-9f83-b20874060b06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:11.018850 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742c12b-e855-488b-8c71-7ba79ff66a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:11.019546 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742c12b-e855-488b-8c71-7ba79ff66a4a admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:11.019881 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742c12b-e855-488b-8c71-7ba79ff66a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:11.020225 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742c12b-e855-488b-8c71-7ba79ff66a4a admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:11.020913 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d742c12b-e855-488b-8c71-7ba79ff66a4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:11.022988 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d742c12b-e855-488b-8c71-7ba79ff66a4a admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:11.034599 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:11.097771 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53271339-6312-4d14-9f83-b20874060b06 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:11.105682 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e161f0d6-aafa-41cf-a0bd-e79d3e13beca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bbebf16219943879df84bdc9a900516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:11.107049 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161f0d6-aafa-41cf-a0bd-e79d3e13beca service nova] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:11.107658 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161f0d6-aafa-41cf-a0bd-e79d3e13beca service nova] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:11.108233 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e161f0d6-aafa-41cf-a0bd-e79d3e13beca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:11.110511 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-e161f0d6-aafa-41cf-a0bd-e79d3e13beca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:11.126437 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e161f0d6-aafa-41cf-a0bd-e79d3e13beca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:11.128349 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e161f0d6-aafa-41cf-a0bd-e79d3e13beca service nova] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:11.141612 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1343/2650] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:48:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:48:11.196279 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1308/2651] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:48:10 2022] POST /identity/v3/users => generated 292 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:48:11.198311 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e161f0d6-aafa-41cf-a0bd-e79d3e13beca service nova] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:11.213725 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e161f0d6-aafa-41cf-a0bd-e79d3e13beca service nova] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:11.220081 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c11d6-dc09-4e6c-a071-a6983a5122da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:11.220833 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c11d6-dc09-4e6c-a071-a6983a5122da admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:11.221160 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c11d6-dc09-4e6c-a071-a6983a5122da admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:11.221449 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c11d6-dc09-4e6c-a071-a6983a5122da admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:11.222195 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560c11d6-dc09-4e6c-a071-a6983a5122da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:11.224518 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560c11d6-dc09-4e6c-a071-a6983a5122da admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:11.237229 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1344/2652] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:48:11 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:48:11.241888 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742c12b-e855-488b-8c71-7ba79ff66a4a admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:11.256901 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742c12b-e855-488b-8c71-7ba79ff66a4a admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:11.262626 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54934a2d-3453-42d0-aff0-3f9b13a8f843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:11.263385 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54934a2d-3453-42d0-aff0-3f9b13a8f843 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:11.263739 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54934a2d-3453-42d0-aff0-3f9b13a8f843 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:11.264086 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54934a2d-3453-42d0-aff0-3f9b13a8f843 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:11.264915 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54934a2d-3453-42d0-aff0-3f9b13a8f843 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:11.266786 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54934a2d-3453-42d0-aff0-3f9b13a8f843 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:11.278989 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1309/2653] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:48:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 10:48:11.283417 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c11d6-dc09-4e6c-a071-a6983a5122da admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:11.309467 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c11d6-dc09-4e6c-a071-a6983a5122da admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:11.314281 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b0f03f-c6f1-4369-8024-cc2f105403c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:11.315199 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0f03f-c6f1-4369-8024-cc2f105403c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:11.315480 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0f03f-c6f1-4369-8024-cc2f105403c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:11.315754 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0f03f-c6f1-4369-8024-cc2f105403c8 admin admin] PATH_INFO: `/v3/projects/71bfca411eb247919cb96f32090af597/users/2f929341be564f9aad54b0b063cab288/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:11.332651 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b0f03f-c6f1-4369-8024-cc2f105403c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71bfca411eb247919cb96f32090af597, user_id=2f929341be564f9aad54b0b063cab288, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:11.335218 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b0f03f-c6f1-4369-8024-cc2f105403c8 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:11.486370 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:11.493779 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1345/2654] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:48:11 2022] PUT /identity/v3/projects/71bfca411eb247919cb96f32090af597/users/2f929341be564f9aad54b0b063cab288/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:48:11.500667 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421fad7-0dc5-4828-acee-d1c964d26097 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:11.500968 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421fad7-0dc5-4828-acee-d1c964d26097 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:11.501474 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421fad7-0dc5-4828-acee-d1c964d26097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:11.520170 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-d421fad7-0dc5-4828-acee-d1c964d26097 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:48:11.521397 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-d421fad7-0dc5-4828-acee-d1c964d26097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:11.583064 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1310/2655] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:48:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:48:11.593068 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b0f03f-c6f1-4369-8024-cc2f105403c8 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:11.595802 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-22b0f03f-c6f1-4369-8024-cc2f105403c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:11.654333 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b0f03f-c6f1-4369-8024-cc2f105403c8 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:11.658079 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b793b-fbfe-40a5-9f25-4de3708278c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:11.658731 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b793b-fbfe-40a5-9f25-4de3708278c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:11.659014 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b793b-fbfe-40a5-9f25-4de3708278c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:11.659293 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b793b-fbfe-40a5-9f25-4de3708278c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:11.670548 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168b793b-fbfe-40a5-9f25-4de3708278c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:11.672124 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168b793b-fbfe-40a5-9f25-4de3708278c6 service neutron] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:11.683059 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1346/2656] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:48:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:48:17.670887 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc1910-ae33-42d5-8e53-03f6c0f9e1f5 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:17.671424 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc1910-ae33-42d5-8e53-03f6c0f9e1f5 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:17.671424 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fc1910-ae33-42d5-8e53-03f6c0f9e1f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:17.708239 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-08fc1910-ae33-42d5-8e53-03f6c0f9e1f5 None None] MFA Rules not processed for user `2f929341be564f9aad54b0b063cab288`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:48:17.709741 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-08fc1910-ae33-42d5-8e53-03f6c0f9e1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:17.785129 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1311/2657] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:48:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:48:17.790663 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b793b-fbfe-40a5-9f25-4de3708278c6 service neutron] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:17.801200 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b793b-fbfe-40a5-9f25-4de3708278c6 service neutron] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:17.806231 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94458141-dd36-45fe-892d-e662ff30b8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:17.807077 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94458141-dd36-45fe-892d-e662ff30b8fc admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:17.808089 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94458141-dd36-45fe-892d-e662ff30b8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:17.808233 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94458141-dd36-45fe-892d-e662ff30b8fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:17.808887 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94458141-dd36-45fe-892d-e662ff30b8fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:17.810858 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94458141-dd36-45fe-892d-e662ff30b8fc admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:17.924296 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc1910-ae33-42d5-8e53-03f6c0f9e1f5 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:17.925792 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-08fc1910-ae33-42d5-8e53-03f6c0f9e1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:17.932441 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1347/2658] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:48:17 2022] POST /identity/v3/projects => generated 383 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:48:17.939310 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fc1910-ae33-42d5-8e53-03f6c0f9e1f5 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:17.951785 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94458141-dd36-45fe-892d-e662ff30b8fc admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:17.992634 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a311342-a141-4adc-a50d-8dae1c2f2316 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:17.993739 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a311342-a141-4adc-a50d-8dae1c2f2316 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:17.994122 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a311342-a141-4adc-a50d-8dae1c2f2316 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:17.994459 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a311342-a141-4adc-a50d-8dae1c2f2316 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:17.996489 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-6a311342-a141-4adc-a50d-8dae1c2f2316 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:18.025787 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94458141-dd36-45fe-892d-e662ff30b8fc admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:18.030696 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:18.031131 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e962c9-16f4-4708-a9a3-34a782b75f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:18.032008 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e962c9-16f4-4708-a9a3-34a782b75f12 admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:18.032297 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e962c9-16f4-4708-a9a3-34a782b75f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:18.032574 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e962c9-16f4-4708-a9a3-34a782b75f12 admin admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:18.033505 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e962c9-16f4-4708-a9a3-34a782b75f12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:18.035535 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e962c9-16f4-4708-a9a3-34a782b75f12 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:18.067864 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a311342-a141-4adc-a50d-8dae1c2f2316 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:18.069337 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a311342-a141-4adc-a50d-8dae1c2f2316 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:18.080395 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1312/2659] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:48:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:48:18.195316 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1348/2660] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:48:17 2022] POST /identity/v3/users => generated 298 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:48:18.204133 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a311342-a141-4adc-a50d-8dae1c2f2316 service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:18.212875 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a311342-a141-4adc-a50d-8dae1c2f2316 service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:18.218675 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691292a9-f284-41c3-be5c-f0a6348e6272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:18.220744 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691292a9-f284-41c3-be5c-f0a6348e6272 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:18.221006 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691292a9-f284-41c3-be5c-f0a6348e6272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:18.221327 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691292a9-f284-41c3-be5c-f0a6348e6272 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:18.223064 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691292a9-f284-41c3-be5c-f0a6348e6272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:18.224636 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691292a9-f284-41c3-be5c-f0a6348e6272 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:18.241704 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1313/2661] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:48:18 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:48:18.246695 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e962c9-16f4-4708-a9a3-34a782b75f12 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:18.266721 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e962c9-16f4-4708-a9a3-34a782b75f12 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:18.266721 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45d050d-d93e-4e6c-a838-1d021cf72035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:18.266721 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d050d-d93e-4e6c-a838-1d021cf72035 admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:18.266721 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d050d-d93e-4e6c-a838-1d021cf72035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:18.267123 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d050d-d93e-4e6c-a838-1d021cf72035 admin admin] PATH_INFO: `/v3/projects/7c71ba2938b5498a9f79f552eba2551c/users/76070a9ff0084d3abeb31c22b08efa6a/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:18.280933 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45d050d-d93e-4e6c-a838-1d021cf72035 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c71ba2938b5498a9f79f552eba2551c, user_id=76070a9ff0084d3abeb31c22b08efa6a, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:18.283650 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45d050d-d93e-4e6c-a838-1d021cf72035 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:18.428008 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1349/2662] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:48:18 2022] PUT /identity/v3/projects/7c71ba2938b5498a9f79f552eba2551c/users/76070a9ff0084d3abeb31c22b08efa6a/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:48:18.432518 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691292a9-f284-41c3-be5c-f0a6348e6272 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:18.442546 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691292a9-f284-41c3-be5c-f0a6348e6272 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:18.501681 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f0143-572c-4dc9-956d-80b64cddd4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:18.502363 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f0143-572c-4dc9-956d-80b64cddd4d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:18.502645 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f0143-572c-4dc9-956d-80b64cddd4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:18.502922 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f0143-572c-4dc9-956d-80b64cddd4d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:18.503650 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13f0143-572c-4dc9-956d-80b64cddd4d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:18.505269 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13f0143-572c-4dc9-956d-80b64cddd4d5 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:18.526202 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1314/2663] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:48:18 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:48:18.526421 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45d050d-d93e-4e6c-a838-1d021cf72035 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:18.534470 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45d050d-d93e-4e6c-a838-1d021cf72035 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:18.542778 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b911bc-00ce-4172-b470-0c92b1290552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:18.544359 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b911bc-00ce-4172-b470-0c92b1290552 admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:18.544866 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b911bc-00ce-4172-b470-0c92b1290552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:18.545424 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b911bc-00ce-4172-b470-0c92b1290552 admin admin] PATH_INFO: `/v3/projects/7c71ba2938b5498a9f79f552eba2551c/users/76070a9ff0084d3abeb31c22b08efa6a/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:18.549231 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b911bc-00ce-4172-b470-0c92b1290552 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c71ba2938b5498a9f79f552eba2551c, user_id=76070a9ff0084d3abeb31c22b08efa6a, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:18.554783 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b911bc-00ce-4172-b470-0c92b1290552 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:18.574408 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1350/2664] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:48:18 2022] PUT /identity/v3/projects/7c71ba2938b5498a9f79f552eba2551c/users/76070a9ff0084d3abeb31c22b08efa6a/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:48:23.736901 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f0143-572c-4dc9-956d-80b64cddd4d5 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:23.738928 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-e13f0143-572c-4dc9-956d-80b64cddd4d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:23.754635 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f0143-572c-4dc9-956d-80b64cddd4d5 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:23.839031 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503e4317-ea11-4f4d-8dca-711746abde0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:23.839930 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e4317-ea11-4f4d-8dca-711746abde0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:23.840327 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e4317-ea11-4f4d-8dca-711746abde0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:23.840525 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e4317-ea11-4f4d-8dca-711746abde0b admin admin] PATH_INFO: `/v3/users/f94ab499b0c8447c9e9e4165b342757b` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:23.841793 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503e4317-ea11-4f4d-8dca-711746abde0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f94ab499b0c8447c9e9e4165b342757b)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:23.843902 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503e4317-ea11-4f4d-8dca-711746abde0b admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:24.141771 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-503e4317-ea11-4f4d-8dca-711746abde0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f94ab499b0c8447c9e9e4165b342757b'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:24.145761 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:24.272774 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-503e4317-ea11-4f4d-8dca-711746abde0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f94ab499b0c8447c9e9e4165b342757b'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:24.274158 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-503e4317-ea11-4f4d-8dca-711746abde0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f94ab499b0c8447c9e9e4165b342757b'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:24.290416 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-503e4317-ea11-4f4d-8dca-711746abde0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f94ab499b0c8447c9e9e4165b342757b'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:24.299656 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-503e4317-ea11-4f4d-8dca-711746abde0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f94ab499b0c8447c9e9e4165b342757b'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:24.307126 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1315/2665] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:48:23 2022] DELETE /identity/v3/users/f94ab499b0c8447c9e9e4165b342757b => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:48:24.666443 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b911bc-00ce-4172-b470-0c92b1290552 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:24.666443 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-61b911bc-00ce-4172-b470-0c92b1290552 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:24.683661 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b911bc-00ce-4172-b470-0c92b1290552 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:24.720375 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:24.772347 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355d4237-8f3e-42e1-b48e-d13f1474b623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:24.773835 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d4237-8f3e-42e1-b48e-d13f1474b623 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:24.774358 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d4237-8f3e-42e1-b48e-d13f1474b623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:24.775011 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d4237-8f3e-42e1-b48e-d13f1474b623 admin admin] PATH_INFO: `/v3/projects/4e847ee4adc14bdf90f671c448f5895c` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:24.777550 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355d4237-8f3e-42e1-b48e-d13f1474b623 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e847ee4adc14bdf90f671c448f5895c)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:24.781090 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355d4237-8f3e-42e1-b48e-d13f1474b623 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:25.006569 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-355d4237-8f3e-42e1-b48e-d13f1474b623 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e847ee4adc14bdf90f671c448f5895c', 'request_id': 'req-355d4237-8f3e-42e1-b48e-d13f1474b623'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:25.019847 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-355d4237-8f3e-42e1-b48e-d13f1474b623 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e847ee4adc14bdf90f671c448f5895c', 'request_id': 'req-355d4237-8f3e-42e1-b48e-d13f1474b623'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:25.039195 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-355d4237-8f3e-42e1-b48e-d13f1474b623 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e847ee4adc14bdf90f671c448f5895c', 'request_id': 'req-355d4237-8f3e-42e1-b48e-d13f1474b623'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:25.165738 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-355d4237-8f3e-42e1-b48e-d13f1474b623 admin admin] The token cache is being invalidate because project 4e847ee4adc14bdf90f671c448f5895c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80392) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:48:25.175116 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-355d4237-8f3e-42e1-b48e-d13f1474b623 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:25.175116 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-355d4237-8f3e-42e1-b48e-d13f1474b623 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:25.175116 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1351/2666] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:48:24 2022] DELETE /identity/v3/projects/4e847ee4adc14bdf90f671c448f5895c => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:48:25.175411 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a8ad5-ffa1-435a-b31b-1fe64ed3091d None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:25.175828 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a8ad5-ffa1-435a-b31b-1fe64ed3091d None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:25.175828 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a8ad5-ffa1-435a-b31b-1fe64ed3091d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:25.200968 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-af1a8ad5-ffa1-435a-b31b-1fe64ed3091d None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:48:25.203897 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-af1a8ad5-ffa1-435a-b31b-1fe64ed3091d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:25.279717 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1316/2667] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:48:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:48:25.287731 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082a56c-93c0-48ef-9b8f-2d12d070e0b1 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:25.288208 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082a56c-93c0-48ef-9b8f-2d12d070e0b1 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:25.288586 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082a56c-93c0-48ef-9b8f-2d12d070e0b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:25.310754 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-6082a56c-93c0-48ef-9b8f-2d12d070e0b1 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:48:25.312056 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-6082a56c-93c0-48ef-9b8f-2d12d070e0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:25.326061 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1352/2668] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:48:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:48:25.330919 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1a8ad5-ffa1-435a-b31b-1fe64ed3091d None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:25.344742 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1a8ad5-ffa1-435a-b31b-1fe64ed3091d None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:25.347189 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2af41d-2f38-40d9-8b24-1ba7176395c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:25.347859 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2af41d-2f38-40d9-8b24-1ba7176395c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:25.348142 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2af41d-2f38-40d9-8b24-1ba7176395c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:25.348415 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2af41d-2f38-40d9-8b24-1ba7176395c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:25.349173 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2af41d-2f38-40d9-8b24-1ba7176395c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:48:25.349482 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2af41d-2f38-40d9-8b24-1ba7176395c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:25.351074 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2af41d-2f38-40d9-8b24-1ba7176395c3 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:25.367666 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1317/2669] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 10:48:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:48:25.369354 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6082a56c-93c0-48ef-9b8f-2d12d070e0b1 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:25.380637 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6082a56c-93c0-48ef-9b8f-2d12d070e0b1 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:25.386168 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d76544a-caf2-4240-80d9-752ecd32f56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:25.386902 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d76544a-caf2-4240-80d9-752ecd32f56f admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:25.387195 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d76544a-caf2-4240-80d9-752ecd32f56f admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:25.387501 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d76544a-caf2-4240-80d9-752ecd32f56f admin admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:25.388289 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d76544a-caf2-4240-80d9-752ecd32f56f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:25.390647 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d76544a-caf2-4240-80d9-752ecd32f56f admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:25.537485 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1353/2670] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:48:25 2022] POST /identity/v3/projects => generated 385 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:48:25.538972 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2af41d-2f38-40d9-8b24-1ba7176395c3 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:25.550497 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2af41d-2f38-40d9-8b24-1ba7176395c3 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:25.635347 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f55e270-07e8-433f-b63a-815fc968b48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:25.636074 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55e270-07e8-433f-b63a-815fc968b48a admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:25.637920 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55e270-07e8-433f-b63a-815fc968b48a admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:25.645675 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55e270-07e8-433f-b63a-815fc968b48a admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:25.645675 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f55e270-07e8-433f-b63a-815fc968b48a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:25.645675 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f55e270-07e8-433f-b63a-815fc968b48a admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:25.817955 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1318/2671] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:48:25 2022] POST /identity/v3/users => generated 293 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:48:25.822500 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d76544a-caf2-4240-80d9-752ecd32f56f admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:25.834028 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d76544a-caf2-4240-80d9-752ecd32f56f admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:25.839884 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b05be-57bb-4fc5-a644-63ca2c68f30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:25.840601 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b05be-57bb-4fc5-a644-63ca2c68f30c admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:25.840963 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b05be-57bb-4fc5-a644-63ca2c68f30c admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:25.841365 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b05be-57bb-4fc5-a644-63ca2c68f30c admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:25.842175 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07b05be-57bb-4fc5-a644-63ca2c68f30c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:25.843861 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07b05be-57bb-4fc5-a644-63ca2c68f30c admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:25.859470 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1354/2672] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:48:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:48:25.861030 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f55e270-07e8-433f-b63a-815fc968b48a admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:25.872772 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f55e270-07e8-433f-b63a-815fc968b48a admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:25.878454 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fa408a-b91a-48ad-af6d-03035c41194d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:25.878627 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa408a-b91a-48ad-af6d-03035c41194d admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:25.878915 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa408a-b91a-48ad-af6d-03035c41194d admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:25.879194 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa408a-b91a-48ad-af6d-03035c41194d admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:25.879923 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fa408a-b91a-48ad-af6d-03035c41194d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:25.881568 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fa408a-b91a-48ad-af6d-03035c41194d admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:25.900292 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1319/2673] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:48:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:48:25.904573 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b05be-57bb-4fc5-a644-63ca2c68f30c admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:25.922252 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b05be-57bb-4fc5-a644-63ca2c68f30c admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:25.928453 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa3b8a-2d8d-404c-8845-3fef398c9aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:25.929433 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa3b8a-2d8d-404c-8845-3fef398c9aaf admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:25.930397 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa3b8a-2d8d-404c-8845-3fef398c9aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:25.930794 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa3b8a-2d8d-404c-8845-3fef398c9aaf admin admin] PATH_INFO: `/v3/projects/1636e286cab74f189f57e10f730a379e/users/3288eb1237b34763ac85f851863dc5e0/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:25.950130 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaa3b8a-2d8d-404c-8845-3fef398c9aaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=1636e286cab74f189f57e10f730a379e, user_id=3288eb1237b34763ac85f851863dc5e0, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:25.953011 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaa3b8a-2d8d-404c-8845-3fef398c9aaf admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:26.060921 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1355/2674] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:48:25 2022] PUT /identity/v3/projects/1636e286cab74f189f57e10f730a379e/users/3288eb1237b34763ac85f851863dc5e0/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:48:26.065939 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5c83c-754b-461d-aae5-d3f19abe31b7 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:26.066222 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5c83c-754b-461d-aae5-d3f19abe31b7 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:26.066519 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5c83c-754b-461d-aae5-d3f19abe31b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:26.096296 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-9cd5c83c-754b-461d-aae5-d3f19abe31b7 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:48:26.098520 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-9cd5c83c-754b-461d-aae5-d3f19abe31b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:26.151261 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:26.153025 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f12ba5-01fd-4d1e-b469-0be1194a8359 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:26.154074 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f12ba5-01fd-4d1e-b469-0be1194a8359 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:26.154074 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f12ba5-01fd-4d1e-b469-0be1194a8359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:26.177604 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1320/2675] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:48:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:48:26.187672 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5c83c-754b-461d-aae5-d3f19abe31b7 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:26.188404 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-16f12ba5-01fd-4d1e-b469-0be1194a8359 None None] MFA Rules not processed for user `76070a9ff0084d3abeb31c22b08efa6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:48:26.189118 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-9cd5c83c-754b-461d-aae5-d3f19abe31b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:26.189894 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-16f12ba5-01fd-4d1e-b469-0be1194a8359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:26.250196 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:26.275946 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1356/2676] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:48:26 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:48:26.282637 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5c83c-754b-461d-aae5-d3f19abe31b7 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:26.282637 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe821cc-498c-49d9-a36e-44c6ddf30837 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:26.282637 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe821cc-498c-49d9-a36e-44c6ddf30837 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:26.284271 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe821cc-498c-49d9-a36e-44c6ddf30837 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:26.284271 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe821cc-498c-49d9-a36e-44c6ddf30837 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:26.290082 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f12ba5-01fd-4d1e-b469-0be1194a8359 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:26.291452 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-16f12ba5-01fd-4d1e-b469-0be1194a8359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:26.294961 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe821cc-498c-49d9-a36e-44c6ddf30837 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:26.296393 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe821cc-498c-49d9-a36e-44c6ddf30837 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:26.309932 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1321/2677] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:48:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:48:26.366558 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f12ba5-01fd-4d1e-b469-0be1194a8359 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:26.403061 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d8d65-37f2-423a-b54c-47dccbe8fd9d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48d1f7d0286745a396905aee50c9410b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:26.403061 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d8d65-37f2-423a-b54c-47dccbe8fd9d service glance] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:26.403061 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d8d65-37f2-423a-b54c-47dccbe8fd9d service glance] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:26.403061 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333d8d65-37f2-423a-b54c-47dccbe8fd9d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:26.403475 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-333d8d65-37f2-423a-b54c-47dccbe8fd9d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:26.434083 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333d8d65-37f2-423a-b54c-47dccbe8fd9d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:26.435517 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333d8d65-37f2-423a-b54c-47dccbe8fd9d service glance] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:26.444520 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1357/2678] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:48:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:48:26.840585 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2f7bc-7925-404d-a8d6-63822a0fc12c None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:26.840881 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2f7bc-7925-404d-a8d6-63822a0fc12c None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:26.841200 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2f7bc-7925-404d-a8d6-63822a0fc12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:26.859824 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-36a2f7bc-7925-404d-a8d6-63822a0fc12c None None] MFA Rules not processed for user `88ad60446c5447a8bbd0096fa2133efb`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:48:26.861221 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-36a2f7bc-7925-404d-a8d6-63822a0fc12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:26.937345 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1322/2679] 10.222.0.39 () {58 vars in 1009 bytes} [Mon Jul 18 10:48:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:48:26.961901 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d8d65-37f2-423a-b54c-47dccbe8fd9d service glance] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:26.969734 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-333d8d65-37f2-423a-b54c-47dccbe8fd9d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:27.034611 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333d8d65-37f2-423a-b54c-47dccbe8fd9d service glance] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:27.040266 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da08464d-93e5-4c00-8d00-0ac4bb1b8e23 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c548474a8d94591ba58dd40e40a28d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:27.040930 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da08464d-93e5-4c00-8d00-0ac4bb1b8e23 service swift] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:27.041258 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da08464d-93e5-4c00-8d00-0ac4bb1b8e23 service swift] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:27.041541 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da08464d-93e5-4c00-8d00-0ac4bb1b8e23 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:27.050781 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da08464d-93e5-4c00-8d00-0ac4bb1b8e23 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:27.052404 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da08464d-93e5-4c00-8d00-0ac4bb1b8e23 service swift] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:27.063287 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1358/2680] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Jul 18 10:48:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 10:48:36.409949 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2561fe3-3191-4f16-a773-b14ee936809a None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:36.410530 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2561fe3-3191-4f16-a773-b14ee936809a None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:36.410530 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2561fe3-3191-4f16-a773-b14ee936809a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:36.447665 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-d2561fe3-3191-4f16-a773-b14ee936809a None None] MFA Rules not processed for user `3288eb1237b34763ac85f851863dc5e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:48:36.451334 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-d2561fe3-3191-4f16-a773-b14ee936809a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:36.536954 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1323/2681] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:48:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:48:36.557013 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da08464d-93e5-4c00-8d00-0ac4bb1b8e23 service swift] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:36.558652 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-da08464d-93e5-4c00-8d00-0ac4bb1b8e23 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:36.600763 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:36.651563 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da08464d-93e5-4c00-8d00-0ac4bb1b8e23 service swift] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:36.654761 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e1816c-b555-4430-8b8b-6b569fedc80a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bbebf16219943879df84bdc9a900516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:36.655434 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e1816c-b555-4430-8b8b-6b569fedc80a service nova] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:36.655725 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e1816c-b555-4430-8b8b-6b569fedc80a service nova] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:36.656162 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e1816c-b555-4430-8b8b-6b569fedc80a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:36.668541 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e1816c-b555-4430-8b8b-6b569fedc80a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:36.674016 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e1816c-b555-4430-8b8b-6b569fedc80a service nova] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:36.696675 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1359/2682] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:48:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:48:40.673564 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2561fe3-3191-4f16-a773-b14ee936809a None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:40.675233 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-d2561fe3-3191-4f16-a773-b14ee936809a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:40.688380 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2561fe3-3191-4f16-a773-b14ee936809a None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:40.692264 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ef9787-e2b5-477e-8333-c7ff2e541c66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:40.693254 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef9787-e2b5-477e-8333-c7ff2e541c66 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:40.693618 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef9787-e2b5-477e-8333-c7ff2e541c66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:40.693968 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef9787-e2b5-477e-8333-c7ff2e541c66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:40.697410 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-64ef9787-e2b5-477e-8333-c7ff2e541c66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:40.715866 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ef9787-e2b5-477e-8333-c7ff2e541c66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:40.718509 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ef9787-e2b5-477e-8333-c7ff2e541c66 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:40.724650 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:40.731715 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1324/2683] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:48:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:48:41.019132 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce5246-9b02-4f48-8885-f38b21b48bcd None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:41.019705 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce5246-9b02-4f48-8885-f38b21b48bcd None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:41.019705 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce5246-9b02-4f48-8885-f38b21b48bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:41.043935 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-ebce5246-9b02-4f48-8885-f38b21b48bcd None None] MFA Rules not processed for user `3288eb1237b34763ac85f851863dc5e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:48:41.045520 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-ebce5246-9b02-4f48-8885-f38b21b48bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:41.057417 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1360/2684] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:48:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:48:41.654462 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ef9787-e2b5-477e-8333-c7ff2e541c66 service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:41.665204 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ef9787-e2b5-477e-8333-c7ff2e541c66 service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:41.670580 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04853111-8253-41b0-826b-a3fee95965d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:41.671272 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04853111-8253-41b0-826b-a3fee95965d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:41.671919 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04853111-8253-41b0-826b-a3fee95965d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:41.671919 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04853111-8253-41b0-826b-a3fee95965d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:41.674038 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-04853111-8253-41b0-826b-a3fee95965d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:41.688049 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04853111-8253-41b0-826b-a3fee95965d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:41.689808 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04853111-8253-41b0-826b-a3fee95965d9 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:41.699612 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1325/2685] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:48:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:48:42.254084 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06a420-a1d7-4d93-9568-1baffc95835c None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:42.254649 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06a420-a1d7-4d93-9568-1baffc95835c None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:42.254649 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06a420-a1d7-4d93-9568-1baffc95835c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:42.297357 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-fa06a420-a1d7-4d93-9568-1baffc95835c None None] MFA Rules not processed for user `2f929341be564f9aad54b0b063cab288`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:48:42.299307 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-fa06a420-a1d7-4d93-9568-1baffc95835c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:42.313189 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1361/2686] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:48:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:48:46.381188 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04853111-8253-41b0-826b-a3fee95965d9 service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:46.382839 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-04853111-8253-41b0-826b-a3fee95965d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:46.401634 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04853111-8253-41b0-826b-a3fee95965d9 service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:46.406189 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f88f04-d5be-4668-8071-f4a1aacce892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:46.407058 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f88f04-d5be-4668-8071-f4a1aacce892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:46.407342 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f88f04-d5be-4668-8071-f4a1aacce892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:46.407617 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f88f04-d5be-4668-8071-f4a1aacce892 admin admin] PATH_INFO: `/v3/users/b336af28da0742f5a66df010b8f5176a` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:46.408851 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f88f04-d5be-4668-8071-f4a1aacce892 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b336af28da0742f5a66df010b8f5176a)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:46.410811 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f88f04-d5be-4668-8071-f4a1aacce892 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:46.681696 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-28f88f04-d5be-4668-8071-f4a1aacce892 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b336af28da0742f5a66df010b8f5176a'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:46.986530 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-28f88f04-d5be-4668-8071-f4a1aacce892 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b336af28da0742f5a66df010b8f5176a'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:46.987538 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-28f88f04-d5be-4668-8071-f4a1aacce892 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b336af28da0742f5a66df010b8f5176a'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:47.023218 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-28f88f04-d5be-4668-8071-f4a1aacce892 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b336af28da0742f5a66df010b8f5176a'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:47.032307 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-28f88f04-d5be-4668-8071-f4a1aacce892 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b336af28da0742f5a66df010b8f5176a'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:47.048303 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1326/2687] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:48:46 2022] DELETE /identity/v3/users/b336af28da0742f5a66df010b8f5176a => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:48:47.600263 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa06a420-a1d7-4d93-9568-1baffc95835c None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:47.629145 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa06a420-a1d7-4d93-9568-1baffc95835c None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:47.717562 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3e47b-f0be-4a0c-9cbe-e72abc781e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:47.718428 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3e47b-f0be-4a0c-9cbe-e72abc781e5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:47.718710 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3e47b-f0be-4a0c-9cbe-e72abc781e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:47.718982 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3e47b-f0be-4a0c-9cbe-e72abc781e5c admin admin] PATH_INFO: `/v3/projects/8487c0ae2e1f471292034b079218bb81` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:47.720169 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed3e47b-f0be-4a0c-9cbe-e72abc781e5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8487c0ae2e1f471292034b079218bb81)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:47.722235 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed3e47b-f0be-4a0c-9cbe-e72abc781e5c admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:48.034072 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-8ed3e47b-f0be-4a0c-9cbe-e72abc781e5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8487c0ae2e1f471292034b079218bb81', 'request_id': 'req-8ed3e47b-f0be-4a0c-9cbe-e72abc781e5c'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:48.037397 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-8ed3e47b-f0be-4a0c-9cbe-e72abc781e5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8487c0ae2e1f471292034b079218bb81', 'request_id': 'req-8ed3e47b-f0be-4a0c-9cbe-e72abc781e5c'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:48.044917 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-8ed3e47b-f0be-4a0c-9cbe-e72abc781e5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8487c0ae2e1f471292034b079218bb81', 'request_id': 'req-8ed3e47b-f0be-4a0c-9cbe-e72abc781e5c'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:48.206308 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-8ed3e47b-f0be-4a0c-9cbe-e72abc781e5c admin admin] The token cache is being invalidate because project 8487c0ae2e1f471292034b079218bb81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80392) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:48:48.206308 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-8ed3e47b-f0be-4a0c-9cbe-e72abc781e5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:48.206308 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-8ed3e47b-f0be-4a0c-9cbe-e72abc781e5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:48.206308 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1362/2688] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:48:47 2022] DELETE /identity/v3/projects/8487c0ae2e1f471292034b079218bb81 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:48:48.212792 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe53a76-2536-4dbd-8f39-5238b8bd97c0 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:48.215104 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe53a76-2536-4dbd-8f39-5238b8bd97c0 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:48.215650 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe53a76-2536-4dbd-8f39-5238b8bd97c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:48.251730 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-abe53a76-2536-4dbd-8f39-5238b8bd97c0 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:48:48.253400 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-abe53a76-2536-4dbd-8f39-5238b8bd97c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:48.294538 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cec14d-02c7-4543-b9f1-9b9ed13652bd None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:48.294836 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cec14d-02c7-4543-b9f1-9b9ed13652bd None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:48.295183 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cec14d-02c7-4543-b9f1-9b9ed13652bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:48.339144 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-b3cec14d-02c7-4543-b9f1-9b9ed13652bd None None] MFA Rules not processed for user `88ad60446c5447a8bbd0096fa2133efb`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:48:48.342040 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-b3cec14d-02c7-4543-b9f1-9b9ed13652bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:48.396232 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1327/2689] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:48:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:48:48.396232 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281801dc-7c22-482a-b391-80b761f92d2a None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:48.402581 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281801dc-7c22-482a-b391-80b761f92d2a None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:48.402948 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281801dc-7c22-482a-b391-80b761f92d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:48.406938 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:48.441181 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-281801dc-7c22-482a-b391-80b761f92d2a None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:48:48.442864 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-281801dc-7c22-482a-b391-80b761f92d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:48.459591 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1328/2690] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:48:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:48:48.460856 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281801dc-7c22-482a-b391-80b761f92d2a None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:48.485245 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281801dc-7c22-482a-b391-80b761f92d2a None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:48.495417 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d051d6-dd3e-495e-a6fe-a46bbf4ac9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:48.496228 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d051d6-dd3e-495e-a6fe-a46bbf4ac9dd admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:48.496600 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d051d6-dd3e-495e-a6fe-a46bbf4ac9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:48.496971 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d051d6-dd3e-495e-a6fe-a46bbf4ac9dd admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:48.497840 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d051d6-dd3e-495e-a6fe-a46bbf4ac9dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:48:48.498241 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d051d6-dd3e-495e-a6fe-a46bbf4ac9dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:48.500178 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d051d6-dd3e-495e-a6fe-a46bbf4ac9dd admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:48.520686 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1329/2691] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 10:48:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:48:48.522150 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d051d6-dd3e-495e-a6fe-a46bbf4ac9dd admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:48.530048 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1363/2692] 10.222.0.39 () {58 vars in 1009 bytes} [Mon Jul 18 10:48:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:48:48.550051 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cec14d-02c7-4543-b9f1-9b9ed13652bd None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:48.552695 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-b3cec14d-02c7-4543-b9f1-9b9ed13652bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:48.563046 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d051d6-dd3e-495e-a6fe-a46bbf4ac9dd admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:48.572901 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68ae7ce-a1cb-48b2-8236-eea782a6021e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:48.574002 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ae7ce-a1cb-48b2-8236-eea782a6021e admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:48.574629 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ae7ce-a1cb-48b2-8236-eea782a6021e admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:48.575163 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ae7ce-a1cb-48b2-8236-eea782a6021e admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:48.576770 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68ae7ce-a1cb-48b2-8236-eea782a6021e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:48.579807 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68ae7ce-a1cb-48b2-8236-eea782a6021e admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:48.674572 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cec14d-02c7-4543-b9f1-9b9ed13652bd None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:48.690532 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e6f6d9-f604-4823-adb8-cc9b48b4167e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c548474a8d94591ba58dd40e40a28d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:48.691230 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6f6d9-f604-4823-adb8-cc9b48b4167e service swift] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:48.691514 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6f6d9-f604-4823-adb8-cc9b48b4167e service swift] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:48.692614 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6f6d9-f604-4823-adb8-cc9b48b4167e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:48.703009 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e6f6d9-f604-4823-adb8-cc9b48b4167e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:48.704803 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e6f6d9-f604-4823-adb8-cc9b48b4167e service swift] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:48.714793 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1364/2693] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Jul 18 10:48:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 10:48:48.729116 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1330/2694] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:48:48 2022] POST /identity/v3/projects => generated 373 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:48:48.734310 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e6f6d9-f604-4823-adb8-cc9b48b4167e service swift] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:48.750499 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e6f6d9-f604-4823-adb8-cc9b48b4167e service swift] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:48.825215 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4967ca39-4a0a-45e9-9ebb-adcacd6afa83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:48.825877 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967ca39-4a0a-45e9-9ebb-adcacd6afa83 admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:48.826162 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967ca39-4a0a-45e9-9ebb-adcacd6afa83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:48.826464 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967ca39-4a0a-45e9-9ebb-adcacd6afa83 admin admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:48.827172 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4967ca39-4a0a-45e9-9ebb-adcacd6afa83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:48.829150 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4967ca39-4a0a-45e9-9ebb-adcacd6afa83 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:48.978676 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1365/2695] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:48:48 2022] POST /identity/v3/users => generated 287 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:48:48.983764 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68ae7ce-a1cb-48b2-8236-eea782a6021e admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:49.009758 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68ae7ce-a1cb-48b2-8236-eea782a6021e admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:49.017138 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f68739-1a90-40fc-8a30-0015f9684deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:49.018428 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f68739-1a90-40fc-8a30-0015f9684deb admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:49.019087 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f68739-1a90-40fc-8a30-0015f9684deb admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:49.019679 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f68739-1a90-40fc-8a30-0015f9684deb admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:49.021349 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f68739-1a90-40fc-8a30-0015f9684deb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:49.023670 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f68739-1a90-40fc-8a30-0015f9684deb admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:49.042213 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1331/2696] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 10:48:49.045814 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4967ca39-4a0a-45e9-9ebb-adcacd6afa83 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:49.061492 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4967ca39-4a0a-45e9-9ebb-adcacd6afa83 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:49.073296 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89241d06-31dd-4993-9b82-f58e98c5f25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:49.074643 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89241d06-31dd-4993-9b82-f58e98c5f25d admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:49.076566 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89241d06-31dd-4993-9b82-f58e98c5f25d admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:49.076566 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89241d06-31dd-4993-9b82-f58e98c5f25d admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:49.079546 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89241d06-31dd-4993-9b82-f58e98c5f25d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:49.084704 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89241d06-31dd-4993-9b82-f58e98c5f25d admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:49.135900 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1366/2697] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:48:49 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:48:49.140422 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f68739-1a90-40fc-8a30-0015f9684deb admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:49.167777 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f68739-1a90-40fc-8a30-0015f9684deb admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:49.178483 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee26f9-ef8a-4b84-ae00-e19edec1bfc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:49.180731 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee26f9-ef8a-4b84-ae00-e19edec1bfc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:49.181337 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee26f9-ef8a-4b84-ae00-e19edec1bfc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:49.181905 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee26f9-ef8a-4b84-ae00-e19edec1bfc5 admin admin] PATH_INFO: `/v3/projects/ac109024fdd04178ba4d445ffa104381/users/d0101739ffd8416eb0edb2841dc085bd/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:49.185766 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:49.213325 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ee26f9-ef8a-4b84-ae00-e19edec1bfc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac109024fdd04178ba4d445ffa104381, user_id=d0101739ffd8416eb0edb2841dc085bd, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:49.220319 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ee26f9-ef8a-4b84-ae00-e19edec1bfc5 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:49.319665 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1332/2698] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:48:49 2022] PUT /identity/v3/projects/ac109024fdd04178ba4d445ffa104381/users/d0101739ffd8416eb0edb2841dc085bd/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:48:49.332725 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea47d435-1f2f-4603-ac1b-65a4df32039f None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:49.333165 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea47d435-1f2f-4603-ac1b-65a4df32039f None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:49.333432 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea47d435-1f2f-4603-ac1b-65a4df32039f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:49.380570 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-ea47d435-1f2f-4603-ac1b-65a4df32039f None None] MFA Rules not processed for user `d0101739ffd8416eb0edb2841dc085bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:48:49.385235 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-ea47d435-1f2f-4603-ac1b-65a4df32039f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:49.452525 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:49.545763 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1367/2699] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:48:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:48:49.557620 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee26f9-ef8a-4b84-ae00-e19edec1bfc5 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:49.559810 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-92ee26f9-ef8a-4b84-ae00-e19edec1bfc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:49.758536 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ee26f9-ef8a-4b84-ae00-e19edec1bfc5 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:49.770777 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3062135b-71c4-4e9a-9a3b-30bec303963b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bbebf16219943879df84bdc9a900516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:49.771461 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062135b-71c4-4e9a-9a3b-30bec303963b service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:49.771745 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062135b-71c4-4e9a-9a3b-30bec303963b service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:49.772024 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062135b-71c4-4e9a-9a3b-30bec303963b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:49.786744 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3062135b-71c4-4e9a-9a3b-30bec303963b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:49.792631 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3062135b-71c4-4e9a-9a3b-30bec303963b service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:49.815699 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1333/2700] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:48:49 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:48:50.876012 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea47d435-1f2f-4603-ac1b-65a4df32039f None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:50.881512 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-ea47d435-1f2f-4603-ac1b-65a4df32039f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:50.928348 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea47d435-1f2f-4603-ac1b-65a4df32039f None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:50.941824 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535db572-3900-40ee-a1ef-9b3c13d7c53b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bbebf16219943879df84bdc9a900516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:50.943219 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535db572-3900-40ee-a1ef-9b3c13d7c53b service nova] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:50.943823 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535db572-3900-40ee-a1ef-9b3c13d7c53b service nova] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:50.944218 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535db572-3900-40ee-a1ef-9b3c13d7c53b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:50.947937 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-535db572-3900-40ee-a1ef-9b3c13d7c53b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:50.967921 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535db572-3900-40ee-a1ef-9b3c13d7c53b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:50.970458 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535db572-3900-40ee-a1ef-9b3c13d7c53b service nova] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:50.984700 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1368/2701] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:48:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:48:53.836667 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3062135b-71c4-4e9a-9a3b-30bec303963b service nova] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:53.923091 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3062135b-71c4-4e9a-9a3b-30bec303963b service nova] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:53.928012 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703efe37-47e2-4544-a5ad-d8fd36135c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:53.928891 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703efe37-47e2-4544-a5ad-d8fd36135c84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:53.929265 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703efe37-47e2-4544-a5ad-d8fd36135c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:53.929939 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703efe37-47e2-4544-a5ad-d8fd36135c84 admin admin] PATH_INFO: `/v3/users/d0101739ffd8416eb0edb2841dc085bd` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:53.930964 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703efe37-47e2-4544-a5ad-d8fd36135c84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0101739ffd8416eb0edb2841dc085bd)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:53.933265 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703efe37-47e2-4544-a5ad-d8fd36135c84 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:54.309834 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-703efe37-47e2-4544-a5ad-d8fd36135c84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0101739ffd8416eb0edb2841dc085bd'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:54.472764 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-703efe37-47e2-4544-a5ad-d8fd36135c84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0101739ffd8416eb0edb2841dc085bd'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:54.473844 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-703efe37-47e2-4544-a5ad-d8fd36135c84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0101739ffd8416eb0edb2841dc085bd'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:54.494486 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:54.499726 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-703efe37-47e2-4544-a5ad-d8fd36135c84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0101739ffd8416eb0edb2841dc085bd'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:54.512290 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-703efe37-47e2-4544-a5ad-d8fd36135c84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0101739ffd8416eb0edb2841dc085bd'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:54.536435 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1334/2702] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:48:53 2022] DELETE /identity/v3/users/d0101739ffd8416eb0edb2841dc085bd => generated 0 bytes in 698 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:48:54.538176 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d6de3-94cb-453d-b109-38adcd09d059 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:54.539555 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d6de3-94cb-453d-b109-38adcd09d059 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:54.540030 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d6de3-94cb-453d-b109-38adcd09d059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:54.570260 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-891d6de3-94cb-453d-b109-38adcd09d059 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:48:54.571655 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-891d6de3-94cb-453d-b109-38adcd09d059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:54.668238 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1369/2703] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:48:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:48:54.676384 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703efe37-47e2-4544-a5ad-d8fd36135c84 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:54.677993 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-703efe37-47e2-4544-a5ad-d8fd36135c84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:54.827438 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703efe37-47e2-4544-a5ad-d8fd36135c84 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:54.831730 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac283fc-4891-46ae-b1f8-1adb8cbf1c9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:54.832217 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac283fc-4891-46ae-b1f8-1adb8cbf1c9e service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:54.832502 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac283fc-4891-46ae-b1f8-1adb8cbf1c9e service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:54.832793 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac283fc-4891-46ae-b1f8-1adb8cbf1c9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:54.845108 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac283fc-4891-46ae-b1f8-1adb8cbf1c9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:54.846733 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac283fc-4891-46ae-b1f8-1adb8cbf1c9e service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:54.858064 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1335/2704] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:48:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:48:55.568236 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d6de3-94cb-453d-b109-38adcd09d059 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:55.571338 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-891d6de3-94cb-453d-b109-38adcd09d059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:55.592981 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d6de3-94cb-453d-b109-38adcd09d059 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:55.599609 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71999cf9-60ec-4eb9-9fd7-7348a243a444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:55.600709 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71999cf9-60ec-4eb9-9fd7-7348a243a444 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:55.601476 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71999cf9-60ec-4eb9-9fd7-7348a243a444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:55.602238 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71999cf9-60ec-4eb9-9fd7-7348a243a444 admin admin] PATH_INFO: `/v3/projects/ac109024fdd04178ba4d445ffa104381` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:55.603726 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71999cf9-60ec-4eb9-9fd7-7348a243a444 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac109024fdd04178ba4d445ffa104381)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:55.606027 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71999cf9-60ec-4eb9-9fd7-7348a243a444 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:55.767296 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-71999cf9-60ec-4eb9-9fd7-7348a243a444 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac109024fdd04178ba4d445ffa104381', 'request_id': 'req-71999cf9-60ec-4eb9-9fd7-7348a243a444'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:55.774903 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-71999cf9-60ec-4eb9-9fd7-7348a243a444 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac109024fdd04178ba4d445ffa104381', 'request_id': 'req-71999cf9-60ec-4eb9-9fd7-7348a243a444'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:55.783005 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-71999cf9-60ec-4eb9-9fd7-7348a243a444 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac109024fdd04178ba4d445ffa104381', 'request_id': 'req-71999cf9-60ec-4eb9-9fd7-7348a243a444'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:55.959587 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-71999cf9-60ec-4eb9-9fd7-7348a243a444 admin admin] The token cache is being invalidate because project ac109024fdd04178ba4d445ffa104381 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80392) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:48:55.959884 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-71999cf9-60ec-4eb9-9fd7-7348a243a444 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:55.960735 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-71999cf9-60ec-4eb9-9fd7-7348a243a444 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:48:55.962934 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1370/2705] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:48:55 2022] DELETE /identity/v3/projects/ac109024fdd04178ba4d445ffa104381 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:48:55.969152 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bddd929-3c82-4586-ac1c-5321ef2d5703 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:55.970294 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bddd929-3c82-4586-ac1c-5321ef2d5703 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:55.970743 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bddd929-3c82-4586-ac1c-5321ef2d5703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:55.994831 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-1bddd929-3c82-4586-ac1c-5321ef2d5703 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:48:55.996138 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-1bddd929-3c82-4586-ac1c-5321ef2d5703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:56.139380 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1336/2706] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:48:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:48:56.142204 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9a75f-8f85-46e0-ad52-1867c5541c66 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:56.142496 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9a75f-8f85-46e0-ad52-1867c5541c66 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:56.142781 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9a75f-8f85-46e0-ad52-1867c5541c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:56.175956 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-bbb9a75f-8f85-46e0-ad52-1867c5541c66 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:48:56.177250 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-bbb9a75f-8f85-46e0-ad52-1867c5541c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:56.189944 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1371/2707] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:48:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:48:56.191273 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bddd929-3c82-4586-ac1c-5321ef2d5703 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:56.203132 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bddd929-3c82-4586-ac1c-5321ef2d5703 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:56.267487 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7fb44a-9798-4285-ae46-451938de89bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:56.267487 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7fb44a-9798-4285-ae46-451938de89bb admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:56.267487 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7fb44a-9798-4285-ae46-451938de89bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:56.267487 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7fb44a-9798-4285-ae46-451938de89bb admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:56.268363 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7fb44a-9798-4285-ae46-451938de89bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:48:56.268363 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7fb44a-9798-4285-ae46-451938de89bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:56.268363 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7fb44a-9798-4285-ae46-451938de89bb admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:56.268363 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1337/2708] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 10:48:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:48:56.269589 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb9a75f-8f85-46e0-ad52-1867c5541c66 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:56.298417 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb9a75f-8f85-46e0-ad52-1867c5541c66 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:56.314650 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dfaa42-d45b-4bae-a2d8-c0e9ce472937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:56.315879 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dfaa42-d45b-4bae-a2d8-c0e9ce472937 admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:56.316294 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dfaa42-d45b-4bae-a2d8-c0e9ce472937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:56.316692 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dfaa42-d45b-4bae-a2d8-c0e9ce472937 admin admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:56.317747 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dfaa42-d45b-4bae-a2d8-c0e9ce472937 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:56.321135 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dfaa42-d45b-4bae-a2d8-c0e9ce472937 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:56.884477 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1372/2709] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:48:56 2022] POST /identity/v3/projects => generated 367 bytes in 612 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:48:56.885525 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7fb44a-9798-4285-ae46-451938de89bb admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:56.899834 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7fb44a-9798-4285-ae46-451938de89bb admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:57.007147 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d211f2d-2948-4ac6-9f8d-2c7d579d5000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:57.009257 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d211f2d-2948-4ac6-9f8d-2c7d579d5000 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:57.009257 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d211f2d-2948-4ac6-9f8d-2c7d579d5000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:57.009705 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d211f2d-2948-4ac6-9f8d-2c7d579d5000 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:57.010933 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d211f2d-2948-4ac6-9f8d-2c7d579d5000 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:57.014453 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d211f2d-2948-4ac6-9f8d-2c7d579d5000 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:57.176512 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1338/2710] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:48:56 2022] POST /identity/v3/users => generated 284 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:48:57.181436 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dfaa42-d45b-4bae-a2d8-c0e9ce472937 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:57.192774 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dfaa42-d45b-4bae-a2d8-c0e9ce472937 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:57.198498 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d004a-cbc7-41d2-843c-53f5101a1d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:57.199253 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d004a-cbc7-41d2-843c-53f5101a1d0e admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:57.202010 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d004a-cbc7-41d2-843c-53f5101a1d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:57.202010 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d004a-cbc7-41d2-843c-53f5101a1d0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:57.202010 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938d004a-cbc7-41d2-843c-53f5101a1d0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:57.202290 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938d004a-cbc7-41d2-843c-53f5101a1d0e admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:57.215477 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1373/2711] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:48:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:48:57.220071 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d211f2d-2948-4ac6-9f8d-2c7d579d5000 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:57.232399 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d211f2d-2948-4ac6-9f8d-2c7d579d5000 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:57.237290 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b7ade5-2469-4a4e-b5ea-48ec485aa416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:57.238121 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b7ade5-2469-4a4e-b5ea-48ec485aa416 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:57.238506 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b7ade5-2469-4a4e-b5ea-48ec485aa416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:57.238880 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b7ade5-2469-4a4e-b5ea-48ec485aa416 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:57.239731 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b7ade5-2469-4a4e-b5ea-48ec485aa416 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:57.241992 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b7ade5-2469-4a4e-b5ea-48ec485aa416 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:57.243849 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:57.254845 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1339/2712] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:48:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:48:57.260854 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d004a-cbc7-41d2-843c-53f5101a1d0e admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:57.274724 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:57.274724 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d004a-cbc7-41d2-843c-53f5101a1d0e admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:57.278733 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5570e-b2e5-47b5-b0fb-d3f57ea0275d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:57.279649 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5570e-b2e5-47b5-b0fb-d3f57ea0275d admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:57.279932 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5570e-b2e5-47b5-b0fb-d3f57ea0275d admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:57.280206 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5570e-b2e5-47b5-b0fb-d3f57ea0275d admin admin] PATH_INFO: `/v3/projects/3cd2487349164dd9a2a2ef18d3e28de5/users/dad1a2aa3b4a462eab6dfe276b17fe6e/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:57.297908 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d5570e-b2e5-47b5-b0fb-d3f57ea0275d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cd2487349164dd9a2a2ef18d3e28de5, user_id=dad1a2aa3b4a462eab6dfe276b17fe6e, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:57.300715 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d5570e-b2e5-47b5-b0fb-d3f57ea0275d admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:57.426203 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1374/2713] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:48:57 2022] PUT /identity/v3/projects/3cd2487349164dd9a2a2ef18d3e28de5/users/dad1a2aa3b4a462eab6dfe276b17fe6e/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:48:57.440174 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c78d6-49d6-4ca7-99a3-06632a6daf23 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:57.440526 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c78d6-49d6-4ca7-99a3-06632a6daf23 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:57.440800 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c78d6-49d6-4ca7-99a3-06632a6daf23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:57.474444 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-e27c78d6-49d6-4ca7-99a3-06632a6daf23 None None] MFA Rules not processed for user `dad1a2aa3b4a462eab6dfe276b17fe6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:48:57.475775 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-e27c78d6-49d6-4ca7-99a3-06632a6daf23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:57.550264 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1340/2714] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:48:57 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:48:57.562460 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5570e-b2e5-47b5-b0fb-d3f57ea0275d admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:57.564232 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-10d5570e-b2e5-47b5-b0fb-d3f57ea0275d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:57.629611 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5570e-b2e5-47b5-b0fb-d3f57ea0275d admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:57.640028 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833d531-71ea-460e-8600-531d90c17289 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:57.640028 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833d531-71ea-460e-8600-531d90c17289 service cinder] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:57.640028 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833d531-71ea-460e-8600-531d90c17289 service cinder] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:57.640028 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833d531-71ea-460e-8600-531d90c17289 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:57.645903 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e833d531-71ea-460e-8600-531d90c17289 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:57.647362 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e833d531-71ea-460e-8600-531d90c17289 service cinder] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:57.678067 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1375/2715] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:48:57 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:48:58.525004 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c78d6-49d6-4ca7-99a3-06632a6daf23 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:48:58.530969 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-e27c78d6-49d6-4ca7-99a3-06632a6daf23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:58.620301 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c78d6-49d6-4ca7-99a3-06632a6daf23 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:48:58.626406 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c7f053-65b2-4d3c-974d-b1d25bfa3dae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bbebf16219943879df84bdc9a900516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:48:58.627099 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c7f053-65b2-4d3c-974d-b1d25bfa3dae service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:48:58.627382 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c7f053-65b2-4d3c-974d-b1d25bfa3dae service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:48:58.627689 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c7f053-65b2-4d3c-974d-b1d25bfa3dae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:48:58.629614 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-74c7f053-65b2-4d3c-974d-b1d25bfa3dae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:48:58.716234 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c7f053-65b2-4d3c-974d-b1d25bfa3dae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:48:58.717896 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c7f053-65b2-4d3c-974d-b1d25bfa3dae service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:48:58.727568 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1341/2716] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:48:58 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:49:06.271370 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833d531-71ea-460e-8600-531d90c17289 service cinder] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:06.271370 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-e833d531-71ea-460e-8600-531d90c17289 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:06.336654 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833d531-71ea-460e-8600-531d90c17289 service cinder] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:06.341833 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8ad0af-ccb3-4864-9dea-18f8d06088e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:06.342688 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ad0af-ccb3-4864-9dea-18f8d06088e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:06.342976 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ad0af-ccb3-4864-9dea-18f8d06088e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:06.343257 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ad0af-ccb3-4864-9dea-18f8d06088e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:06.348158 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-bf8ad0af-ccb3-4864-9dea-18f8d06088e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:06.434818 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8ad0af-ccb3-4864-9dea-18f8d06088e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:06.436249 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8ad0af-ccb3-4864-9dea-18f8d06088e9 service neutron] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:06.450864 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1376/2717] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:49:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:49:08.723021 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=90 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:11.659076 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c7f053-65b2-4d3c-974d-b1d25bfa3dae service nova] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:11.670449 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c7f053-65b2-4d3c-974d-b1d25bfa3dae service nova] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:11.675590 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4efb434-03a5-4015-9b22-4afc1b115d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:11.676598 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4efb434-03a5-4015-9b22-4afc1b115d7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:11.676941 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4efb434-03a5-4015-9b22-4afc1b115d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:11.677329 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4efb434-03a5-4015-9b22-4afc1b115d7d admin admin] PATH_INFO: `/v3/users/dad1a2aa3b4a462eab6dfe276b17fe6e` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:11.678628 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4efb434-03a5-4015-9b22-4afc1b115d7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=dad1a2aa3b4a462eab6dfe276b17fe6e)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:11.680626 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4efb434-03a5-4015-9b22-4afc1b115d7d admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:12.182875 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-e4efb434-03a5-4015-9b22-4afc1b115d7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dad1a2aa3b4a462eab6dfe276b17fe6e'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:12.426871 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-e4efb434-03a5-4015-9b22-4afc1b115d7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dad1a2aa3b4a462eab6dfe276b17fe6e'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:12.427600 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-e4efb434-03a5-4015-9b22-4afc1b115d7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dad1a2aa3b4a462eab6dfe276b17fe6e'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:12.445951 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-e4efb434-03a5-4015-9b22-4afc1b115d7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dad1a2aa3b4a462eab6dfe276b17fe6e'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:12.451660 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-e4efb434-03a5-4015-9b22-4afc1b115d7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dad1a2aa3b4a462eab6dfe276b17fe6e'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:12.457886 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1342/2718] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:49:11 2022] DELETE /identity/v3/users/dad1a2aa3b4a462eab6dfe276b17fe6e => generated 0 bytes in 799 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:49:12.462749 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227ff69-8612-4cb8-acc5-bcfbbe4de0e0 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:12.463297 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227ff69-8612-4cb8-acc5-bcfbbe4de0e0 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:12.463297 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227ff69-8612-4cb8-acc5-bcfbbe4de0e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:12.484342 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-6227ff69-8612-4cb8-acc5-bcfbbe4de0e0 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:49:12.485685 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-6227ff69-8612-4cb8-acc5-bcfbbe4de0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:12.514536 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:12.553107 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1377/2719] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:49:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:49:12.564837 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4efb434-03a5-4015-9b22-4afc1b115d7d admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:12.566376 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-e4efb434-03a5-4015-9b22-4afc1b115d7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:12.639993 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4efb434-03a5-4015-9b22-4afc1b115d7d admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:12.643980 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f918521e-97ea-45e9-830f-c2ceebb7073f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:12.644705 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918521e-97ea-45e9-830f-c2ceebb7073f service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:12.645138 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918521e-97ea-45e9-830f-c2ceebb7073f service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:12.645283 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918521e-97ea-45e9-830f-c2ceebb7073f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:12.657143 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f918521e-97ea-45e9-830f-c2ceebb7073f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:12.658696 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f918521e-97ea-45e9-830f-c2ceebb7073f service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:12.670012 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1343/2720] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:49:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:49:13.308764 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6227ff69-8612-4cb8-acc5-bcfbbe4de0e0 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:13.310766 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-6227ff69-8612-4cb8-acc5-bcfbbe4de0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:13.323787 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6227ff69-8612-4cb8-acc5-bcfbbe4de0e0 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:13.329561 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb279e4-cda4-42f0-b3d4-e3074a068bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:13.331429 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb279e4-cda4-42f0-b3d4-e3074a068bdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:13.332155 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb279e4-cda4-42f0-b3d4-e3074a068bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:13.333524 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb279e4-cda4-42f0-b3d4-e3074a068bdd admin admin] PATH_INFO: `/v3/projects/3cd2487349164dd9a2a2ef18d3e28de5` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:13.337574 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb279e4-cda4-42f0-b3d4-e3074a068bdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cd2487349164dd9a2a2ef18d3e28de5)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:13.347630 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb279e4-cda4-42f0-b3d4-e3074a068bdd admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:13.544168 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-ebb279e4-cda4-42f0-b3d4-e3074a068bdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cd2487349164dd9a2a2ef18d3e28de5', 'request_id': 'req-ebb279e4-cda4-42f0-b3d4-e3074a068bdd'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:13.554518 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-ebb279e4-cda4-42f0-b3d4-e3074a068bdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cd2487349164dd9a2a2ef18d3e28de5', 'request_id': 'req-ebb279e4-cda4-42f0-b3d4-e3074a068bdd'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:13.566246 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-ebb279e4-cda4-42f0-b3d4-e3074a068bdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cd2487349164dd9a2a2ef18d3e28de5', 'request_id': 'req-ebb279e4-cda4-42f0-b3d4-e3074a068bdd'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:13.734827 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-ebb279e4-cda4-42f0-b3d4-e3074a068bdd admin admin] The token cache is being invalidate because project 3cd2487349164dd9a2a2ef18d3e28de5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80392) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:49:13.735124 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-ebb279e4-cda4-42f0-b3d4-e3074a068bdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:13.735760 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-ebb279e4-cda4-42f0-b3d4-e3074a068bdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:13.737385 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1378/2721] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:49:13 2022] DELETE /identity/v3/projects/3cd2487349164dd9a2a2ef18d3e28de5 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:49:13.743138 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f913601-b3b1-41ea-8ae3-f7b3d79a1ee5 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:13.743814 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f913601-b3b1-41ea-8ae3-f7b3d79a1ee5 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:13.743814 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f913601-b3b1-41ea-8ae3-f7b3d79a1ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:13.771168 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-7f913601-b3b1-41ea-8ae3-f7b3d79a1ee5 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:49:13.773280 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-7f913601-b3b1-41ea-8ae3-f7b3d79a1ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:13.857080 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1344/2722] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:49:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:49:13.864303 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0785eb6a-df2e-43ea-a2e4-682930d73d2e None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:13.864801 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0785eb6a-df2e-43ea-a2e4-682930d73d2e None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:13.865286 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0785eb6a-df2e-43ea-a2e4-682930d73d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:13.891449 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-0785eb6a-df2e-43ea-a2e4-682930d73d2e None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:49:13.893612 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-0785eb6a-df2e-43ea-a2e4-682930d73d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:13.906890 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1379/2723] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:49:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:49:13.911181 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f913601-b3b1-41ea-8ae3-f7b3d79a1ee5 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:13.926781 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f913601-b3b1-41ea-8ae3-f7b3d79a1ee5 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:13.934840 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1eb7ff-0676-4457-8892-8cb1ffab538b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:13.936176 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1eb7ff-0676-4457-8892-8cb1ffab538b admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:13.936661 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1eb7ff-0676-4457-8892-8cb1ffab538b admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:13.937243 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1eb7ff-0676-4457-8892-8cb1ffab538b admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:13.938209 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1eb7ff-0676-4457-8892-8cb1ffab538b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:49:13.938727 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1eb7ff-0676-4457-8892-8cb1ffab538b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:13.941281 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1eb7ff-0676-4457-8892-8cb1ffab538b admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:13.958930 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1345/2724] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 10:49:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:49:13.964825 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0785eb6a-df2e-43ea-a2e4-682930d73d2e None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:13.977572 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0785eb6a-df2e-43ea-a2e4-682930d73d2e None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:13.982884 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7bf12c-84f3-4357-a3e1-31148ff9f146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:13.983587 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7bf12c-84f3-4357-a3e1-31148ff9f146 admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:13.984104 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7bf12c-84f3-4357-a3e1-31148ff9f146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:13.984616 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7bf12c-84f3-4357-a3e1-31148ff9f146 admin admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:13.985972 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7bf12c-84f3-4357-a3e1-31148ff9f146 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:13.987907 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7bf12c-84f3-4357-a3e1-31148ff9f146 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:14.173250 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1380/2725] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:49:13 2022] POST /identity/v3/projects => generated 365 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:49:14.184307 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1eb7ff-0676-4457-8892-8cb1ffab538b admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:14.190284 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:14.201851 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1eb7ff-0676-4457-8892-8cb1ffab538b admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:14.298644 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db31467-5abd-446a-aa6c-50b0bdf8fc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:14.300502 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db31467-5abd-446a-aa6c-50b0bdf8fc9a admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:14.300872 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db31467-5abd-446a-aa6c-50b0bdf8fc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:14.301725 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db31467-5abd-446a-aa6c-50b0bdf8fc9a admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:14.302759 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db31467-5abd-446a-aa6c-50b0bdf8fc9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:14.304984 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db31467-5abd-446a-aa6c-50b0bdf8fc9a admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:14.446088 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1346/2726] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:49:14 2022] POST /identity/v3/users => generated 283 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:49:14.450055 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7bf12c-84f3-4357-a3e1-31148ff9f146 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:14.469499 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7bf12c-84f3-4357-a3e1-31148ff9f146 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:14.476473 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bc2660-d0ad-470f-8a10-b5fa748cca2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:14.477366 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc2660-d0ad-470f-8a10-b5fa748cca2a admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:14.478026 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc2660-d0ad-470f-8a10-b5fa748cca2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:14.478407 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc2660-d0ad-470f-8a10-b5fa748cca2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:14.479464 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bc2660-d0ad-470f-8a10-b5fa748cca2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:14.481467 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bc2660-d0ad-470f-8a10-b5fa748cca2a admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:14.500530 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1381/2727] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:49:14.502481 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db31467-5abd-446a-aa6c-50b0bdf8fc9a admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:14.514100 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db31467-5abd-446a-aa6c-50b0bdf8fc9a admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:14.519246 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1151531b-a799-4fa7-930a-b056028361ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:14.519933 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151531b-a799-4fa7-930a-b056028361ff admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:14.520218 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151531b-a799-4fa7-930a-b056028361ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:14.520644 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151531b-a799-4fa7-930a-b056028361ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:14.521431 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1151531b-a799-4fa7-930a-b056028361ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:14.524397 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1151531b-a799-4fa7-930a-b056028361ff admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:14.541364 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1347/2728] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:49:14.545923 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bc2660-d0ad-470f-8a10-b5fa748cca2a admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:14.557421 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bc2660-d0ad-470f-8a10-b5fa748cca2a admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:14.563067 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf19622-38b1-4d35-8744-b6d3933774bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:14.564623 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf19622-38b1-4d35-8744-b6d3933774bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:14.565157 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf19622-38b1-4d35-8744-b6d3933774bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:14.565664 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf19622-38b1-4d35-8744-b6d3933774bc admin admin] PATH_INFO: `/v3/projects/758f31f4fbe945548b88f9ce55ed6e87/users/b6444745e6394ca095921805f57da15a/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:14.594150 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf19622-38b1-4d35-8744-b6d3933774bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=758f31f4fbe945548b88f9ce55ed6e87, user_id=b6444745e6394ca095921805f57da15a, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:14.599047 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf19622-38b1-4d35-8744-b6d3933774bc admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:14.892030 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1382/2729] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:49:14 2022] PUT /identity/v3/projects/758f31f4fbe945548b88f9ce55ed6e87/users/b6444745e6394ca095921805f57da15a/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:49:14.905803 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b17d3-4f34-4c6f-863b-6c25b491c2d0 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:14.907006 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b17d3-4f34-4c6f-863b-6c25b491c2d0 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:14.907544 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b17d3-4f34-4c6f-863b-6c25b491c2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:14.978143 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-183b17d3-4f34-4c6f-863b-6c25b491c2d0 None None] MFA Rules not processed for user `b6444745e6394ca095921805f57da15a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:49:14.980677 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-183b17d3-4f34-4c6f-863b-6c25b491c2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:15.096005 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1348/2730] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:49:14 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:49:15.102411 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf19622-38b1-4d35-8744-b6d3933774bc admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:15.164585 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:15.178465 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf19622-38b1-4d35-8744-b6d3933774bc admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:15.183389 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f54fba-a5b7-44f3-9e2f-4792de3719e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:15.184003 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f54fba-a5b7-44f3-9e2f-4792de3719e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:15.184296 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f54fba-a5b7-44f3-9e2f-4792de3719e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:15.184572 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f54fba-a5b7-44f3-9e2f-4792de3719e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:15.185302 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f54fba-a5b7-44f3-9e2f-4792de3719e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:15.187231 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f54fba-a5b7-44f3-9e2f-4792de3719e6 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:15.375311 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1383/2731] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:49:15 2022] POST /identity/v3/projects => generated 365 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:49:15.380181 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b17d3-4f34-4c6f-863b-6c25b491c2d0 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:15.399868 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b17d3-4f34-4c6f-863b-6c25b491c2d0 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:15.490628 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f53174-8078-4296-8cb1-6f7826b4a748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:15.491927 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f53174-8078-4296-8cb1-6f7826b4a748 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:15.492204 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f53174-8078-4296-8cb1-6f7826b4a748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:15.492489 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f53174-8078-4296-8cb1-6f7826b4a748 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:15.493221 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f53174-8078-4296-8cb1-6f7826b4a748 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:15.495385 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f53174-8078-4296-8cb1-6f7826b4a748 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:15.668167 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:15.673721 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1349/2732] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:49:15 2022] POST /identity/v3/users => generated 289 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:49:15.677985 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f54fba-a5b7-44f3-9e2f-4792de3719e6 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:15.690074 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f54fba-a5b7-44f3-9e2f-4792de3719e6 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:15.696399 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b332791-6a9b-49bf-8e60-31825251fe39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:15.697122 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b332791-6a9b-49bf-8e60-31825251fe39 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:15.697441 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b332791-6a9b-49bf-8e60-31825251fe39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:15.697737 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b332791-6a9b-49bf-8e60-31825251fe39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:15.698909 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b332791-6a9b-49bf-8e60-31825251fe39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:15.700604 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b332791-6a9b-49bf-8e60-31825251fe39 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:15.714092 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1384/2733] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:49:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 10:49:15.718180 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f53174-8078-4296-8cb1-6f7826b4a748 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:15.732775 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f53174-8078-4296-8cb1-6f7826b4a748 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:15.741598 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d891d33d-12e5-45a5-a550-65b571b04ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:15.743192 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d891d33d-12e5-45a5-a550-65b571b04ab2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:15.743692 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d891d33d-12e5-45a5-a550-65b571b04ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:15.744003 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d891d33d-12e5-45a5-a550-65b571b04ab2 admin admin] PATH_INFO: `/v3/projects/18b4d53f48ad4e3b9f3155f9f915c4ea/users/08c66bfbff1a495c9267d713fb3c0221/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:15.768218 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d891d33d-12e5-45a5-a550-65b571b04ab2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18b4d53f48ad4e3b9f3155f9f915c4ea, user_id=08c66bfbff1a495c9267d713fb3c0221, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:15.770949 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d891d33d-12e5-45a5-a550-65b571b04ab2 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:15.898942 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1350/2734] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:49:15 2022] PUT /identity/v3/projects/18b4d53f48ad4e3b9f3155f9f915c4ea/users/08c66bfbff1a495c9267d713fb3c0221/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:49:15.908592 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b332791-6a9b-49bf-8e60-31825251fe39 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:15.944844 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b332791-6a9b-49bf-8e60-31825251fe39 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:16.035716 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07497aaf-c201-41d2-95fb-fe4350a1635b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:16.036757 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07497aaf-c201-41d2-95fb-fe4350a1635b admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:16.037095 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07497aaf-c201-41d2-95fb-fe4350a1635b admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:16.038264 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07497aaf-c201-41d2-95fb-fe4350a1635b admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:16.039345 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07497aaf-c201-41d2-95fb-fe4350a1635b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:16.041587 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07497aaf-c201-41d2-95fb-fe4350a1635b admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:16.061719 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1385/2735] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:49:15 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:49:16.066941 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d891d33d-12e5-45a5-a550-65b571b04ab2 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:16.101893 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d891d33d-12e5-45a5-a550-65b571b04ab2 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:16.117747 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ba9d2-4d60-4128-933e-aca3f03f871d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:16.118883 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ba9d2-4d60-4128-933e-aca3f03f871d admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:16.119358 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ba9d2-4d60-4128-933e-aca3f03f871d admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:16.119623 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159ba9d2-4d60-4128-933e-aca3f03f871d admin admin] PATH_INFO: `/v3/projects/18b4d53f48ad4e3b9f3155f9f915c4ea/users/08c66bfbff1a495c9267d713fb3c0221/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:16.122309 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159ba9d2-4d60-4128-933e-aca3f03f871d admin admin] RBAC: Authorizing `identity:create_grant(project_id=18b4d53f48ad4e3b9f3155f9f915c4ea, user_id=08c66bfbff1a495c9267d713fb3c0221, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:16.125314 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159ba9d2-4d60-4128-933e-aca3f03f871d admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:16.144691 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1351/2736] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:49:16 2022] PUT /identity/v3/projects/18b4d53f48ad4e3b9f3155f9f915c4ea/users/08c66bfbff1a495c9267d713fb3c0221/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:49:16.162079 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e1bcf-a72f-4a66-8f1c-5df5819e8beb None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:16.163440 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e1bcf-a72f-4a66-8f1c-5df5819e8beb None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:16.164177 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e1bcf-a72f-4a66-8f1c-5df5819e8beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:16.213274 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-943e1bcf-a72f-4a66-8f1c-5df5819e8beb None None] MFA Rules not processed for user `08c66bfbff1a495c9267d713fb3c0221`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:49:16.216655 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-943e1bcf-a72f-4a66-8f1c-5df5819e8beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:16.318157 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1386/2737] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:49:16 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:49:16.337188 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ba9d2-4d60-4128-933e-aca3f03f871d admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:16.339351 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-159ba9d2-4d60-4128-933e-aca3f03f871d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:16.442678 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159ba9d2-4d60-4128-933e-aca3f03f871d admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:16.448230 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a3c39-b650-4513-8031-36cbb73d0937 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:16.448925 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a3c39-b650-4513-8031-36cbb73d0937 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:16.449428 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a3c39-b650-4513-8031-36cbb73d0937 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:16.449748 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a3c39-b650-4513-8031-36cbb73d0937 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:16.466201 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8a3c39-b650-4513-8031-36cbb73d0937 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:16.466755 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8a3c39-b650-4513-8031-36cbb73d0937 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:16.478125 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1352/2738] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:49:16 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:49:16.641203 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e1bcf-a72f-4a66-8f1c-5df5819e8beb None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:16.642707 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-943e1bcf-a72f-4a66-8f1c-5df5819e8beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:16.699743 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:16.731464 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e1bcf-a72f-4a66-8f1c-5df5819e8beb None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:16.736394 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a3c39-b650-4513-8031-36cbb73d0937 service cinder] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:16.737374 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe7e910-49b0-46de-82cc-4892dcfada99 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2330638e80a941cd9aeeb2fd615900d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:16.737754 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-4a8a3c39-b650-4513-8031-36cbb73d0937 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:16.738315 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7e910-49b0-46de-82cc-4892dcfada99 service placement] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:16.738645 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7e910-49b0-46de-82cc-4892dcfada99 service placement] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:16.738948 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7e910-49b0-46de-82cc-4892dcfada99 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:16.740820 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-2fe7e910-49b0-46de-82cc-4892dcfada99 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:16.749330 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a3c39-b650-4513-8031-36cbb73d0937 service cinder] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:16.753322 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989fe331-7f6a-4c46-a2de-b997bf609eb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:16.754021 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989fe331-7f6a-4c46-a2de-b997bf609eb7 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:16.754312 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe7e910-49b0-46de-82cc-4892dcfada99 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:16.754483 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989fe331-7f6a-4c46-a2de-b997bf609eb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:16.754601 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989fe331-7f6a-4c46-a2de-b997bf609eb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:16.755998 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe7e910-49b0-46de-82cc-4892dcfada99 service placement] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:16.768687 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1387/2739] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:49:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:49:16.831476 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989fe331-7f6a-4c46-a2de-b997bf609eb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:16.831757 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe7e910-49b0-46de-82cc-4892dcfada99 service placement] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:16.833164 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989fe331-7f6a-4c46-a2de-b997bf609eb7 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:16.835608 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-2fe7e910-49b0-46de-82cc-4892dcfada99 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:16.854097 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1353/2740] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:49:16 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:49:16.924837 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe7e910-49b0-46de-82cc-4892dcfada99 service placement] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:16.931823 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f9efbb-883f-4d00-8fef-7ef8e258ee39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:16.932942 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9efbb-883f-4d00-8fef-7ef8e258ee39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:16.933326 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9efbb-883f-4d00-8fef-7ef8e258ee39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:16.933673 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9efbb-883f-4d00-8fef-7ef8e258ee39 admin admin] PATH_INFO: `/v3/users/1e377caaec0c4198afbdfb84f3215249` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:16.935127 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f9efbb-883f-4d00-8fef-7ef8e258ee39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e377caaec0c4198afbdfb84f3215249)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:16.945085 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f9efbb-883f-4d00-8fef-7ef8e258ee39 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:17.229268 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-f5f9efbb-883f-4d00-8fef-7ef8e258ee39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e377caaec0c4198afbdfb84f3215249'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:17.302752 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-f5f9efbb-883f-4d00-8fef-7ef8e258ee39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e377caaec0c4198afbdfb84f3215249'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:17.303501 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-f5f9efbb-883f-4d00-8fef-7ef8e258ee39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e377caaec0c4198afbdfb84f3215249'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:17.326514 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-f5f9efbb-883f-4d00-8fef-7ef8e258ee39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e377caaec0c4198afbdfb84f3215249'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:17.337954 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-f5f9efbb-883f-4d00-8fef-7ef8e258ee39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e377caaec0c4198afbdfb84f3215249'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:17.345390 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1388/2741] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:49:16 2022] DELETE /identity/v3/users/1e377caaec0c4198afbdfb84f3215249 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:49:17.651545 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989fe331-7f6a-4c46-a2de-b997bf609eb7 service cinder] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:17.663122 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989fe331-7f6a-4c46-a2de-b997bf609eb7 service cinder] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:17.731373 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8b8df7-c27f-4540-aa90-537450276a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:17.732258 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b8df7-c27f-4540-aa90-537450276a72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:17.732532 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b8df7-c27f-4540-aa90-537450276a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:17.732810 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b8df7-c27f-4540-aa90-537450276a72 admin admin] PATH_INFO: `/v3/projects/f31ee2e47e7f402e9557a27066b5652f` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:17.734137 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8b8df7-c27f-4540-aa90-537450276a72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f31ee2e47e7f402e9557a27066b5652f)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:17.736092 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8b8df7-c27f-4540-aa90-537450276a72 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:17.744496 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:17.952319 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-2c8b8df7-c27f-4540-aa90-537450276a72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f31ee2e47e7f402e9557a27066b5652f', 'request_id': 'req-2c8b8df7-c27f-4540-aa90-537450276a72'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:17.958512 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-2c8b8df7-c27f-4540-aa90-537450276a72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f31ee2e47e7f402e9557a27066b5652f', 'request_id': 'req-2c8b8df7-c27f-4540-aa90-537450276a72'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:17.964310 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-2c8b8df7-c27f-4540-aa90-537450276a72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f31ee2e47e7f402e9557a27066b5652f', 'request_id': 'req-2c8b8df7-c27f-4540-aa90-537450276a72'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:18.083910 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-2c8b8df7-c27f-4540-aa90-537450276a72 admin admin] The token cache is being invalidate because project f31ee2e47e7f402e9557a27066b5652f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:49:18.084141 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-2c8b8df7-c27f-4540-aa90-537450276a72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:18.089836 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-2c8b8df7-c27f-4540-aa90-537450276a72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:18.089836 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1354/2742] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:49:17 2022] DELETE /identity/v3/projects/f31ee2e47e7f402e9557a27066b5652f => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:49:18.091973 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f9efbb-883f-4d00-8fef-7ef8e258ee39 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:18.096000 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-f5f9efbb-883f-4d00-8fef-7ef8e258ee39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:18.128199 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f9efbb-883f-4d00-8fef-7ef8e258ee39 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:18.194772 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:18.206117 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27672789-21e5-45da-91d5-a83f877cb415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:18.207095 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27672789-21e5-45da-91d5-a83f877cb415 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:18.207817 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27672789-21e5-45da-91d5-a83f877cb415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:18.208167 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27672789-21e5-45da-91d5-a83f877cb415 admin admin] PATH_INFO: `/v3/users/06bf1b42960a450ea0076a0d1a953b62` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:18.209776 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27672789-21e5-45da-91d5-a83f877cb415 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06bf1b42960a450ea0076a0d1a953b62)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:18.216207 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27672789-21e5-45da-91d5-a83f877cb415 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:18.474932 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8b8df7-c27f-4540-aa90-537450276a72 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:18.477545 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-2c8b8df7-c27f-4540-aa90-537450276a72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:18.517402 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-27672789-21e5-45da-91d5-a83f877cb415 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06bf1b42960a450ea0076a0d1a953b62'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:18.557416 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8b8df7-c27f-4540-aa90-537450276a72 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:18.561694 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45dba9d-3750-4069-a82b-1932ad3d6b91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:18.562378 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45dba9d-3750-4069-a82b-1932ad3d6b91 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:18.562636 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45dba9d-3750-4069-a82b-1932ad3d6b91 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:18.562907 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45dba9d-3750-4069-a82b-1932ad3d6b91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:18.564774 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-f45dba9d-3750-4069-a82b-1932ad3d6b91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:18.614949 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-27672789-21e5-45da-91d5-a83f877cb415 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06bf1b42960a450ea0076a0d1a953b62'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:18.615599 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-27672789-21e5-45da-91d5-a83f877cb415 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06bf1b42960a450ea0076a0d1a953b62'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:18.629176 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-27672789-21e5-45da-91d5-a83f877cb415 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06bf1b42960a450ea0076a0d1a953b62'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:18.639975 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45dba9d-3750-4069-a82b-1932ad3d6b91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:18.641483 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45dba9d-3750-4069-a82b-1932ad3d6b91 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:18.646456 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-27672789-21e5-45da-91d5-a83f877cb415 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06bf1b42960a450ea0076a0d1a953b62'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:18.652727 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1355/2743] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:49:18 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:49:18.655152 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1389/2744] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:49:18 2022] DELETE /identity/v3/users/06bf1b42960a450ea0076a0d1a953b62 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:49:18.973291 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45dba9d-3750-4069-a82b-1932ad3d6b91 service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:18.974782 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-f45dba9d-3750-4069-a82b-1932ad3d6b91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:18.990819 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45dba9d-3750-4069-a82b-1932ad3d6b91 service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:19.046612 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:19.066811 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c779234b-c532-4ed3-9f9a-968ec7c5c43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:19.067678 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779234b-c532-4ed3-9f9a-968ec7c5c43a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:19.068032 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779234b-c532-4ed3-9f9a-968ec7c5c43a admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:19.068443 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779234b-c532-4ed3-9f9a-968ec7c5c43a admin admin] PATH_INFO: `/v3/projects/b17c3cd090fa4b1c897f99169cd19a54` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:19.070159 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c779234b-c532-4ed3-9f9a-968ec7c5c43a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b17c3cd090fa4b1c897f99169cd19a54)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:19.072083 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c779234b-c532-4ed3-9f9a-968ec7c5c43a admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:19.281933 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c779234b-c532-4ed3-9f9a-968ec7c5c43a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b17c3cd090fa4b1c897f99169cd19a54', 'request_id': 'req-c779234b-c532-4ed3-9f9a-968ec7c5c43a'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:19.289755 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c779234b-c532-4ed3-9f9a-968ec7c5c43a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b17c3cd090fa4b1c897f99169cd19a54', 'request_id': 'req-c779234b-c532-4ed3-9f9a-968ec7c5c43a'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:19.296958 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c779234b-c532-4ed3-9f9a-968ec7c5c43a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b17c3cd090fa4b1c897f99169cd19a54', 'request_id': 'req-c779234b-c532-4ed3-9f9a-968ec7c5c43a'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:19.503958 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c779234b-c532-4ed3-9f9a-968ec7c5c43a admin admin] The token cache is being invalidate because project b17c3cd090fa4b1c897f99169cd19a54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:49:19.504567 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c779234b-c532-4ed3-9f9a-968ec7c5c43a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:19.505298 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c779234b-c532-4ed3-9f9a-968ec7c5c43a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:19.523940 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1356/2745] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:49:18 2022] DELETE /identity/v3/projects/b17c3cd090fa4b1c897f99169cd19a54 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:49:28.650171 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=28,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:29.831302 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27672789-21e5-45da-91d5-a83f877cb415 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:29.832888 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-27672789-21e5-45da-91d5-a83f877cb415 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:29.845994 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27672789-21e5-45da-91d5-a83f877cb415 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:29.906319 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99ee837-9788-4b3b-afd4-e3612611c810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:29.907201 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ee837-9788-4b3b-afd4-e3612611c810 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:29.907484 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ee837-9788-4b3b-afd4-e3612611c810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:29.907782 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ee837-9788-4b3b-afd4-e3612611c810 admin admin] PATH_INFO: `/v3/users/b6444745e6394ca095921805f57da15a` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:29.908961 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99ee837-9788-4b3b-afd4-e3612611c810 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6444745e6394ca095921805f57da15a)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:29.910921 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99ee837-9788-4b3b-afd4-e3612611c810 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:29.969542 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=31,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:30.194552 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-d99ee837-9788-4b3b-afd4-e3612611c810 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6444745e6394ca095921805f57da15a'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:30.317785 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-d99ee837-9788-4b3b-afd4-e3612611c810 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6444745e6394ca095921805f57da15a'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:30.318415 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-d99ee837-9788-4b3b-afd4-e3612611c810 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6444745e6394ca095921805f57da15a'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:30.332162 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-d99ee837-9788-4b3b-afd4-e3612611c810 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6444745e6394ca095921805f57da15a'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:30.339717 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-d99ee837-9788-4b3b-afd4-e3612611c810 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6444745e6394ca095921805f57da15a'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:30.346095 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1390/2746] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:49:29 2022] DELETE /identity/v3/users/b6444745e6394ca095921805f57da15a => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:49:30.351334 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6e78a-c33c-4bcb-9206-521bcb44e8d7 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:30.351625 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6e78a-c33c-4bcb-9206-521bcb44e8d7 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:30.351910 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae6e78a-c33c-4bcb-9206-521bcb44e8d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:30.381670 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-1ae6e78a-c33c-4bcb-9206-521bcb44e8d7 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:49:30.383407 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-1ae6e78a-c33c-4bcb-9206-521bcb44e8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:30.455969 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1357/2747] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:49:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:49:30.465822 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99ee837-9788-4b3b-afd4-e3612611c810 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:30.467259 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-d99ee837-9788-4b3b-afd4-e3612611c810 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:30.533703 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99ee837-9788-4b3b-afd4-e3612611c810 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:30.538435 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a834ddf-bb6c-4760-bd68-99e1c1a6ff55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:30.539102 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a834ddf-bb6c-4760-bd68-99e1c1a6ff55 service neutron] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:30.539379 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a834ddf-bb6c-4760-bd68-99e1c1a6ff55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:30.539652 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a834ddf-bb6c-4760-bd68-99e1c1a6ff55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:30.550384 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a834ddf-bb6c-4760-bd68-99e1c1a6ff55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:30.551829 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a834ddf-bb6c-4760-bd68-99e1c1a6ff55 service neutron] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:30.570105 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1391/2748] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:49:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:49:31.066563 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae6e78a-c33c-4bcb-9206-521bcb44e8d7 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:31.069020 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-1ae6e78a-c33c-4bcb-9206-521bcb44e8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:31.083084 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae6e78a-c33c-4bcb-9206-521bcb44e8d7 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:31.096945 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70df5d3-824c-49c4-8c1e-3cc22de2ef89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:31.098101 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70df5d3-824c-49c4-8c1e-3cc22de2ef89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:31.103189 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70df5d3-824c-49c4-8c1e-3cc22de2ef89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:31.103559 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70df5d3-824c-49c4-8c1e-3cc22de2ef89 admin admin] PATH_INFO: `/v3/projects/758f31f4fbe945548b88f9ce55ed6e87` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:31.104939 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70df5d3-824c-49c4-8c1e-3cc22de2ef89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=758f31f4fbe945548b88f9ce55ed6e87)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:31.107007 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70df5d3-824c-49c4-8c1e-3cc22de2ef89 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:31.217395 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-f70df5d3-824c-49c4-8c1e-3cc22de2ef89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '758f31f4fbe945548b88f9ce55ed6e87', 'request_id': 'req-f70df5d3-824c-49c4-8c1e-3cc22de2ef89'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:31.223694 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-f70df5d3-824c-49c4-8c1e-3cc22de2ef89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '758f31f4fbe945548b88f9ce55ed6e87', 'request_id': 'req-f70df5d3-824c-49c4-8c1e-3cc22de2ef89'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:31.229717 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-f70df5d3-824c-49c4-8c1e-3cc22de2ef89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '758f31f4fbe945548b88f9ce55ed6e87', 'request_id': 'req-f70df5d3-824c-49c4-8c1e-3cc22de2ef89'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:31.374549 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-f70df5d3-824c-49c4-8c1e-3cc22de2ef89 admin admin] The token cache is being invalidate because project 758f31f4fbe945548b88f9ce55ed6e87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:49:31.374831 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-f70df5d3-824c-49c4-8c1e-3cc22de2ef89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:31.375417 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-f70df5d3-824c-49c4-8c1e-3cc22de2ef89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:31.377210 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1358/2749] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:49:31 2022] DELETE /identity/v3/projects/758f31f4fbe945548b88f9ce55ed6e87 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:49:31.381185 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a834ddf-bb6c-4760-bd68-99e1c1a6ff55 service neutron] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:31.392205 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a834ddf-bb6c-4760-bd68-99e1c1a6ff55 service neutron] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:31.410309 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:31.451888 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7bcd4c-1b46-4833-8bb4-8e4ad52cdf77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:31.452840 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bcd4c-1b46-4833-8bb4-8e4ad52cdf77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:31.453157 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bcd4c-1b46-4833-8bb4-8e4ad52cdf77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:31.453448 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bcd4c-1b46-4833-8bb4-8e4ad52cdf77 admin admin] PATH_INFO: `/v3/users/08c66bfbff1a495c9267d713fb3c0221` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:31.454721 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7bcd4c-1b46-4833-8bb4-8e4ad52cdf77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08c66bfbff1a495c9267d713fb3c0221)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:31.456722 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7bcd4c-1b46-4833-8bb4-8e4ad52cdf77 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:31.761683 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-6c7bcd4c-1b46-4833-8bb4-8e4ad52cdf77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08c66bfbff1a495c9267d713fb3c0221'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:31.872382 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-6c7bcd4c-1b46-4833-8bb4-8e4ad52cdf77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08c66bfbff1a495c9267d713fb3c0221'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:31.873247 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-6c7bcd4c-1b46-4833-8bb4-8e4ad52cdf77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08c66bfbff1a495c9267d713fb3c0221'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:31.887810 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-6c7bcd4c-1b46-4833-8bb4-8e4ad52cdf77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08c66bfbff1a495c9267d713fb3c0221'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:31.895370 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-6c7bcd4c-1b46-4833-8bb4-8e4ad52cdf77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08c66bfbff1a495c9267d713fb3c0221'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:31.901844 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1392/2750] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:49:31 2022] DELETE /identity/v3/users/08c66bfbff1a495c9267d713fb3c0221 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:49:32.473695 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70df5d3-824c-49c4-8c1e-3cc22de2ef89 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:32.482561 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-f70df5d3-824c-49c4-8c1e-3cc22de2ef89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:32.489592 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70df5d3-824c-49c4-8c1e-3cc22de2ef89 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:32.548796 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d6195-6b2e-4315-9a84-89ba8ea1e987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:32.549684 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d6195-6b2e-4315-9a84-89ba8ea1e987 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:32.549963 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d6195-6b2e-4315-9a84-89ba8ea1e987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:32.550235 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d6195-6b2e-4315-9a84-89ba8ea1e987 admin admin] PATH_INFO: `/v3/projects/18b4d53f48ad4e3b9f3155f9f915c4ea` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:32.551393 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357d6195-6b2e-4315-9a84-89ba8ea1e987 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18b4d53f48ad4e3b9f3155f9f915c4ea)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:32.553520 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357d6195-6b2e-4315-9a84-89ba8ea1e987 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:32.713672 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:32.729883 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-357d6195-6b2e-4315-9a84-89ba8ea1e987 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18b4d53f48ad4e3b9f3155f9f915c4ea', 'request_id': 'req-357d6195-6b2e-4315-9a84-89ba8ea1e987'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:32.736144 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-357d6195-6b2e-4315-9a84-89ba8ea1e987 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18b4d53f48ad4e3b9f3155f9f915c4ea', 'request_id': 'req-357d6195-6b2e-4315-9a84-89ba8ea1e987'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:32.742839 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-357d6195-6b2e-4315-9a84-89ba8ea1e987 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18b4d53f48ad4e3b9f3155f9f915c4ea', 'request_id': 'req-357d6195-6b2e-4315-9a84-89ba8ea1e987'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:32.883559 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-357d6195-6b2e-4315-9a84-89ba8ea1e987 admin admin] The token cache is being invalidate because project 18b4d53f48ad4e3b9f3155f9f915c4ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:49:32.883853 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-357d6195-6b2e-4315-9a84-89ba8ea1e987 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:32.884503 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-357d6195-6b2e-4315-9a84-89ba8ea1e987 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:32.886127 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1359/2751] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:49:32 2022] DELETE /identity/v3/projects/18b4d53f48ad4e3b9f3155f9f915c4ea => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:49:32.891982 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d6d9a-2d07-49d0-87b6-0b22f1a823a4 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:32.893089 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d6d9a-2d07-49d0-87b6-0b22f1a823a4 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:32.893089 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d6d9a-2d07-49d0-87b6-0b22f1a823a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:32.910864 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-3b2d6d9a-2d07-49d0-87b6-0b22f1a823a4 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:49:32.912102 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-3b2d6d9a-2d07-49d0-87b6-0b22f1a823a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:32.978066 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1393/2752] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:49:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:49:32.987360 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c60784-b18c-4948-b79e-dc9a6404caa8 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:32.987571 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c60784-b18c-4948-b79e-dc9a6404caa8 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:32.987850 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c60784-b18c-4948-b79e-dc9a6404caa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:33.008553 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-a5c60784-b18c-4948-b79e-dc9a6404caa8 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:49:33.009817 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-a5c60784-b18c-4948-b79e-dc9a6404caa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:33.017908 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1360/2753] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:49:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:49:33.022518 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2d6d9a-2d07-49d0-87b6-0b22f1a823a4 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:33.032376 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2d6d9a-2d07-49d0-87b6-0b22f1a823a4 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:33.036911 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696a84e-3138-4da4-a40c-d2c440b1c609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:33.038018 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696a84e-3138-4da4-a40c-d2c440b1c609 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:33.038303 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696a84e-3138-4da4-a40c-d2c440b1c609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:33.038577 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696a84e-3138-4da4-a40c-d2c440b1c609 admin admin] PATH_INFO: `/v3/domains` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:33.039301 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5696a84e-3138-4da4-a40c-d2c440b1c609 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:49:33.039608 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5696a84e-3138-4da4-a40c-d2c440b1c609 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:33.041251 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5696a84e-3138-4da4-a40c-d2c440b1c609 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:33.053813 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1394/2754] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 10:49:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:49:33.058461 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c60784-b18c-4948-b79e-dc9a6404caa8 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:33.067673 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c60784-b18c-4948-b79e-dc9a6404caa8 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:33.073240 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b5145-631a-49b6-99dc-704e2a40acd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:33.074514 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b5145-631a-49b6-99dc-704e2a40acd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:33.074805 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b5145-631a-49b6-99dc-704e2a40acd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:33.075080 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12b5145-631a-49b6-99dc-704e2a40acd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:33.075772 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12b5145-631a-49b6-99dc-704e2a40acd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:33.077880 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12b5145-631a-49b6-99dc-704e2a40acd1 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:33.309679 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1361/2755] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:49:33 2022] POST /identity/v3/projects => generated 385 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:49:33.314036 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696a84e-3138-4da4-a40c-d2c440b1c609 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:33.324181 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696a84e-3138-4da4-a40c-d2c440b1c609 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:33.351088 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:33.382808 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45591f29-d563-46ea-a1e8-1629fdbc5bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:33.383497 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45591f29-d563-46ea-a1e8-1629fdbc5bfe admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:33.383789 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45591f29-d563-46ea-a1e8-1629fdbc5bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:33.384073 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45591f29-d563-46ea-a1e8-1629fdbc5bfe admin admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:33.384870 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45591f29-d563-46ea-a1e8-1629fdbc5bfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:33.386837 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45591f29-d563-46ea-a1e8-1629fdbc5bfe admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:33.489405 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1395/2756] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:49:33 2022] POST /identity/v3/users => generated 293 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:49:33.494445 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b5145-631a-49b6-99dc-704e2a40acd1 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:33.505037 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12b5145-631a-49b6-99dc-704e2a40acd1 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:33.509782 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ddc68e-094d-4878-9ce7-bf4b2fa6242b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:33.510447 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ddc68e-094d-4878-9ce7-bf4b2fa6242b admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:33.510736 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ddc68e-094d-4878-9ce7-bf4b2fa6242b admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:33.511109 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ddc68e-094d-4878-9ce7-bf4b2fa6242b admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:33.511869 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ddc68e-094d-4878-9ce7-bf4b2fa6242b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:33.513492 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ddc68e-094d-4878-9ce7-bf4b2fa6242b admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:33.524842 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1362/2757] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:49:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:49:33.528956 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45591f29-d563-46ea-a1e8-1629fdbc5bfe admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:33.540368 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45591f29-d563-46ea-a1e8-1629fdbc5bfe admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:33.545095 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b23131-e576-4bab-858f-ab402a1f4c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:33.545760 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b23131-e576-4bab-858f-ab402a1f4c6f admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:33.546039 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b23131-e576-4bab-858f-ab402a1f4c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:33.546313 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b23131-e576-4bab-858f-ab402a1f4c6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:33.547293 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b23131-e576-4bab-858f-ab402a1f4c6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:33.548881 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b23131-e576-4bab-858f-ab402a1f4c6f admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:33.559952 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1396/2758] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:49:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:49:33.564010 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ddc68e-094d-4878-9ce7-bf4b2fa6242b admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:33.574495 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ddc68e-094d-4878-9ce7-bf4b2fa6242b admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:33.579438 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c08c4c0-1754-44fd-b859-e677968cc6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:33.580311 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08c4c0-1754-44fd-b859-e677968cc6f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:33.580589 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08c4c0-1754-44fd-b859-e677968cc6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:33.580862 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08c4c0-1754-44fd-b859-e677968cc6f6 admin admin] PATH_INFO: `/v3/projects/d3313bbe54094d12a05aa0cab7ba2a18/users/3c8fa2c6267d43a6896c5aa41e9943c0/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:33.596041 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c08c4c0-1754-44fd-b859-e677968cc6f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3313bbe54094d12a05aa0cab7ba2a18, user_id=3c8fa2c6267d43a6896c5aa41e9943c0, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:33.598723 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c08c4c0-1754-44fd-b859-e677968cc6f6 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:33.723846 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1363/2759] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:49:33 2022] PUT /identity/v3/projects/d3313bbe54094d12a05aa0cab7ba2a18/users/3c8fa2c6267d43a6896c5aa41e9943c0/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:49:33.734867 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a90e3-68d5-4044-a982-5811f37c0b2b None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:33.735152 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a90e3-68d5-4044-a982-5811f37c0b2b None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:33.735426 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a90e3-68d5-4044-a982-5811f37c0b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:33.762640 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-b98a90e3-68d5-4044-a982-5811f37c0b2b None None] MFA Rules not processed for user `3c8fa2c6267d43a6896c5aa41e9943c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:49:33.763854 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-b98a90e3-68d5-4044-a982-5811f37c0b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:33.828644 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1397/2760] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:49:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:49:33.833017 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c08c4c0-1754-44fd-b859-e677968cc6f6 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:33.893795 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c08c4c0-1754-44fd-b859-e677968cc6f6 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:33.899834 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2702af-a98b-4470-bb97-af3d3aa45273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:33.905173 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2702af-a98b-4470-bb97-af3d3aa45273 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:33.905173 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2702af-a98b-4470-bb97-af3d3aa45273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:33.905173 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2702af-a98b-4470-bb97-af3d3aa45273 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:33.905173 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2702af-a98b-4470-bb97-af3d3aa45273 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:33.905173 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2702af-a98b-4470-bb97-af3d3aa45273 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:34.073559 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1364/2761] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:49:33 2022] POST /identity/v3/projects => generated 387 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:49:34.077514 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a90e3-68d5-4044-a982-5811f37c0b2b None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:34.091579 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a90e3-68d5-4044-a982-5811f37c0b2b None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:34.148431 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003d6e16-1c4f-496d-9b8b-66506418519c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:34.149136 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d6e16-1c4f-496d-9b8b-66506418519c admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:34.149425 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d6e16-1c4f-496d-9b8b-66506418519c admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:34.149704 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d6e16-1c4f-496d-9b8b-66506418519c admin admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:34.150398 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003d6e16-1c4f-496d-9b8b-66506418519c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:34.152316 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003d6e16-1c4f-496d-9b8b-66506418519c admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:34.289682 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1398/2762] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:49:34 2022] POST /identity/v3/users => generated 300 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:49:34.293771 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2702af-a98b-4470-bb97-af3d3aa45273 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:34.305147 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2702af-a98b-4470-bb97-af3d3aa45273 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:34.309664 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d417f6b-c8fa-4c58-b908-44640d187e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:34.310318 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d417f6b-c8fa-4c58-b908-44640d187e37 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:34.310602 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d417f6b-c8fa-4c58-b908-44640d187e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:34.310877 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d417f6b-c8fa-4c58-b908-44640d187e37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:34.311624 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d417f6b-c8fa-4c58-b908-44640d187e37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:34.313239 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d417f6b-c8fa-4c58-b908-44640d187e37 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:34.325456 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1365/2763] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:49:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:49:34.329628 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003d6e16-1c4f-496d-9b8b-66506418519c admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:34.340195 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003d6e16-1c4f-496d-9b8b-66506418519c admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:34.344924 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2801b7d-324f-4bd8-990e-d1c287fe42b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:34.345844 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2801b7d-324f-4bd8-990e-d1c287fe42b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:34.346126 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2801b7d-324f-4bd8-990e-d1c287fe42b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:34.346402 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2801b7d-324f-4bd8-990e-d1c287fe42b3 admin admin] PATH_INFO: `/v3/projects/a0a6817be89047b0b966d2f0f4344857/users/078a1430364c425295de3dfdd617d4a1/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:34.361757 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2801b7d-324f-4bd8-990e-d1c287fe42b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0a6817be89047b0b966d2f0f4344857, user_id=078a1430364c425295de3dfdd617d4a1, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:34.364827 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2801b7d-324f-4bd8-990e-d1c287fe42b3 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:34.450433 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1399/2764] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:49:34 2022] PUT /identity/v3/projects/a0a6817be89047b0b966d2f0f4344857/users/078a1430364c425295de3dfdd617d4a1/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:49:34.454356 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d417f6b-c8fa-4c58-b908-44640d187e37 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:34.464531 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d417f6b-c8fa-4c58-b908-44640d187e37 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:34.484093 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:34.521219 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317516d6-fba8-4194-ae33-971db22dab5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:34.521904 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317516d6-fba8-4194-ae33-971db22dab5b admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:34.522189 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317516d6-fba8-4194-ae33-971db22dab5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:34.522458 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317516d6-fba8-4194-ae33-971db22dab5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:34.523177 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317516d6-fba8-4194-ae33-971db22dab5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:34.524788 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317516d6-fba8-4194-ae33-971db22dab5b admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:34.534640 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1366/2765] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:49:34 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:49:34.539269 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2801b7d-324f-4bd8-990e-d1c287fe42b3 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:34.545574 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:34.551312 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2801b7d-324f-4bd8-990e-d1c287fe42b3 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:34.556976 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdae023-7be5-4fdd-9e4f-34587dc314b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:34.557884 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdae023-7be5-4fdd-9e4f-34587dc314b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:34.558166 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdae023-7be5-4fdd-9e4f-34587dc314b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:34.558439 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdae023-7be5-4fdd-9e4f-34587dc314b7 admin admin] PATH_INFO: `/v3/projects/a0a6817be89047b0b966d2f0f4344857/users/078a1430364c425295de3dfdd617d4a1/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:34.560405 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdae023-7be5-4fdd-9e4f-34587dc314b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0a6817be89047b0b966d2f0f4344857, user_id=078a1430364c425295de3dfdd617d4a1, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:34.563103 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdae023-7be5-4fdd-9e4f-34587dc314b7 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:34.574119 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1400/2766] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:49:34 2022] PUT /identity/v3/projects/a0a6817be89047b0b966d2f0f4344857/users/078a1430364c425295de3dfdd617d4a1/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:49:34.584742 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a825cd0e-b571-4c87-ab8e-8116b46aca63 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:34.585100 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a825cd0e-b571-4c87-ab8e-8116b46aca63 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:34.585387 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a825cd0e-b571-4c87-ab8e-8116b46aca63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:34.612276 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-a825cd0e-b571-4c87-ab8e-8116b46aca63 None None] MFA Rules not processed for user `078a1430364c425295de3dfdd617d4a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:49:34.613527 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-a825cd0e-b571-4c87-ab8e-8116b46aca63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:34.683637 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1367/2767] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:49:34 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:49:34.695299 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdae023-7be5-4fdd-9e4f-34587dc314b7 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:34.697189 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-3fdae023-7be5-4fdd-9e4f-34587dc314b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:34.755622 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdae023-7be5-4fdd-9e4f-34587dc314b7 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:34.759634 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf7976b-f140-4555-ab55-631bd1396c6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:34.760281 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7976b-f140-4555-ab55-631bd1396c6c service cinder] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:34.760571 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7976b-f140-4555-ab55-631bd1396c6c service cinder] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:34.760870 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7976b-f140-4555-ab55-631bd1396c6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:34.770213 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf7976b-f140-4555-ab55-631bd1396c6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:34.771664 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf7976b-f140-4555-ab55-631bd1396c6c service cinder] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:34.781548 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1401/2768] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:49:34 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:49:34.847341 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a825cd0e-b571-4c87-ab8e-8116b46aca63 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:34.908077 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a825cd0e-b571-4c87-ab8e-8116b46aca63 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:34.913078 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea54d5-b392-4d6d-a989-a45bd94b5cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:34.913948 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea54d5-b392-4d6d-a989-a45bd94b5cd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:34.914228 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea54d5-b392-4d6d-a989-a45bd94b5cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:34.914505 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea54d5-b392-4d6d-a989-a45bd94b5cd6 admin admin] PATH_INFO: `/v3/users/3c8fa2c6267d43a6896c5aa41e9943c0` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:34.915744 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcea54d5-b392-4d6d-a989-a45bd94b5cd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c8fa2c6267d43a6896c5aa41e9943c0)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:34.918591 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcea54d5-b392-4d6d-a989-a45bd94b5cd6 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:35.200838 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-fcea54d5-b392-4d6d-a989-a45bd94b5cd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c8fa2c6267d43a6896c5aa41e9943c0'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:35.203564 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:35.312726 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-fcea54d5-b392-4d6d-a989-a45bd94b5cd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c8fa2c6267d43a6896c5aa41e9943c0'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:35.313403 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-fcea54d5-b392-4d6d-a989-a45bd94b5cd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c8fa2c6267d43a6896c5aa41e9943c0'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:35.328709 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-fcea54d5-b392-4d6d-a989-a45bd94b5cd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c8fa2c6267d43a6896c5aa41e9943c0'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:35.337158 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-fcea54d5-b392-4d6d-a989-a45bd94b5cd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c8fa2c6267d43a6896c5aa41e9943c0'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:35.344665 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1368/2769] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:49:34 2022] DELETE /identity/v3/users/3c8fa2c6267d43a6896c5aa41e9943c0 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:49:35.349796 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ba1ad-b1f5-43fe-a96e-e2bb28fa9a8a None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:35.350836 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ba1ad-b1f5-43fe-a96e-e2bb28fa9a8a None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:35.350836 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ba1ad-b1f5-43fe-a96e-e2bb28fa9a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:35.370196 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-5b2ba1ad-b1f5-43fe-a96e-e2bb28fa9a8a None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:49:35.371444 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-5b2ba1ad-b1f5-43fe-a96e-e2bb28fa9a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:35.434706 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1402/2770] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:49:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:49:35.445525 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea54d5-b392-4d6d-a989-a45bd94b5cd6 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:35.447127 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-fcea54d5-b392-4d6d-a989-a45bd94b5cd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:35.513709 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea54d5-b392-4d6d-a989-a45bd94b5cd6 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:35.517399 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c9f1f-c461-4d01-a24f-bdf576fe9ad2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:35.518060 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c9f1f-c461-4d01-a24f-bdf576fe9ad2 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:35.518345 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c9f1f-c461-4d01-a24f-bdf576fe9ad2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:35.518621 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c9f1f-c461-4d01-a24f-bdf576fe9ad2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:35.529593 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c9f1f-c461-4d01-a24f-bdf576fe9ad2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:35.538366 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c9f1f-c461-4d01-a24f-bdf576fe9ad2 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:35.541567 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1369/2771] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:49:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:49:35.999431 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2ba1ad-b1f5-43fe-a96e-e2bb28fa9a8a None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:36.000872 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-5b2ba1ad-b1f5-43fe-a96e-e2bb28fa9a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:36.016802 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2ba1ad-b1f5-43fe-a96e-e2bb28fa9a8a None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:36.023289 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aeba4a-229e-4840-a10f-ec7748994e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:36.024852 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aeba4a-229e-4840-a10f-ec7748994e25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:36.025186 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aeba4a-229e-4840-a10f-ec7748994e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:36.025877 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aeba4a-229e-4840-a10f-ec7748994e25 admin admin] PATH_INFO: `/v3/projects/d3313bbe54094d12a05aa0cab7ba2a18` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:36.027266 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aeba4a-229e-4840-a10f-ec7748994e25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3313bbe54094d12a05aa0cab7ba2a18)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:36.029228 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aeba4a-229e-4840-a10f-ec7748994e25 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:36.159408 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-20aeba4a-229e-4840-a10f-ec7748994e25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3313bbe54094d12a05aa0cab7ba2a18', 'request_id': 'req-20aeba4a-229e-4840-a10f-ec7748994e25'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:36.165935 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-20aeba4a-229e-4840-a10f-ec7748994e25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3313bbe54094d12a05aa0cab7ba2a18', 'request_id': 'req-20aeba4a-229e-4840-a10f-ec7748994e25'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:36.172454 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-20aeba4a-229e-4840-a10f-ec7748994e25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3313bbe54094d12a05aa0cab7ba2a18', 'request_id': 'req-20aeba4a-229e-4840-a10f-ec7748994e25'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:36.248669 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-20aeba4a-229e-4840-a10f-ec7748994e25 admin admin] The token cache is being invalidate because project d3313bbe54094d12a05aa0cab7ba2a18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80392) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:49:36.248966 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-20aeba4a-229e-4840-a10f-ec7748994e25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:36.249767 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-20aeba4a-229e-4840-a10f-ec7748994e25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:36.251445 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1403/2772] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:49:35 2022] DELETE /identity/v3/projects/d3313bbe54094d12a05aa0cab7ba2a18 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:49:36.255759 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c9f1f-c461-4d01-a24f-bdf576fe9ad2 service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:36.266858 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c9f1f-c461-4d01-a24f-bdf576fe9ad2 service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:36.328588 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba08afa8-899e-47ce-bb26-643f82a587ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:36.329500 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba08afa8-899e-47ce-bb26-643f82a587ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:36.329784 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba08afa8-899e-47ce-bb26-643f82a587ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:36.330062 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba08afa8-899e-47ce-bb26-643f82a587ff admin admin] PATH_INFO: `/v3/users/078a1430364c425295de3dfdd617d4a1` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:36.331258 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba08afa8-899e-47ce-bb26-643f82a587ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=078a1430364c425295de3dfdd617d4a1)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:36.333245 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba08afa8-899e-47ce-bb26-643f82a587ff admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:36.547625 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-ba08afa8-899e-47ce-bb26-643f82a587ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '078a1430364c425295de3dfdd617d4a1'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:36.666359 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-ba08afa8-899e-47ce-bb26-643f82a587ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '078a1430364c425295de3dfdd617d4a1'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:36.667029 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-ba08afa8-899e-47ce-bb26-643f82a587ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '078a1430364c425295de3dfdd617d4a1'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:36.684280 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:36.685628 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-ba08afa8-899e-47ce-bb26-643f82a587ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '078a1430364c425295de3dfdd617d4a1'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:36.692914 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-ba08afa8-899e-47ce-bb26-643f82a587ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '078a1430364c425295de3dfdd617d4a1'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:36.701509 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1370/2773] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:49:36 2022] DELETE /identity/v3/users/078a1430364c425295de3dfdd617d4a1 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:49:37.256373 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aeba4a-229e-4840-a10f-ec7748994e25 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:37.257920 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-20aeba4a-229e-4840-a10f-ec7748994e25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:37.277732 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aeba4a-229e-4840-a10f-ec7748994e25 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:37.290928 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:37.338777 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b7e22b-cf9a-4dcb-b2ab-e4e478d9d835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:37.339562 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b7e22b-cf9a-4dcb-b2ab-e4e478d9d835 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:37.339844 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b7e22b-cf9a-4dcb-b2ab-e4e478d9d835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:37.340124 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b7e22b-cf9a-4dcb-b2ab-e4e478d9d835 admin admin] PATH_INFO: `/v3/projects/a0a6817be89047b0b966d2f0f4344857` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:37.341352 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b7e22b-cf9a-4dcb-b2ab-e4e478d9d835 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0a6817be89047b0b966d2f0f4344857)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:37.343269 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b7e22b-cf9a-4dcb-b2ab-e4e478d9d835 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:37.524789 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-26b7e22b-cf9a-4dcb-b2ab-e4e478d9d835 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0a6817be89047b0b966d2f0f4344857', 'request_id': 'req-26b7e22b-cf9a-4dcb-b2ab-e4e478d9d835'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:37.530188 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-26b7e22b-cf9a-4dcb-b2ab-e4e478d9d835 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0a6817be89047b0b966d2f0f4344857', 'request_id': 'req-26b7e22b-cf9a-4dcb-b2ab-e4e478d9d835'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:37.536385 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-26b7e22b-cf9a-4dcb-b2ab-e4e478d9d835 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0a6817be89047b0b966d2f0f4344857', 'request_id': 'req-26b7e22b-cf9a-4dcb-b2ab-e4e478d9d835'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:37.677743 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-26b7e22b-cf9a-4dcb-b2ab-e4e478d9d835 admin admin] The token cache is being invalidate because project a0a6817be89047b0b966d2f0f4344857 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80392) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:49:37.677964 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-26b7e22b-cf9a-4dcb-b2ab-e4e478d9d835 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:37.678625 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-26b7e22b-cf9a-4dcb-b2ab-e4e478d9d835 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:37.680542 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1404/2774] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:49:37 2022] DELETE /identity/v3/projects/a0a6817be89047b0b966d2f0f4344857 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:49:37.685660 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888a11e-e27c-45f8-acc9-71f9cbd0b38d None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:37.686110 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888a11e-e27c-45f8-acc9-71f9cbd0b38d None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:37.686234 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888a11e-e27c-45f8-acc9-71f9cbd0b38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:37.706378 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-6888a11e-e27c-45f8-acc9-71f9cbd0b38d None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:49:37.707588 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-6888a11e-e27c-45f8-acc9-71f9cbd0b38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:37.769307 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1371/2775] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:49:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:49:37.779334 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5fe40-92bd-45c2-bdbe-a8bd7a8c52c3 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:37.779630 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5fe40-92bd-45c2-bdbe-a8bd7a8c52c3 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:37.779911 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5fe40-92bd-45c2-bdbe-a8bd7a8c52c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:37.799290 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-1da5fe40-92bd-45c2-bdbe-a8bd7a8c52c3 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:49:37.800638 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-1da5fe40-92bd-45c2-bdbe-a8bd7a8c52c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:37.809014 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1405/2776] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:49:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:49:37.813257 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6888a11e-e27c-45f8-acc9-71f9cbd0b38d None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:37.824151 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6888a11e-e27c-45f8-acc9-71f9cbd0b38d None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:37.829228 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa1d453-8750-44c4-8121-f85344f85b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:37.835485 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1d453-8750-44c4-8121-f85344f85b8d admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:37.835485 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1d453-8750-44c4-8121-f85344f85b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:37.835485 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1d453-8750-44c4-8121-f85344f85b8d admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:37.835485 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa1d453-8750-44c4-8121-f85344f85b8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:49:37.835485 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa1d453-8750-44c4-8121-f85344f85b8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:37.835485 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa1d453-8750-44c4-8121-f85344f85b8d admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:37.846783 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1372/2777] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 10:49:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:49:37.851247 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da5fe40-92bd-45c2-bdbe-a8bd7a8c52c3 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:37.860573 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da5fe40-92bd-45c2-bdbe-a8bd7a8c52c3 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:37.865973 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4b8167-dbb8-4890-9abb-cc1072ed340a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:37.866624 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4b8167-dbb8-4890-9abb-cc1072ed340a admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:37.866909 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4b8167-dbb8-4890-9abb-cc1072ed340a admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:37.867186 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4b8167-dbb8-4890-9abb-cc1072ed340a admin admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:37.867872 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4b8167-dbb8-4890-9abb-cc1072ed340a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:37.869805 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4b8167-dbb8-4890-9abb-cc1072ed340a admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:38.022554 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1406/2778] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:49:37 2022] POST /identity/v3/projects => generated 401 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:49:38.026682 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa1d453-8750-44c4-8121-f85344f85b8d admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:38.036762 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa1d453-8750-44c4-8121-f85344f85b8d admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:38.092345 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7961f1-7ff2-4b92-a3f5-92cc63967e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:38.092967 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7961f1-7ff2-4b92-a3f5-92cc63967e46 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:38.093274 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7961f1-7ff2-4b92-a3f5-92cc63967e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:38.093545 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7961f1-7ff2-4b92-a3f5-92cc63967e46 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:38.094241 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7961f1-7ff2-4b92-a3f5-92cc63967e46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:38.096137 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7961f1-7ff2-4b92-a3f5-92cc63967e46 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:38.249882 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1373/2779] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:49:38 2022] POST /identity/v3/users => generated 301 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:49:38.254181 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4b8167-dbb8-4890-9abb-cc1072ed340a admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:38.265219 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4b8167-dbb8-4890-9abb-cc1072ed340a admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:38.270008 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6559231-8de4-47cf-ab43-35a0a98f30a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:38.270676 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6559231-8de4-47cf-ab43-35a0a98f30a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:38.270958 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6559231-8de4-47cf-ab43-35a0a98f30a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:38.271322 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6559231-8de4-47cf-ab43-35a0a98f30a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:38.272673 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6559231-8de4-47cf-ab43-35a0a98f30a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:38.274363 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6559231-8de4-47cf-ab43-35a0a98f30a2 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:38.285514 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1407/2780] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:49:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:49:38.289592 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7961f1-7ff2-4b92-a3f5-92cc63967e46 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:38.299928 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7961f1-7ff2-4b92-a3f5-92cc63967e46 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:38.305015 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1832dddf-5ef5-4f8a-8ce1-bd102ff17308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:38.305690 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1832dddf-5ef5-4f8a-8ce1-bd102ff17308 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:38.305971 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1832dddf-5ef5-4f8a-8ce1-bd102ff17308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:38.306360 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1832dddf-5ef5-4f8a-8ce1-bd102ff17308 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:38.307081 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1832dddf-5ef5-4f8a-8ce1-bd102ff17308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:38.308662 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1832dddf-5ef5-4f8a-8ce1-bd102ff17308 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:38.322799 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1374/2781] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:49:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 10:49:38.327212 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6559231-8de4-47cf-ab43-35a0a98f30a2 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:38.337421 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6559231-8de4-47cf-ab43-35a0a98f30a2 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:38.346250 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f065a23e-d534-4419-8d38-9eccacef6674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:38.347146 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065a23e-d534-4419-8d38-9eccacef6674 admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:38.347539 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065a23e-d534-4419-8d38-9eccacef6674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:38.347902 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065a23e-d534-4419-8d38-9eccacef6674 admin admin] PATH_INFO: `/v3/projects/1985e252e6874419bd5cfda9e62d7be9/users/452400052070481698b5fd66b64b92ef/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:38.374955 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f065a23e-d534-4419-8d38-9eccacef6674 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1985e252e6874419bd5cfda9e62d7be9, user_id=452400052070481698b5fd66b64b92ef, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:38.377696 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f065a23e-d534-4419-8d38-9eccacef6674 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:38.495499 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1408/2782] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:49:38 2022] PUT /identity/v3/projects/1985e252e6874419bd5cfda9e62d7be9/users/452400052070481698b5fd66b64b92ef/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:49:38.516805 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ecfc0f-1f9f-4300-8f39-311087dce53a None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:38.517029 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ecfc0f-1f9f-4300-8f39-311087dce53a None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:38.517329 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ecfc0f-1f9f-4300-8f39-311087dce53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:38.544872 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-f6ecfc0f-1f9f-4300-8f39-311087dce53a None None] MFA Rules not processed for user `452400052070481698b5fd66b64b92ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:49:38.546122 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-f6ecfc0f-1f9f-4300-8f39-311087dce53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:38.588828 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:38.611519 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1375/2783] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:49:38 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:49:38.616609 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f065a23e-d534-4419-8d38-9eccacef6674 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:38.660847 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:38.682415 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f065a23e-d534-4419-8d38-9eccacef6674 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:38.688271 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84907e8-41ea-4b31-883a-c55ecbf74f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:38.688271 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84907e8-41ea-4b31-883a-c55ecbf74f0d admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:38.688271 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84907e8-41ea-4b31-883a-c55ecbf74f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:38.688603 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84907e8-41ea-4b31-883a-c55ecbf74f0d admin admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:38.689273 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84907e8-41ea-4b31-883a-c55ecbf74f0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:38.691251 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84907e8-41ea-4b31-883a-c55ecbf74f0d admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:38.845345 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1409/2784] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:49:38 2022] POST /identity/v3/projects => generated 397 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:49:38.849089 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ecfc0f-1f9f-4300-8f39-311087dce53a None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:38.861200 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ecfc0f-1f9f-4300-8f39-311087dce53a None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:38.918669 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acaf84f-4cf9-4488-838b-cef08d3bd496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:38.919368 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acaf84f-4cf9-4488-838b-cef08d3bd496 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:38.919655 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acaf84f-4cf9-4488-838b-cef08d3bd496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:38.920474 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acaf84f-4cf9-4488-838b-cef08d3bd496 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:38.920618 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acaf84f-4cf9-4488-838b-cef08d3bd496 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:38.922907 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acaf84f-4cf9-4488-838b-cef08d3bd496 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:39.106571 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1376/2785] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:49:38 2022] POST /identity/v3/users => generated 305 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:49:39.110727 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84907e8-41ea-4b31-883a-c55ecbf74f0d admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:39.121532 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84907e8-41ea-4b31-883a-c55ecbf74f0d admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:39.126084 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a085eec6-2be2-4503-98e9-64bd20cb73e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:39.126736 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085eec6-2be2-4503-98e9-64bd20cb73e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:39.127015 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085eec6-2be2-4503-98e9-64bd20cb73e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:39.127290 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085eec6-2be2-4503-98e9-64bd20cb73e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:39.128037 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a085eec6-2be2-4503-98e9-64bd20cb73e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:39.129656 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a085eec6-2be2-4503-98e9-64bd20cb73e5 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:39.140820 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1410/2786] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:49:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:49:39.145250 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acaf84f-4cf9-4488-838b-cef08d3bd496 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:39.158272 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acaf84f-4cf9-4488-838b-cef08d3bd496 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:39.163431 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75864b18-8cdf-483f-92f0-1d464da398eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:39.164415 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75864b18-8cdf-483f-92f0-1d464da398eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:39.164704 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75864b18-8cdf-483f-92f0-1d464da398eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:39.165023 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75864b18-8cdf-483f-92f0-1d464da398eb admin admin] PATH_INFO: `/v3/projects/5564af8a9f95452999b26b295ec24a24/users/b81e7fe46f5943aeb9f35c337c5b781b/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:39.180516 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75864b18-8cdf-483f-92f0-1d464da398eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5564af8a9f95452999b26b295ec24a24, user_id=b81e7fe46f5943aeb9f35c337c5b781b, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:39.183379 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75864b18-8cdf-483f-92f0-1d464da398eb admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:39.278891 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1377/2787] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:49:39 2022] PUT /identity/v3/projects/5564af8a9f95452999b26b295ec24a24/users/b81e7fe46f5943aeb9f35c337c5b781b/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:49:39.282901 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a085eec6-2be2-4503-98e9-64bd20cb73e5 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:39.293584 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a085eec6-2be2-4503-98e9-64bd20cb73e5 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:39.352802 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5611026-451d-461e-8db3-098fd43a3311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:39.353504 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5611026-451d-461e-8db3-098fd43a3311 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:39.353789 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5611026-451d-461e-8db3-098fd43a3311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:39.354069 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5611026-451d-461e-8db3-098fd43a3311 admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:39.354797 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5611026-451d-461e-8db3-098fd43a3311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:39.356609 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5611026-451d-461e-8db3-098fd43a3311 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:39.371635 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1411/2788] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:49:39 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:49:39.376486 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75864b18-8cdf-483f-92f0-1d464da398eb admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:39.387698 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75864b18-8cdf-483f-92f0-1d464da398eb admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:39.392591 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be80317-9247-48d0-a8fd-aa6d4f66abfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:39.393529 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be80317-9247-48d0-a8fd-aa6d4f66abfc admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:39.393909 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be80317-9247-48d0-a8fd-aa6d4f66abfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:39.406094 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be80317-9247-48d0-a8fd-aa6d4f66abfc admin admin] PATH_INFO: `/v3/projects/5564af8a9f95452999b26b295ec24a24/users/b81e7fe46f5943aeb9f35c337c5b781b/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:39.406094 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be80317-9247-48d0-a8fd-aa6d4f66abfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5564af8a9f95452999b26b295ec24a24, user_id=b81e7fe46f5943aeb9f35c337c5b781b, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:39.406094 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be80317-9247-48d0-a8fd-aa6d4f66abfc admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:39.410598 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1378/2789] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:49:39 2022] PUT /identity/v3/projects/5564af8a9f95452999b26b295ec24a24/users/b81e7fe46f5943aeb9f35c337c5b781b/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:49:39.421880 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad202432-9d80-4237-a0e1-eef6bff5e7f3 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:39.422131 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad202432-9d80-4237-a0e1-eef6bff5e7f3 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:39.422438 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad202432-9d80-4237-a0e1-eef6bff5e7f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:39.450580 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-ad202432-9d80-4237-a0e1-eef6bff5e7f3 None None] MFA Rules not processed for user `b81e7fe46f5943aeb9f35c337c5b781b`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:49:39.451816 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-ad202432-9d80-4237-a0e1-eef6bff5e7f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:39.522604 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1412/2790] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:49:39 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:49:39.533387 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be80317-9247-48d0-a8fd-aa6d4f66abfc admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:39.535218 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-7be80317-9247-48d0-a8fd-aa6d4f66abfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:39.594191 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be80317-9247-48d0-a8fd-aa6d4f66abfc admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:39.598254 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a41a401-367a-4416-955a-91e0c4687304 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:39.598912 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41a401-367a-4416-955a-91e0c4687304 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:39.599196 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41a401-367a-4416-955a-91e0c4687304 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:39.599474 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41a401-367a-4416-955a-91e0c4687304 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:39.610921 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a41a401-367a-4416-955a-91e0c4687304 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:39.612282 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a41a401-367a-4416-955a-91e0c4687304 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:39.622493 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1379/2791] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:49:39 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:49:39.950008 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad202432-9d80-4237-a0e1-eef6bff5e7f3 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:39.959632 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad202432-9d80-4237-a0e1-eef6bff5e7f3 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:39.963267 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10afc784-b0a9-4a8a-bf23-22e59f37c4ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:39.963925 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10afc784-b0a9-4a8a-bf23-22e59f37c4ee service cinder] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:39.964214 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10afc784-b0a9-4a8a-bf23-22e59f37c4ee service cinder] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:39.964492 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10afc784-b0a9-4a8a-bf23-22e59f37c4ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:40.024981 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10afc784-b0a9-4a8a-bf23-22e59f37c4ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:40.026782 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10afc784-b0a9-4a8a-bf23-22e59f37c4ee service cinder] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:40.038582 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1413/2792] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:49:39 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:49:40.265611 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:47.264799 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a41a401-367a-4416-955a-91e0c4687304 service cinder] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:47.309259 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:47.376548 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a41a401-367a-4416-955a-91e0c4687304 service cinder] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:47.382617 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58cd464-0239-442f-86f8-1d9aae92acf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:47.383501 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58cd464-0239-442f-86f8-1d9aae92acf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:47.383783 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58cd464-0239-442f-86f8-1d9aae92acf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:47.384104 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58cd464-0239-442f-86f8-1d9aae92acf5 admin admin] PATH_INFO: `/v3/users/452400052070481698b5fd66b64b92ef` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:47.385352 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58cd464-0239-442f-86f8-1d9aae92acf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=452400052070481698b5fd66b64b92ef)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:47.387265 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58cd464-0239-442f-86f8-1d9aae92acf5 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:47.652178 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a58cd464-0239-442f-86f8-1d9aae92acf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '452400052070481698b5fd66b64b92ef'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:47.746343 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a58cd464-0239-442f-86f8-1d9aae92acf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '452400052070481698b5fd66b64b92ef'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:47.747111 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a58cd464-0239-442f-86f8-1d9aae92acf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '452400052070481698b5fd66b64b92ef'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:47.760043 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a58cd464-0239-442f-86f8-1d9aae92acf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '452400052070481698b5fd66b64b92ef'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:47.767908 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a58cd464-0239-442f-86f8-1d9aae92acf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '452400052070481698b5fd66b64b92ef'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:47.774638 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1380/2793] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:49:47 2022] DELETE /identity/v3/users/452400052070481698b5fd66b64b92ef => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:49:47.779351 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6f4a2-fcff-4c14-a851-a33f6f245922 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:47.779841 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6f4a2-fcff-4c14-a851-a33f6f245922 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:47.779939 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6f4a2-fcff-4c14-a851-a33f6f245922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:47.831322 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-95d6f4a2-fcff-4c14-a851-a33f6f245922 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:49:47.832545 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-95d6f4a2-fcff-4c14-a851-a33f6f245922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:48.018090 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1414/2794] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:49:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:49:48.028588 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58cd464-0239-442f-86f8-1d9aae92acf5 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:48.030155 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-a58cd464-0239-442f-86f8-1d9aae92acf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:48.117169 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58cd464-0239-442f-86f8-1d9aae92acf5 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:48.119579 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05ab8ae-ebce-4b1e-bbee-ab29acac8766 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:48.120485 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ab8ae-ebce-4b1e-bbee-ab29acac8766 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:48.120844 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ab8ae-ebce-4b1e-bbee-ab29acac8766 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:48.121253 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ab8ae-ebce-4b1e-bbee-ab29acac8766 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:48.131987 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05ab8ae-ebce-4b1e-bbee-ab29acac8766 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:48.133517 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05ab8ae-ebce-4b1e-bbee-ab29acac8766 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:48.144995 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1381/2795] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:49:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:49:48.656616 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d6f4a2-fcff-4c14-a851-a33f6f245922 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:48.658173 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-95d6f4a2-fcff-4c14-a851-a33f6f245922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:48.670133 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d6f4a2-fcff-4c14-a851-a33f6f245922 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:48.675176 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee58277-b9d1-4a3c-b227-7910d111c0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:48.676090 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee58277-b9d1-4a3c-b227-7910d111c0f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:48.676368 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee58277-b9d1-4a3c-b227-7910d111c0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:48.676739 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee58277-b9d1-4a3c-b227-7910d111c0f1 admin admin] PATH_INFO: `/v3/projects/1985e252e6874419bd5cfda9e62d7be9` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:48.678544 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee58277-b9d1-4a3c-b227-7910d111c0f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1985e252e6874419bd5cfda9e62d7be9)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:48.680453 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee58277-b9d1-4a3c-b227-7910d111c0f1 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:48.891356 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-7ee58277-b9d1-4a3c-b227-7910d111c0f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1985e252e6874419bd5cfda9e62d7be9', 'request_id': 'req-7ee58277-b9d1-4a3c-b227-7910d111c0f1'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:48.892261 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-7ee58277-b9d1-4a3c-b227-7910d111c0f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1985e252e6874419bd5cfda9e62d7be9', 'request_id': 'req-7ee58277-b9d1-4a3c-b227-7910d111c0f1'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:48.902656 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-7ee58277-b9d1-4a3c-b227-7910d111c0f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1985e252e6874419bd5cfda9e62d7be9', 'request_id': 'req-7ee58277-b9d1-4a3c-b227-7910d111c0f1'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:48.985955 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-7ee58277-b9d1-4a3c-b227-7910d111c0f1 admin admin] The token cache is being invalidate because project 1985e252e6874419bd5cfda9e62d7be9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80392) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:49:48.988013 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-7ee58277-b9d1-4a3c-b227-7910d111c0f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:48.988013 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-7ee58277-b9d1-4a3c-b227-7910d111c0f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:48.988624 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1415/2796] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:49:48 2022] DELETE /identity/v3/projects/1985e252e6874419bd5cfda9e62d7be9 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:49:48.993103 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05ab8ae-ebce-4b1e-bbee-ab29acac8766 service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:48.998041 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:49.003575 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05ab8ae-ebce-4b1e-bbee-ab29acac8766 service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:49.061768 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8707f534-c898-4a23-b2dd-0075f4a1429e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:49.062767 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8707f534-c898-4a23-b2dd-0075f4a1429e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:49.063031 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8707f534-c898-4a23-b2dd-0075f4a1429e admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:49.063305 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8707f534-c898-4a23-b2dd-0075f4a1429e admin admin] PATH_INFO: `/v3/users/b81e7fe46f5943aeb9f35c337c5b781b` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:49.064591 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8707f534-c898-4a23-b2dd-0075f4a1429e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b81e7fe46f5943aeb9f35c337c5b781b)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:49.066530 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8707f534-c898-4a23-b2dd-0075f4a1429e admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:49.294544 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-8707f534-c898-4a23-b2dd-0075f4a1429e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b81e7fe46f5943aeb9f35c337c5b781b'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:49.380532 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-8707f534-c898-4a23-b2dd-0075f4a1429e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b81e7fe46f5943aeb9f35c337c5b781b'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:49.381815 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-8707f534-c898-4a23-b2dd-0075f4a1429e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b81e7fe46f5943aeb9f35c337c5b781b'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:49.395031 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-8707f534-c898-4a23-b2dd-0075f4a1429e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b81e7fe46f5943aeb9f35c337c5b781b'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:49.403380 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-8707f534-c898-4a23-b2dd-0075f4a1429e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b81e7fe46f5943aeb9f35c337c5b781b'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:49.410957 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1382/2797] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:49:48 2022] DELETE /identity/v3/users/b81e7fe46f5943aeb9f35c337c5b781b => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:49:49.964473 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee58277-b9d1-4a3c-b227-7910d111c0f1 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:49.966036 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-7ee58277-b9d1-4a3c-b227-7910d111c0f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:49.979473 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee58277-b9d1-4a3c-b227-7910d111c0f1 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:50.015600 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:50.043866 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e41791-a6e7-4cf9-a3ed-64c98acc1fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:50.044742 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e41791-a6e7-4cf9-a3ed-64c98acc1fa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:50.045031 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e41791-a6e7-4cf9-a3ed-64c98acc1fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:50.045341 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e41791-a6e7-4cf9-a3ed-64c98acc1fa8 admin admin] PATH_INFO: `/v3/projects/5564af8a9f95452999b26b295ec24a24` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:50.046825 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e41791-a6e7-4cf9-a3ed-64c98acc1fa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5564af8a9f95452999b26b295ec24a24)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:50.048852 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e41791-a6e7-4cf9-a3ed-64c98acc1fa8 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:50.194985 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-89e41791-a6e7-4cf9-a3ed-64c98acc1fa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5564af8a9f95452999b26b295ec24a24', 'request_id': 'req-89e41791-a6e7-4cf9-a3ed-64c98acc1fa8'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:50.201475 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-89e41791-a6e7-4cf9-a3ed-64c98acc1fa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5564af8a9f95452999b26b295ec24a24', 'request_id': 'req-89e41791-a6e7-4cf9-a3ed-64c98acc1fa8'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:50.210467 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-89e41791-a6e7-4cf9-a3ed-64c98acc1fa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5564af8a9f95452999b26b295ec24a24', 'request_id': 'req-89e41791-a6e7-4cf9-a3ed-64c98acc1fa8'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:50.378729 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-89e41791-a6e7-4cf9-a3ed-64c98acc1fa8 admin admin] The token cache is being invalidate because project 5564af8a9f95452999b26b295ec24a24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80392) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:49:50.379073 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-89e41791-a6e7-4cf9-a3ed-64c98acc1fa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:50.379674 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-89e41791-a6e7-4cf9-a3ed-64c98acc1fa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:50.382306 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1416/2798] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:49:49 2022] DELETE /identity/v3/projects/5564af8a9f95452999b26b295ec24a24 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:49:50.387573 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d331b6-6fb8-4099-921b-32f4ccac1ffe None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:50.388064 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d331b6-6fb8-4099-921b-32f4ccac1ffe None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:50.388174 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d331b6-6fb8-4099-921b-32f4ccac1ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:50.438294 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-c7d331b6-6fb8-4099-921b-32f4ccac1ffe None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:49:50.439510 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c7d331b6-6fb8-4099-921b-32f4ccac1ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:50.493537 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:50.502715 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1383/2799] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:49:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:49:50.510737 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf37b7-367a-49cf-a0b8-38c906582f4f None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:50.511280 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf37b7-367a-49cf-a0b8-38c906582f4f None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:50.511738 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf37b7-367a-49cf-a0b8-38c906582f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:50.530413 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-cbbf37b7-367a-49cf-a0b8-38c906582f4f None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:49:50.531674 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-cbbf37b7-367a-49cf-a0b8-38c906582f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:50.540154 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1417/2800] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:49:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:49:50.544454 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d331b6-6fb8-4099-921b-32f4ccac1ffe None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:50.555132 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d331b6-6fb8-4099-921b-32f4ccac1ffe None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:50.560156 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d144eaf7-a294-40e0-b291-68d990ff2873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:50.560816 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144eaf7-a294-40e0-b291-68d990ff2873 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:50.561145 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144eaf7-a294-40e0-b291-68d990ff2873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:50.561424 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144eaf7-a294-40e0-b291-68d990ff2873 admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:50.562156 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d144eaf7-a294-40e0-b291-68d990ff2873 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:49:50.562459 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d144eaf7-a294-40e0-b291-68d990ff2873 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:50.564049 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d144eaf7-a294-40e0-b291-68d990ff2873 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:50.576209 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1384/2801] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 10:49:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:49:50.580612 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf37b7-367a-49cf-a0b8-38c906582f4f None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:50.590862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf37b7-367a-49cf-a0b8-38c906582f4f None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:50.595736 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181ab47-98a6-4c08-9286-399eeca091ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:50.596647 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181ab47-98a6-4c08-9286-399eeca091ee admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:50.596647 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181ab47-98a6-4c08-9286-399eeca091ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:50.596939 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181ab47-98a6-4c08-9286-399eeca091ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:50.597666 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3181ab47-98a6-4c08-9286-399eeca091ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:50.600132 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3181ab47-98a6-4c08-9286-399eeca091ee admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:50.697439 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1418/2802] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:49:50 2022] POST /identity/v3/projects => generated 361 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:49:50.701660 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d144eaf7-a294-40e0-b291-68d990ff2873 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:50.712581 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d144eaf7-a294-40e0-b291-68d990ff2873 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:50.773861 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba526bf-f5a6-4cdf-866c-afd6bd83ab41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:50.774421 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba526bf-f5a6-4cdf-866c-afd6bd83ab41 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:50.774708 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba526bf-f5a6-4cdf-866c-afd6bd83ab41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:50.774988 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba526bf-f5a6-4cdf-866c-afd6bd83ab41 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:50.775680 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba526bf-f5a6-4cdf-866c-afd6bd83ab41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:50.777654 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba526bf-f5a6-4cdf-866c-afd6bd83ab41 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:50.866637 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1385/2803] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:49:50 2022] POST /identity/v3/users => generated 281 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:49:50.870749 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181ab47-98a6-4c08-9286-399eeca091ee admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:50.881266 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181ab47-98a6-4c08-9286-399eeca091ee admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:50.886039 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a14d3d5-ba7b-4e3f-be90-72b9915d0e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:50.886702 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14d3d5-ba7b-4e3f-be90-72b9915d0e01 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:50.886987 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14d3d5-ba7b-4e3f-be90-72b9915d0e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:50.887263 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14d3d5-ba7b-4e3f-be90-72b9915d0e01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:50.887992 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a14d3d5-ba7b-4e3f-be90-72b9915d0e01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:50.889646 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a14d3d5-ba7b-4e3f-be90-72b9915d0e01 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:50.901095 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1419/2804] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:49:50.905197 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba526bf-f5a6-4cdf-866c-afd6bd83ab41 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:50.917318 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba526bf-f5a6-4cdf-866c-afd6bd83ab41 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:50.922412 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59f2203-a0a9-4e5f-ab51-f65a844a46b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:50.923085 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f2203-a0a9-4e5f-ab51-f65a844a46b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:50.923374 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f2203-a0a9-4e5f-ab51-f65a844a46b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:50.923655 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f2203-a0a9-4e5f-ab51-f65a844a46b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:50.924827 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59f2203-a0a9-4e5f-ab51-f65a844a46b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:50.926092 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59f2203-a0a9-4e5f-ab51-f65a844a46b9 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:50.941892 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1386/2805] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:49:50.946840 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a14d3d5-ba7b-4e3f-be90-72b9915d0e01 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:50.955005 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a14d3d5-ba7b-4e3f-be90-72b9915d0e01 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:50.960292 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1e2e9-b830-4be2-a37b-a7255f8c1d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:50.961199 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1e2e9-b830-4be2-a37b-a7255f8c1d9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:50.961479 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1e2e9-b830-4be2-a37b-a7255f8c1d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:50.961753 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1e2e9-b830-4be2-a37b-a7255f8c1d9a admin admin] PATH_INFO: `/v3/projects/c9ec4cc9931244e7a38ce783d499519d/users/ff890fd29d8b4d7cbe34f9825a978f6e/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:50.977646 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f1e2e9-b830-4be2-a37b-a7255f8c1d9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9ec4cc9931244e7a38ce783d499519d, user_id=ff890fd29d8b4d7cbe34f9825a978f6e, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:50.980419 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f1e2e9-b830-4be2-a37b-a7255f8c1d9a admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:51.078389 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1420/2806] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:49:50 2022] PUT /identity/v3/projects/c9ec4cc9931244e7a38ce783d499519d/users/ff890fd29d8b4d7cbe34f9825a978f6e/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:49:51.089950 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff649b-f027-4abf-a01d-b990445dbf1a None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:51.090241 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff649b-f027-4abf-a01d-b990445dbf1a None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:51.090524 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ff649b-f027-4abf-a01d-b990445dbf1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:51.119957 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-c4ff649b-f027-4abf-a01d-b990445dbf1a None None] MFA Rules not processed for user `ff890fd29d8b4d7cbe34f9825a978f6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:49:51.121402 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c4ff649b-f027-4abf-a01d-b990445dbf1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:51.188185 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1387/2807] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:49:51 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:49:51.220128 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1e2e9-b830-4be2-a37b-a7255f8c1d9a admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:51.221871 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-71f1e2e9-b830-4be2-a37b-a7255f8c1d9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:51.281126 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1e2e9-b830-4be2-a37b-a7255f8c1d9a admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:51.285141 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91b33b-2a67-439b-966d-4e0060b1ee90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:51.285676 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91b33b-2a67-439b-966d-4e0060b1ee90 service cinder] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:51.285959 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91b33b-2a67-439b-966d-4e0060b1ee90 service cinder] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:51.286234 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91b33b-2a67-439b-966d-4e0060b1ee90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:51.296140 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad91b33b-2a67-439b-966d-4e0060b1ee90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:51.297909 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad91b33b-2a67-439b-966d-4e0060b1ee90 service cinder] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:51.307500 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1421/2808] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:49:51 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:49:51.323965 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff649b-f027-4abf-a01d-b990445dbf1a None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:51.399297 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:51.410728 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ff649b-f027-4abf-a01d-b990445dbf1a None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:51.416669 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b7c4d-6654-4e6a-9858-d1f538aa9363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:51.417584 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b7c4d-6654-4e6a-9858-d1f538aa9363 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:51.417860 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b7c4d-6654-4e6a-9858-d1f538aa9363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:51.418129 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b7c4d-6654-4e6a-9858-d1f538aa9363 admin admin] PATH_INFO: `/v3/users/ff890fd29d8b4d7cbe34f9825a978f6e` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:51.419391 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101b7c4d-6654-4e6a-9858-d1f538aa9363 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff890fd29d8b4d7cbe34f9825a978f6e)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:51.421312 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101b7c4d-6654-4e6a-9858-d1f538aa9363 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:51.874155 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-101b7c4d-6654-4e6a-9858-d1f538aa9363 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff890fd29d8b4d7cbe34f9825a978f6e'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:52.014615 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-101b7c4d-6654-4e6a-9858-d1f538aa9363 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff890fd29d8b4d7cbe34f9825a978f6e'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:52.015243 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-101b7c4d-6654-4e6a-9858-d1f538aa9363 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff890fd29d8b4d7cbe34f9825a978f6e'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:52.028709 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-101b7c4d-6654-4e6a-9858-d1f538aa9363 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff890fd29d8b4d7cbe34f9825a978f6e'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:52.035678 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-101b7c4d-6654-4e6a-9858-d1f538aa9363 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff890fd29d8b4d7cbe34f9825a978f6e'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:52.042588 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1388/2809] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:49:51 2022] DELETE /identity/v3/users/ff890fd29d8b4d7cbe34f9825a978f6e => generated 0 bytes in 719 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:49:52.047490 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece36d28-229a-471e-a7fd-5bd55a561bf4 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:52.047982 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece36d28-229a-471e-a7fd-5bd55a561bf4 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:52.048082 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece36d28-229a-471e-a7fd-5bd55a561bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:52.054448 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:52.066247 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-ece36d28-229a-471e-a7fd-5bd55a561bf4 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:49:52.067461 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-ece36d28-229a-471e-a7fd-5bd55a561bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:52.127643 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1422/2810] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:49:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:49:52.138362 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b7c4d-6654-4e6a-9858-d1f538aa9363 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:52.139969 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-101b7c4d-6654-4e6a-9858-d1f538aa9363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:52.203266 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b7c4d-6654-4e6a-9858-d1f538aa9363 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:52.207201 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc769a3e-25da-4b91-9380-57a2b0a91ff4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:52.207787 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc769a3e-25da-4b91-9380-57a2b0a91ff4 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:52.208074 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc769a3e-25da-4b91-9380-57a2b0a91ff4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:52.208348 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc769a3e-25da-4b91-9380-57a2b0a91ff4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:52.218966 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc769a3e-25da-4b91-9380-57a2b0a91ff4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:52.220406 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc769a3e-25da-4b91-9380-57a2b0a91ff4 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:52.231793 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1389/2811] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:49:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:49:52.734974 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece36d28-229a-471e-a7fd-5bd55a561bf4 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:52.734974 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-ece36d28-229a-471e-a7fd-5bd55a561bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:52.744878 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece36d28-229a-471e-a7fd-5bd55a561bf4 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:52.749989 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a0051c-999d-49d9-9249-a2b57b0b5e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:52.750944 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0051c-999d-49d9-9249-a2b57b0b5e8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:52.751229 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0051c-999d-49d9-9249-a2b57b0b5e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:52.751656 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0051c-999d-49d9-9249-a2b57b0b5e8a admin admin] PATH_INFO: `/v3/projects/c9ec4cc9931244e7a38ce783d499519d` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:52.752774 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a0051c-999d-49d9-9249-a2b57b0b5e8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9ec4cc9931244e7a38ce783d499519d)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:52.754753 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a0051c-999d-49d9-9249-a2b57b0b5e8a admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:52.913676 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-21a0051c-999d-49d9-9249-a2b57b0b5e8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9ec4cc9931244e7a38ce783d499519d', 'request_id': 'req-21a0051c-999d-49d9-9249-a2b57b0b5e8a'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:52.919422 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-21a0051c-999d-49d9-9249-a2b57b0b5e8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9ec4cc9931244e7a38ce783d499519d', 'request_id': 'req-21a0051c-999d-49d9-9249-a2b57b0b5e8a'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:52.926498 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-21a0051c-999d-49d9-9249-a2b57b0b5e8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9ec4cc9931244e7a38ce783d499519d', 'request_id': 'req-21a0051c-999d-49d9-9249-a2b57b0b5e8a'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:53.083061 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-21a0051c-999d-49d9-9249-a2b57b0b5e8a admin admin] The token cache is being invalidate because project c9ec4cc9931244e7a38ce783d499519d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80392) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:49:53.083775 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-21a0051c-999d-49d9-9249-a2b57b0b5e8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:53.087488 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-21a0051c-999d-49d9-9249-a2b57b0b5e8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:49:53.089644 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1423/2812] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:49:52 2022] DELETE /identity/v3/projects/c9ec4cc9931244e7a38ce783d499519d => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:49:53.094748 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3e062-8374-442c-90f9-371aef1be906 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:53.095250 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3e062-8374-442c-90f9-371aef1be906 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:53.095346 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3e062-8374-442c-90f9-371aef1be906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:53.115538 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-51e3e062-8374-442c-90f9-371aef1be906 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:49:53.116788 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-51e3e062-8374-442c-90f9-371aef1be906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:53.187974 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1390/2813] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:49:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:49:53.198281 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fde72f-20f3-4cb6-b005-62fd91341222 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:53.198623 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fde72f-20f3-4cb6-b005-62fd91341222 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:53.198836 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fde72f-20f3-4cb6-b005-62fd91341222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:53.218644 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-73fde72f-20f3-4cb6-b005-62fd91341222 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:49:53.219886 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-73fde72f-20f3-4cb6-b005-62fd91341222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:53.228637 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1424/2814] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:49:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:49:53.233032 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e3e062-8374-442c-90f9-371aef1be906 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:53.245142 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e3e062-8374-442c-90f9-371aef1be906 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:53.250906 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af056a7a-7f76-4b21-9284-04423cb91b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:53.251883 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af056a7a-7f76-4b21-9284-04423cb91b10 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:53.252275 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af056a7a-7f76-4b21-9284-04423cb91b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:53.252711 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af056a7a-7f76-4b21-9284-04423cb91b10 admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:53.254602 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af056a7a-7f76-4b21-9284-04423cb91b10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:49:53.254602 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af056a7a-7f76-4b21-9284-04423cb91b10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:53.257838 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af056a7a-7f76-4b21-9284-04423cb91b10 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:53.276674 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1391/2815] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 10:49:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:49:53.281008 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fde72f-20f3-4cb6-b005-62fd91341222 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:53.291081 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fde72f-20f3-4cb6-b005-62fd91341222 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:53.296008 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b10999-0d30-4166-926e-741cb27c5eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:53.296946 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b10999-0d30-4166-926e-741cb27c5eed admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:53.297255 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b10999-0d30-4166-926e-741cb27c5eed admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:53.297526 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b10999-0d30-4166-926e-741cb27c5eed admin admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:53.298243 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b10999-0d30-4166-926e-741cb27c5eed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:53.300214 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b10999-0d30-4166-926e-741cb27c5eed admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:53.424507 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1425/2816] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:49:53 2022] POST /identity/v3/projects => generated 373 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:49:53.429414 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af056a7a-7f76-4b21-9284-04423cb91b10 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:53.434965 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:53.442396 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af056a7a-7f76-4b21-9284-04423cb91b10 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:53.504047 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ce4ed-fac1-41f1-91d9-7c2c66e48a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:53.506087 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ce4ed-fac1-41f1-91d9-7c2c66e48a40 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:53.506087 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ce4ed-fac1-41f1-91d9-7c2c66e48a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:53.506087 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ce4ed-fac1-41f1-91d9-7c2c66e48a40 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:53.506400 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16ce4ed-fac1-41f1-91d9-7c2c66e48a40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:53.508142 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16ce4ed-fac1-41f1-91d9-7c2c66e48a40 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:53.894475 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1392/2817] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:49:53 2022] POST /identity/v3/users => generated 287 bytes in 465 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:49:53.899476 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b10999-0d30-4166-926e-741cb27c5eed admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:53.909584 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b10999-0d30-4166-926e-741cb27c5eed admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:53.914945 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90953ccc-b933-463a-a237-dab97b3bf366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:53.915612 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90953ccc-b933-463a-a237-dab97b3bf366 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:53.915895 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90953ccc-b933-463a-a237-dab97b3bf366 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:53.916165 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90953ccc-b933-463a-a237-dab97b3bf366 admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:53.916892 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90953ccc-b933-463a-a237-dab97b3bf366 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:53.918509 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90953ccc-b933-463a-a237-dab97b3bf366 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:53.929778 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1426/2818] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:49:53.933836 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ce4ed-fac1-41f1-91d9-7c2c66e48a40 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:53.948646 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ce4ed-fac1-41f1-91d9-7c2c66e48a40 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:53.956406 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a15191-792f-4b35-8209-17afb4606ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:53.957212 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a15191-792f-4b35-8209-17afb4606ede admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:53.957502 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a15191-792f-4b35-8209-17afb4606ede admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:53.957845 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a15191-792f-4b35-8209-17afb4606ede admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:53.959458 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a15191-792f-4b35-8209-17afb4606ede admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:53.961747 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a15191-792f-4b35-8209-17afb4606ede admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:53.973604 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1393/2819] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 10:49:53.979408 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90953ccc-b933-463a-a237-dab97b3bf366 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:54.000239 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90953ccc-b933-463a-a237-dab97b3bf366 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:54.007050 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68a1311-a169-40b5-b5e6-c8830bafc264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:54.010120 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a1311-a169-40b5-b5e6-c8830bafc264 admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:54.010120 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a1311-a169-40b5-b5e6-c8830bafc264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:54.010120 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68a1311-a169-40b5-b5e6-c8830bafc264 admin admin] PATH_INFO: `/v3/projects/22d6aeded571456b95969679ab5635cc/users/376501a630254fc5ba967a3605d751f1/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:54.038909 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68a1311-a169-40b5-b5e6-c8830bafc264 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22d6aeded571456b95969679ab5635cc, user_id=376501a630254fc5ba967a3605d751f1, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:54.039769 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68a1311-a169-40b5-b5e6-c8830bafc264 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:54.192492 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1427/2820] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:49:53 2022] PUT /identity/v3/projects/22d6aeded571456b95969679ab5635cc/users/376501a630254fc5ba967a3605d751f1/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:49:54.198527 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86294451-02af-4a71-8825-528a21ef0d88 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:54.198981 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86294451-02af-4a71-8825-528a21ef0d88 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:54.199131 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86294451-02af-4a71-8825-528a21ef0d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:54.225397 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-86294451-02af-4a71-8825-528a21ef0d88 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:49:54.226640 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-86294451-02af-4a71-8825-528a21ef0d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:54.293849 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1394/2821] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:49:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:49:54.305970 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68a1311-a169-40b5-b5e6-c8830bafc264 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:54.307915 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-e68a1311-a169-40b5-b5e6-c8830bafc264 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:54.346707 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:54.387038 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68a1311-a169-40b5-b5e6-c8830bafc264 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:54.390974 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889fb44-2f07-48d2-b5ea-64a922374445 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:54.391631 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889fb44-2f07-48d2-b5ea-64a922374445 service neutron] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:54.391925 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889fb44-2f07-48d2-b5ea-64a922374445 service neutron] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:54.392219 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889fb44-2f07-48d2-b5ea-64a922374445 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:54.403025 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1889fb44-2f07-48d2-b5ea-64a922374445 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:54.404488 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1889fb44-2f07-48d2-b5ea-64a922374445 service neutron] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:54.414359 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1428/2822] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:49:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:49:54.882285 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634c4f1-a939-491b-8403-0766bc788549 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:54.882613 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634c4f1-a939-491b-8403-0766bc788549 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:54.882900 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4634c4f1-a939-491b-8403-0766bc788549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:54.904555 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-4634c4f1-a939-491b-8403-0766bc788549 None None] MFA Rules not processed for user `3288eb1237b34763ac85f851863dc5e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:49:54.906059 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-4634c4f1-a939-491b-8403-0766bc788549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:54.971620 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1395/2823] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:49:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:49:56.546020 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54254f3-ad57-4585-b243-bd78758f3dd5 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:56.546849 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54254f3-ad57-4585-b243-bd78758f3dd5 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:56.546849 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54254f3-ad57-4585-b243-bd78758f3dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:56.573809 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-e54254f3-ad57-4585-b243-bd78758f3dd5 None None] MFA Rules not processed for user `376501a630254fc5ba967a3605d751f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:49:56.575060 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-e54254f3-ad57-4585-b243-bd78758f3dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:56.643657 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1429/2824] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:49:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:49:56.655904 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4634c4f1-a939-491b-8403-0766bc788549 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:49:56.657790 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-4634c4f1-a939-491b-8403-0766bc788549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:56.689396 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:56.717640 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4634c4f1-a939-491b-8403-0766bc788549 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:49:56.721409 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9cee1d-38fb-4003-b2a7-919b317e9031 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:49:56.722002 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9cee1d-38fb-4003-b2a7-919b317e9031 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:56.722288 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9cee1d-38fb-4003-b2a7-919b317e9031 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:56.722592 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9cee1d-38fb-4003-b2a7-919b317e9031 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:56.731455 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9cee1d-38fb-4003-b2a7-919b317e9031 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:49:56.733081 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9cee1d-38fb-4003-b2a7-919b317e9031 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:49:56.742949 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1396/2825] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:49:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:49:59.898235 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6f111-1bd5-44fe-a020-f0a8e27b87a8 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:49:59.898844 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6f111-1bd5-44fe-a020-f0a8e27b87a8 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:49:59.898844 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6f111-1bd5-44fe-a020-f0a8e27b87a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:49:59.921862 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-c7b6f111-1bd5-44fe-a020-f0a8e27b87a8 None None] MFA Rules not processed for user `376501a630254fc5ba967a3605d751f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:49:59.923104 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-c7b6f111-1bd5-44fe-a020-f0a8e27b87a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:49:59.930256 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1430/2826] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:49:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:50:08.460785 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=14 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:50:09.911282 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=51 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:50:21.489448 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9cee1d-38fb-4003-b2a7-919b317e9031 service cinder] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:50:21.491699 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-9f9cee1d-38fb-4003-b2a7-919b317e9031 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:50:21.583859 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9cee1d-38fb-4003-b2a7-919b317e9031 service cinder] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:50:21.589082 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec87ef49-3fba-4f1d-90f6-3dbda423a368 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2330638e80a941cd9aeeb2fd615900d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:50:21.589782 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87ef49-3fba-4f1d-90f6-3dbda423a368 service placement] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:50:21.590075 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87ef49-3fba-4f1d-90f6-3dbda423a368 service placement] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:50:21.590347 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87ef49-3fba-4f1d-90f6-3dbda423a368 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:50:21.592168 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-ec87ef49-3fba-4f1d-90f6-3dbda423a368 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:50:21.605256 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec87ef49-3fba-4f1d-90f6-3dbda423a368 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:50:21.606867 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec87ef49-3fba-4f1d-90f6-3dbda423a368 service placement] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:50:21.618813 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1397/2827] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:50:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:50:23.030313 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030e7a7-20ea-4aab-aa15-17601f89e875 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:50:23.030848 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030e7a7-20ea-4aab-aa15-17601f89e875 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:50:23.031003 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030e7a7-20ea-4aab-aa15-17601f89e875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:50:23.049842 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-b030e7a7-20ea-4aab-aa15-17601f89e875 None None] MFA Rules not processed for user `376501a630254fc5ba967a3605d751f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:50:23.051058 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-b030e7a7-20ea-4aab-aa15-17601f89e875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:50:23.059031 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1431/2828] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:50:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:50:31.612826 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=41 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:50:33.044112 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=3 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:50:46.005208 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a3515f-df95-4826-aa3c-f7374c0d3140 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:50:46.005731 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a3515f-df95-4826-aa3c-f7374c0d3140 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:50:46.006091 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a3515f-df95-4826-aa3c-f7374c0d3140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:50:46.035746 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-50a3515f-df95-4826-aa3c-f7374c0d3140 None None] MFA Rules not processed for user `88ad60446c5447a8bbd0096fa2133efb`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:50:46.037651 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-50a3515f-df95-4826-aa3c-f7374c0d3140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:50:46.107784 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1398/2829] 10.222.0.39 () {58 vars in 1009 bytes} [Mon Jul 18 10:50:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:50:46.149966 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030e7a7-20ea-4aab-aa15-17601f89e875 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:50:46.151433 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-b030e7a7-20ea-4aab-aa15-17601f89e875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:50:46.234028 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030e7a7-20ea-4aab-aa15-17601f89e875 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:50:46.239095 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f043df6d-a1d8-4790-acbc-032344981b78 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c548474a8d94591ba58dd40e40a28d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:50:46.239861 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043df6d-a1d8-4790-acbc-032344981b78 service swift] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:50:46.240176 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043df6d-a1d8-4790-acbc-032344981b78 service swift] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:50:46.240453 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043df6d-a1d8-4790-acbc-032344981b78 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:50:46.249287 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f043df6d-a1d8-4790-acbc-032344981b78 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:50:46.250855 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f043df6d-a1d8-4790-acbc-032344981b78 service swift] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:50:46.259375 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1432/2830] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Jul 18 10:50:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 10:50:56.100307 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=32 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:50:56.255687 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=32 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:50:57.267336 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8edb919-ea66-4b3d-a99a-5f3b072369c8 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:50:57.267852 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8edb919-ea66-4b3d-a99a-5f3b072369c8 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:50:57.267954 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8edb919-ea66-4b3d-a99a-5f3b072369c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:50:57.296228 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-b8edb919-ea66-4b3d-a99a-5f3b072369c8 None None] MFA Rules not processed for user `88ad60446c5447a8bbd0096fa2133efb`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:50:57.297933 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-b8edb919-ea66-4b3d-a99a-5f3b072369c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:50:57.314552 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1399/2831] 10.222.0.39 () {58 vars in 967 bytes} [Mon Jul 18 10:50:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:50:57.331783 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f043df6d-a1d8-4790-acbc-032344981b78 service swift] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:50:57.359575 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f043df6d-a1d8-4790-acbc-032344981b78 service swift] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:50:57.359575 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d3e5f-3c8b-4533-a735-77e1e1d22559 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c548474a8d94591ba58dd40e40a28d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:50:57.359575 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d3e5f-3c8b-4533-a735-77e1e1d22559 service swift] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:50:57.359575 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d3e5f-3c8b-4533-a735-77e1e1d22559 service swift] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:50:57.360449 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d3e5f-3c8b-4533-a735-77e1e1d22559 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:50:57.367915 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d3e5f-3c8b-4533-a735-77e1e1d22559 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:50:57.369549 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d3e5f-3c8b-4533-a735-77e1e1d22559 service swift] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:50:57.379228 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1433/2832] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Jul 18 10:50:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 10:51:06.190411 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2157f9a-b197-4509-8dfa-951a1a86f6dd None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:51:06.190882 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2157f9a-b197-4509-8dfa-951a1a86f6dd None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:51:06.190977 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2157f9a-b197-4509-8dfa-951a1a86f6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:51:06.209271 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-c2157f9a-b197-4509-8dfa-951a1a86f6dd None None] MFA Rules not processed for user `88ad60446c5447a8bbd0096fa2133efb`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:51:06.210720 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c2157f9a-b197-4509-8dfa-951a1a86f6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:51:06.218151 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1400/2833] 10.222.0.39 () {58 vars in 967 bytes} [Mon Jul 18 10:51:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:51:06.232223 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d3e5f-3c8b-4533-a735-77e1e1d22559 service swift] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:51:06.244195 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d3e5f-3c8b-4533-a735-77e1e1d22559 service swift] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:51:06.249401 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486b6ef5-4a13-46ca-af81-b5721308a558 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c548474a8d94591ba58dd40e40a28d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:51:06.250046 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b6ef5-4a13-46ca-af81-b5721308a558 service swift] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:51:06.250429 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b6ef5-4a13-46ca-af81-b5721308a558 service swift] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:51:06.250823 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b6ef5-4a13-46ca-af81-b5721308a558 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:51:06.260145 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486b6ef5-4a13-46ca-af81-b5721308a558 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:51:06.261713 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486b6ef5-4a13-46ca-af81-b5721308a558 service swift] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:51:06.270532 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1434/2834] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Jul 18 10:51:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 10:51:10.193336 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2157f9a-b197-4509-8dfa-951a1a86f6dd None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:51:10.194991 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c2157f9a-b197-4509-8dfa-951a1a86f6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:51:10.210535 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2157f9a-b197-4509-8dfa-951a1a86f6dd None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:51:10.215178 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f9079-375d-4981-a0c9-519209a47d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:51:10.216035 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f9079-375d-4981-a0c9-519209a47d53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:51:10.216309 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f9079-375d-4981-a0c9-519209a47d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:51:10.216574 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f9079-375d-4981-a0c9-519209a47d53 admin admin] PATH_INFO: `/v3/users/2f929341be564f9aad54b0b063cab288` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:51:10.217753 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08f9079-375d-4981-a0c9-519209a47d53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f929341be564f9aad54b0b063cab288)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:51:10.219647 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08f9079-375d-4981-a0c9-519209a47d53 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:51:10.530526 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-d08f9079-375d-4981-a0c9-519209a47d53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f929341be564f9aad54b0b063cab288'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:10.674964 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-d08f9079-375d-4981-a0c9-519209a47d53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f929341be564f9aad54b0b063cab288'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:10.674964 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-d08f9079-375d-4981-a0c9-519209a47d53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f929341be564f9aad54b0b063cab288'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:10.685646 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-d08f9079-375d-4981-a0c9-519209a47d53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f929341be564f9aad54b0b063cab288'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:10.692646 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-d08f9079-375d-4981-a0c9-519209a47d53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f929341be564f9aad54b0b063cab288'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:10.699262 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1401/2835] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:51:10 2022] DELETE /identity/v3/users/2f929341be564f9aad54b0b063cab288 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:51:10.785236 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486b6ef5-4a13-46ca-af81-b5721308a558 service swift] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:51:10.798130 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486b6ef5-4a13-46ca-af81-b5721308a558 service swift] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:51:10.860915 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b70b8d9-e1bb-4426-a3fa-ae87fee32b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:51:10.861847 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70b8d9-e1bb-4426-a3fa-ae87fee32b37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:51:10.862136 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70b8d9-e1bb-4426-a3fa-ae87fee32b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:51:10.862414 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70b8d9-e1bb-4426-a3fa-ae87fee32b37 admin admin] PATH_INFO: `/v3/users/376501a630254fc5ba967a3605d751f1` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:51:10.863672 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b70b8d9-e1bb-4426-a3fa-ae87fee32b37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=376501a630254fc5ba967a3605d751f1)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:51:10.865673 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b70b8d9-e1bb-4426-a3fa-ae87fee32b37 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:51:11.056888 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f9079-375d-4981-a0c9-519209a47d53 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:51:11.058491 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-d08f9079-375d-4981-a0c9-519209a47d53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:51:11.078220 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f9079-375d-4981-a0c9-519209a47d53 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:51:11.083439 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33d305-4e0c-4d2f-82ab-1cd3b5f1c227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:51:11.084473 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33d305-4e0c-4d2f-82ab-1cd3b5f1c227 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:51:11.084648 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33d305-4e0c-4d2f-82ab-1cd3b5f1c227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:51:11.084873 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33d305-4e0c-4d2f-82ab-1cd3b5f1c227 admin admin] PATH_INFO: `/v3/projects/71bfca411eb247919cb96f32090af597` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:51:11.091701 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f33d305-4e0c-4d2f-82ab-1cd3b5f1c227 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71bfca411eb247919cb96f32090af597)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:51:11.091701 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f33d305-4e0c-4d2f-82ab-1cd3b5f1c227 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:51:11.143406 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-4b70b8d9-e1bb-4426-a3fa-ae87fee32b37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '376501a630254fc5ba967a3605d751f1'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:11.231452 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-4b70b8d9-e1bb-4426-a3fa-ae87fee32b37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '376501a630254fc5ba967a3605d751f1'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:11.232843 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-4b70b8d9-e1bb-4426-a3fa-ae87fee32b37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '376501a630254fc5ba967a3605d751f1'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:11.251323 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-4b70b8d9-e1bb-4426-a3fa-ae87fee32b37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '376501a630254fc5ba967a3605d751f1'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:11.259340 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-4b70b8d9-e1bb-4426-a3fa-ae87fee32b37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '376501a630254fc5ba967a3605d751f1'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:11.261380 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-0f33d305-4e0c-4d2f-82ab-1cd3b5f1c227 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71bfca411eb247919cb96f32090af597', 'request_id': 'req-0f33d305-4e0c-4d2f-82ab-1cd3b5f1c227'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:11.266611 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1435/2836] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:51:10 2022] DELETE /identity/v3/users/376501a630254fc5ba967a3605d751f1 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:51:11.281848 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-0f33d305-4e0c-4d2f-82ab-1cd3b5f1c227 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71bfca411eb247919cb96f32090af597', 'request_id': 'req-0f33d305-4e0c-4d2f-82ab-1cd3b5f1c227'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:11.289589 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-0f33d305-4e0c-4d2f-82ab-1cd3b5f1c227 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71bfca411eb247919cb96f32090af597', 'request_id': 'req-0f33d305-4e0c-4d2f-82ab-1cd3b5f1c227'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:11.386993 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-0f33d305-4e0c-4d2f-82ab-1cd3b5f1c227 admin admin] The token cache is being invalidate because project 71bfca411eb247919cb96f32090af597 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:51:11.387561 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-0f33d305-4e0c-4d2f-82ab-1cd3b5f1c227 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:11.388723 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-0f33d305-4e0c-4d2f-82ab-1cd3b5f1c227 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:11.390499 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1402/2837] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:51:11 2022] DELETE /identity/v3/projects/71bfca411eb247919cb96f32090af597 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:51:11.394912 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b70b8d9-e1bb-4426-a3fa-ae87fee32b37 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:51:11.402117 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-4b70b8d9-e1bb-4426-a3fa-ae87fee32b37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:51:11.470480 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:51:11.489168 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b70b8d9-e1bb-4426-a3fa-ae87fee32b37 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:51:11.489168 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9027c41f-4052-4753-940c-75e20210d7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:51:11.489168 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9027c41f-4052-4753-940c-75e20210d7a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:51:11.489662 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9027c41f-4052-4753-940c-75e20210d7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:51:11.489662 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9027c41f-4052-4753-940c-75e20210d7a7 admin admin] PATH_INFO: `/v3/users/76070a9ff0084d3abeb31c22b08efa6a` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:51:11.490793 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9027c41f-4052-4753-940c-75e20210d7a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76070a9ff0084d3abeb31c22b08efa6a)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:51:11.493445 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9027c41f-4052-4753-940c-75e20210d7a7 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:51:11.659775 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33d305-4e0c-4d2f-82ab-1cd3b5f1c227 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:51:11.672813 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-0f33d305-4e0c-4d2f-82ab-1cd3b5f1c227 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:51:11.730530 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:51:11.753269 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33d305-4e0c-4d2f-82ab-1cd3b5f1c227 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:51:11.757838 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d53c2-23fd-4287-a34d-56cd45af2f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:51:11.758290 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d53c2-23fd-4287-a34d-56cd45af2f51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:51:11.758573 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d53c2-23fd-4287-a34d-56cd45af2f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:51:11.758846 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756d53c2-23fd-4287-a34d-56cd45af2f51 admin admin] PATH_INFO: `/v3/projects/22d6aeded571456b95969679ab5635cc` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:51:11.760086 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756d53c2-23fd-4287-a34d-56cd45af2f51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22d6aeded571456b95969679ab5635cc)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:51:11.762063 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756d53c2-23fd-4287-a34d-56cd45af2f51 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:51:11.889031 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-9027c41f-4052-4753-940c-75e20210d7a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76070a9ff0084d3abeb31c22b08efa6a'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:11.928292 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-756d53c2-23fd-4287-a34d-56cd45af2f51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22d6aeded571456b95969679ab5635cc', 'request_id': 'req-756d53c2-23fd-4287-a34d-56cd45af2f51'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:11.935052 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-756d53c2-23fd-4287-a34d-56cd45af2f51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22d6aeded571456b95969679ab5635cc', 'request_id': 'req-756d53c2-23fd-4287-a34d-56cd45af2f51'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:11.940656 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-756d53c2-23fd-4287-a34d-56cd45af2f51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22d6aeded571456b95969679ab5635cc', 'request_id': 'req-756d53c2-23fd-4287-a34d-56cd45af2f51'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:12.088296 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-9027c41f-4052-4753-940c-75e20210d7a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76070a9ff0084d3abeb31c22b08efa6a'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:12.089192 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-9027c41f-4052-4753-940c-75e20210d7a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76070a9ff0084d3abeb31c22b08efa6a'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:12.103169 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-9027c41f-4052-4753-940c-75e20210d7a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76070a9ff0084d3abeb31c22b08efa6a'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:12.110246 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-9027c41f-4052-4753-940c-75e20210d7a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76070a9ff0084d3abeb31c22b08efa6a'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:12.117298 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1436/2838] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:51:11 2022] DELETE /identity/v3/users/76070a9ff0084d3abeb31c22b08efa6a => generated 0 bytes in 723 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:51:12.182609 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-756d53c2-23fd-4287-a34d-56cd45af2f51 admin admin] The token cache is being invalidate because project 22d6aeded571456b95969679ab5635cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:51:12.182908 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-756d53c2-23fd-4287-a34d-56cd45af2f51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:12.183572 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-756d53c2-23fd-4287-a34d-56cd45af2f51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:12.185213 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1403/2839] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:51:11 2022] DELETE /identity/v3/projects/22d6aeded571456b95969679ab5635cc => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:51:12.430559 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2a783-0fc6-468f-8652-d8f3b79cd4da None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:51:12.430845 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2a783-0fc6-468f-8652-d8f3b79cd4da None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:51:12.431146 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2a783-0fc6-468f-8652-d8f3b79cd4da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:51:12.449678 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-e8a2a783-0fc6-468f-8652-d8f3b79cd4da None None] MFA Rules not processed for user `3288eb1237b34763ac85f851863dc5e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:51:12.450916 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-e8a2a783-0fc6-468f-8652-d8f3b79cd4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:51:12.458623 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d53c2-23fd-4287-a34d-56cd45af2f51 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:51:12.460828 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-756d53c2-23fd-4287-a34d-56cd45af2f51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:51:12.510816 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1437/2840] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:51:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:51:12.535755 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756d53c2-23fd-4287-a34d-56cd45af2f51 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:51:12.600441 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81d0387-9991-4e78-8861-9b13d769baa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:51:12.605597 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d0387-9991-4e78-8861-9b13d769baa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:51:12.605597 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d0387-9991-4e78-8861-9b13d769baa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:51:12.605597 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d0387-9991-4e78-8861-9b13d769baa5 admin admin] PATH_INFO: `/v3/projects/7c71ba2938b5498a9f79f552eba2551c` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:51:12.605597 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81d0387-9991-4e78-8861-9b13d769baa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c71ba2938b5498a9f79f552eba2551c)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:51:12.605597 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81d0387-9991-4e78-8861-9b13d769baa5 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:51:12.777640 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c81d0387-9991-4e78-8861-9b13d769baa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c71ba2938b5498a9f79f552eba2551c', 'request_id': 'req-c81d0387-9991-4e78-8861-9b13d769baa5'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:12.783909 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c81d0387-9991-4e78-8861-9b13d769baa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c71ba2938b5498a9f79f552eba2551c', 'request_id': 'req-c81d0387-9991-4e78-8861-9b13d769baa5'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:12.791175 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c81d0387-9991-4e78-8861-9b13d769baa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c71ba2938b5498a9f79f552eba2551c', 'request_id': 'req-c81d0387-9991-4e78-8861-9b13d769baa5'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:12.925200 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c81d0387-9991-4e78-8861-9b13d769baa5 admin admin] The token cache is being invalidate because project 7c71ba2938b5498a9f79f552eba2551c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:51:12.925491 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c81d0387-9991-4e78-8861-9b13d769baa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:12.926127 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c81d0387-9991-4e78-8861-9b13d769baa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:51:12.927675 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1404/2841] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:51:12 2022] DELETE /identity/v3/projects/7c71ba2938b5498a9f79f552eba2551c => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:51:13.174393 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:51:22.960134 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=54,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:51:23.539267 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:DELETE=7,keystone:SELECT=15,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:52:05.689271 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a2a783-0fc6-468f-8652-d8f3b79cd4da None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:52:05.690828 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-e8a2a783-0fc6-468f-8652-d8f3b79cd4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:52:05.779973 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a2a783-0fc6-468f-8652-d8f3b79cd4da None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:52:05.830657 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1834eb-149b-4e4a-b68c-6ccd60868510 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:52:05.831313 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1834eb-149b-4e4a-b68c-6ccd60868510 service neutron] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:52:05.831591 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1834eb-149b-4e4a-b68c-6ccd60868510 service neutron] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:52:05.831867 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1834eb-149b-4e4a-b68c-6ccd60868510 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:52:05.833729 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-ab1834eb-149b-4e4a-b68c-6ccd60868510 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:52:05.916114 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1834eb-149b-4e4a-b68c-6ccd60868510 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:52:05.917508 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1834eb-149b-4e4a-b68c-6ccd60868510 service neutron] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:52:05.937645 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1438/2842] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:52:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:52:14.215721 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88224f73-2053-47de-99c3-09b14dbc0d09 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:52:14.216268 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88224f73-2053-47de-99c3-09b14dbc0d09 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:52:14.216268 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88224f73-2053-47de-99c3-09b14dbc0d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:52:14.234360 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-88224f73-2053-47de-99c3-09b14dbc0d09 None None] MFA Rules not processed for user `3288eb1237b34763ac85f851863dc5e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:52:14.235563 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-88224f73-2053-47de-99c3-09b14dbc0d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:52:14.288855 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1405/2843] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:52:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:52:15.046808 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1834eb-149b-4e4a-b68c-6ccd60868510 service neutron] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:52:15.048318 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-ab1834eb-149b-4e4a-b68c-6ccd60868510 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:52:15.059300 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1834eb-149b-4e4a-b68c-6ccd60868510 service neutron] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:52:15.062972 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1e1416-881e-480b-bb26-a6f23ef1ae04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:52:15.063613 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e1416-881e-480b-bb26-a6f23ef1ae04 service neutron] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:52:15.063897 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e1416-881e-480b-bb26-a6f23ef1ae04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:52:15.064173 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e1416-881e-480b-bb26-a6f23ef1ae04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:52:15.066151 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-af1e1416-881e-480b-bb26-a6f23ef1ae04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:52:15.081584 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1e1416-881e-480b-bb26-a6f23ef1ae04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:52:15.083325 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1e1416-881e-480b-bb26-a6f23ef1ae04 service neutron] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:52:15.097421 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1439/2844] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:52:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:52:24.282289 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=25 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:52:25.092199 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=98 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:52:26.464873 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88224f73-2053-47de-99c3-09b14dbc0d09 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:52:26.474481 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88224f73-2053-47de-99c3-09b14dbc0d09 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:52:26.478831 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e7fde-99dd-47c8-8dc1-c60974f3668a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:52:26.479474 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e7fde-99dd-47c8-8dc1-c60974f3668a service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:52:26.479753 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e7fde-99dd-47c8-8dc1-c60974f3668a service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:52:26.480030 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e7fde-99dd-47c8-8dc1-c60974f3668a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:52:26.481981 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-8e2e7fde-99dd-47c8-8dc1-c60974f3668a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:52:26.492176 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e7fde-99dd-47c8-8dc1-c60974f3668a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:52:26.494381 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e7fde-99dd-47c8-8dc1-c60974f3668a service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:52:26.502700 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1406/2845] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:52:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:52:36.498905 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=6 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:53:25.987521 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1e1416-881e-480b-bb26-a6f23ef1ae04 service neutron] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:25.989064 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-af1e1416-881e-480b-bb26-a6f23ef1ae04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:53:26.059487 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1e1416-881e-480b-bb26-a6f23ef1ae04 service neutron] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:26.065649 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a6304-ca97-4fe7-9532-3c816f47be5d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2330638e80a941cd9aeeb2fd615900d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:26.066305 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a6304-ca97-4fe7-9532-3c816f47be5d service placement] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:26.066593 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a6304-ca97-4fe7-9532-3c816f47be5d service placement] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:26.066940 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a6304-ca97-4fe7-9532-3c816f47be5d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:26.068797 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-697a6304-ca97-4fe7-9532-3c816f47be5d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:53:26.081644 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697a6304-ca97-4fe7-9532-3c816f47be5d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:26.083223 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697a6304-ca97-4fe7-9532-3c816f47be5d service placement] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:26.098276 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1440/2846] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:53:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:53:26.099019 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e7fde-99dd-47c8-8dc1-c60974f3668a service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:26.101409 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-8e2e7fde-99dd-47c8-8dc1-c60974f3668a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:53:26.181279 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e7fde-99dd-47c8-8dc1-c60974f3668a service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:26.186665 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f63aa3-410f-4452-8c08-6e7605ffa6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:26.187601 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f63aa3-410f-4452-8c08-6e7605ffa6f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:26.187889 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f63aa3-410f-4452-8c08-6e7605ffa6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:26.188199 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f63aa3-410f-4452-8c08-6e7605ffa6f8 admin admin] PATH_INFO: `/v3/users/3288eb1237b34763ac85f851863dc5e0` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:26.189465 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f63aa3-410f-4452-8c08-6e7605ffa6f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3288eb1237b34763ac85f851863dc5e0)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:26.191389 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f63aa3-410f-4452-8c08-6e7605ffa6f8 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:26.379409 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-41f63aa3-410f-4452-8c08-6e7605ffa6f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3288eb1237b34763ac85f851863dc5e0'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:53:26.452379 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-41f63aa3-410f-4452-8c08-6e7605ffa6f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3288eb1237b34763ac85f851863dc5e0'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:53:26.453065 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-41f63aa3-410f-4452-8c08-6e7605ffa6f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3288eb1237b34763ac85f851863dc5e0'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:53:26.465956 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-41f63aa3-410f-4452-8c08-6e7605ffa6f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3288eb1237b34763ac85f851863dc5e0'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:53:26.472918 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-41f63aa3-410f-4452-8c08-6e7605ffa6f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3288eb1237b34763ac85f851863dc5e0'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:53:26.478875 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1407/2847] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:53:26 2022] DELETE /identity/v3/users/3288eb1237b34763ac85f851863dc5e0 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:53:26.489208 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a6304-ca97-4fe7-9532-3c816f47be5d service placement] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:26.499364 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a6304-ca97-4fe7-9532-3c816f47be5d service placement] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:26.549456 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bc84ba-b770-4bf0-a983-a51f321ee8df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:26.550111 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc84ba-b770-4bf0-a983-a51f321ee8df service neutron] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:26.550395 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc84ba-b770-4bf0-a983-a51f321ee8df service neutron] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:26.550670 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc84ba-b770-4bf0-a983-a51f321ee8df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:26.552484 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-49bc84ba-b770-4bf0-a983-a51f321ee8df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:53:26.615183 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bc84ba-b770-4bf0-a983-a51f321ee8df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:26.616608 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bc84ba-b770-4bf0-a983-a51f321ee8df service neutron] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:26.626572 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1441/2848] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:53:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:53:26.928543 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f63aa3-410f-4452-8c08-6e7605ffa6f8 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:26.930027 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-41f63aa3-410f-4452-8c08-6e7605ffa6f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:53:26.943742 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f63aa3-410f-4452-8c08-6e7605ffa6f8 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:26.948379 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0db692-0d70-4812-b510-d0bd654f5f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:26.949274 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0db692-0d70-4812-b510-d0bd654f5f86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:26.949556 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0db692-0d70-4812-b510-d0bd654f5f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:26.949833 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0db692-0d70-4812-b510-d0bd654f5f86 admin admin] PATH_INFO: `/v3/projects/1636e286cab74f189f57e10f730a379e` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:26.951021 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0db692-0d70-4812-b510-d0bd654f5f86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1636e286cab74f189f57e10f730a379e)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:26.953523 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0db692-0d70-4812-b510-d0bd654f5f86 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:27.100257 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-eb0db692-0d70-4812-b510-d0bd654f5f86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1636e286cab74f189f57e10f730a379e', 'request_id': 'req-eb0db692-0d70-4812-b510-d0bd654f5f86'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:53:27.107860 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-eb0db692-0d70-4812-b510-d0bd654f5f86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1636e286cab74f189f57e10f730a379e', 'request_id': 'req-eb0db692-0d70-4812-b510-d0bd654f5f86'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:53:27.114236 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-eb0db692-0d70-4812-b510-d0bd654f5f86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1636e286cab74f189f57e10f730a379e', 'request_id': 'req-eb0db692-0d70-4812-b510-d0bd654f5f86'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:53:27.206484 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-eb0db692-0d70-4812-b510-d0bd654f5f86 admin admin] The token cache is being invalidate because project 1636e286cab74f189f57e10f730a379e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:53:27.206781 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-eb0db692-0d70-4812-b510-d0bd654f5f86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:53:27.207409 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-eb0db692-0d70-4812-b510-d0bd654f5f86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:53:27.208974 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1408/2849] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:53:26 2022] DELETE /identity/v3/projects/1636e286cab74f189f57e10f730a379e => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 10:53:27.213888 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289db73-1c46-455f-9267-d1458829267a None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:27.214383 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289db73-1c46-455f-9267-d1458829267a None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:27.214499 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9289db73-1c46-455f-9267-d1458829267a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:27.233422 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-9289db73-1c46-455f-9267-d1458829267a None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:53:27.234642 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-9289db73-1c46-455f-9267-d1458829267a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:53:27.269701 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:53:27.295781 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1442/2850] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:53:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:53:27.303688 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8eb68-0510-4cd4-a46a-8b9aeb3f71f9 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:27.303980 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8eb68-0510-4cd4-a46a-8b9aeb3f71f9 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:27.304260 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8eb68-0510-4cd4-a46a-8b9aeb3f71f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:27.310929 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:53:27.323861 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-37c8eb68-0510-4cd4-a46a-8b9aeb3f71f9 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:53:27.325224 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-37c8eb68-0510-4cd4-a46a-8b9aeb3f71f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:53:27.334367 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1409/2851] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:53:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:53:27.338792 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9289db73-1c46-455f-9267-d1458829267a None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:27.349429 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9289db73-1c46-455f-9267-d1458829267a None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:27.354118 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6def1c-5d9e-4af8-b43a-67f5401da83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:27.358800 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6def1c-5d9e-4af8-b43a-67f5401da83d admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:27.358800 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6def1c-5d9e-4af8-b43a-67f5401da83d admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:27.358800 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6def1c-5d9e-4af8-b43a-67f5401da83d admin admin] PATH_INFO: `/v3/domains` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:27.358800 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6def1c-5d9e-4af8-b43a-67f5401da83d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:53:27.358800 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6def1c-5d9e-4af8-b43a-67f5401da83d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:27.358800 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6def1c-5d9e-4af8-b43a-67f5401da83d admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:27.371271 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1443/2852] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 10:53:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:53:27.376156 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c8eb68-0510-4cd4-a46a-8b9aeb3f71f9 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:27.386147 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c8eb68-0510-4cd4-a46a-8b9aeb3f71f9 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:27.391860 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4601c07a-364b-4aaf-8cef-fe8a9c116686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:27.393175 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601c07a-364b-4aaf-8cef-fe8a9c116686 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:27.393175 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601c07a-364b-4aaf-8cef-fe8a9c116686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:27.393175 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601c07a-364b-4aaf-8cef-fe8a9c116686 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:27.393726 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4601c07a-364b-4aaf-8cef-fe8a9c116686 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:27.395615 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4601c07a-364b-4aaf-8cef-fe8a9c116686 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:27.510551 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1410/2853] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:53:27 2022] POST /identity/v3/projects => generated 383 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:53:27.515320 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6def1c-5d9e-4af8-b43a-67f5401da83d admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:27.525372 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6def1c-5d9e-4af8-b43a-67f5401da83d admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:27.582419 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca39955a-7857-4da2-ac48-7bea8d13e8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:27.583087 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca39955a-7857-4da2-ac48-7bea8d13e8cd admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:27.583372 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca39955a-7857-4da2-ac48-7bea8d13e8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:27.583647 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca39955a-7857-4da2-ac48-7bea8d13e8cd admin admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:27.584340 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca39955a-7857-4da2-ac48-7bea8d13e8cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:27.586276 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca39955a-7857-4da2-ac48-7bea8d13e8cd admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:27.704407 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1444/2854] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:53:27 2022] POST /identity/v3/users => generated 292 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:53:27.708884 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4601c07a-364b-4aaf-8cef-fe8a9c116686 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:27.719510 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4601c07a-364b-4aaf-8cef-fe8a9c116686 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:27.724034 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89690c6a-59fc-4c1b-8bba-6a418b7e4a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:27.724731 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89690c6a-59fc-4c1b-8bba-6a418b7e4a5c admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:27.725012 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89690c6a-59fc-4c1b-8bba-6a418b7e4a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:27.725320 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89690c6a-59fc-4c1b-8bba-6a418b7e4a5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:27.726035 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89690c6a-59fc-4c1b-8bba-6a418b7e4a5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:27.727618 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89690c6a-59fc-4c1b-8bba-6a418b7e4a5c admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:27.737933 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1411/2855] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:53:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:53:27.741883 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca39955a-7857-4da2-ac48-7bea8d13e8cd admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:27.752670 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca39955a-7857-4da2-ac48-7bea8d13e8cd admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:27.757311 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f492b-5c3c-451a-a438-ca764e89cb58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:27.757965 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f492b-5c3c-451a-a438-ca764e89cb58 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:27.758246 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f492b-5c3c-451a-a438-ca764e89cb58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:27.758517 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f492b-5c3c-451a-a438-ca764e89cb58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:27.759233 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4f492b-5c3c-451a-a438-ca764e89cb58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:27.760865 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4f492b-5c3c-451a-a438-ca764e89cb58 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:27.771834 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1445/2856] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:53:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:53:27.776002 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89690c6a-59fc-4c1b-8bba-6a418b7e4a5c admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:27.786210 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89690c6a-59fc-4c1b-8bba-6a418b7e4a5c admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:27.791188 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e8d721-9c13-4299-a241-4be4aea7a110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:27.796015 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8d721-9c13-4299-a241-4be4aea7a110 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:27.796015 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8d721-9c13-4299-a241-4be4aea7a110 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:27.796015 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8d721-9c13-4299-a241-4be4aea7a110 admin admin] PATH_INFO: `/v3/projects/c7afb898ff94475a9f3832f62e888f51/users/4c6cb052975c42bfa81fff6dd2d4f0a0/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:27.807984 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e8d721-9c13-4299-a241-4be4aea7a110 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7afb898ff94475a9f3832f62e888f51, user_id=4c6cb052975c42bfa81fff6dd2d4f0a0, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:27.811478 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e8d721-9c13-4299-a241-4be4aea7a110 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:27.915373 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1412/2857] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:53:27 2022] PUT /identity/v3/projects/c7afb898ff94475a9f3832f62e888f51/users/4c6cb052975c42bfa81fff6dd2d4f0a0/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:53:27.926701 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1866dd9-d656-46d3-a14c-2cd346602def None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:27.927000 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1866dd9-d656-46d3-a14c-2cd346602def None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:27.927280 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1866dd9-d656-46d3-a14c-2cd346602def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:27.955713 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-d1866dd9-d656-46d3-a14c-2cd346602def None None] MFA Rules not processed for user `4c6cb052975c42bfa81fff6dd2d4f0a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:53:27.956938 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-d1866dd9-d656-46d3-a14c-2cd346602def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:53:28.022940 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1446/2858] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:53:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:53:28.034582 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e8d721-9c13-4299-a241-4be4aea7a110 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:28.036320 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-34e8d721-9c13-4299-a241-4be4aea7a110 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:53:28.111956 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e8d721-9c13-4299-a241-4be4aea7a110 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:28.117754 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad198a05-bf73-41d2-8bd5-01d81d86a6ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bbebf16219943879df84bdc9a900516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:28.118402 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad198a05-bf73-41d2-8bd5-01d81d86a6ef service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:28.118686 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad198a05-bf73-41d2-8bd5-01d81d86a6ef service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:28.118967 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad198a05-bf73-41d2-8bd5-01d81d86a6ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:28.127619 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad198a05-bf73-41d2-8bd5-01d81d86a6ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:28.129190 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad198a05-bf73-41d2-8bd5-01d81d86a6ef service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:28.138022 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1413/2859] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:53:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:53:34.219510 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1866dd9-d656-46d3-a14c-2cd346602def None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:34.258266 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:53:34.281609 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1866dd9-d656-46d3-a14c-2cd346602def None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:34.287739 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bdbdd5-c500-4b5c-bd68-93481f86566e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:34.288621 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bdbdd5-c500-4b5c-bd68-93481f86566e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:34.288907 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bdbdd5-c500-4b5c-bd68-93481f86566e admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:34.289220 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bdbdd5-c500-4b5c-bd68-93481f86566e admin admin] PATH_INFO: `/v3/users/4c6cb052975c42bfa81fff6dd2d4f0a0` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:34.290662 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bdbdd5-c500-4b5c-bd68-93481f86566e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c6cb052975c42bfa81fff6dd2d4f0a0)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:34.292603 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bdbdd5-c500-4b5c-bd68-93481f86566e admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:34.465428 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-a8bdbdd5-c500-4b5c-bd68-93481f86566e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c6cb052975c42bfa81fff6dd2d4f0a0'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:53:34.537009 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-a8bdbdd5-c500-4b5c-bd68-93481f86566e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c6cb052975c42bfa81fff6dd2d4f0a0'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:53:34.537749 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-a8bdbdd5-c500-4b5c-bd68-93481f86566e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c6cb052975c42bfa81fff6dd2d4f0a0'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:53:34.551464 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-a8bdbdd5-c500-4b5c-bd68-93481f86566e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c6cb052975c42bfa81fff6dd2d4f0a0'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:53:34.558461 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-a8bdbdd5-c500-4b5c-bd68-93481f86566e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c6cb052975c42bfa81fff6dd2d4f0a0'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:53:34.564523 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1447/2860] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:53:34 2022] DELETE /identity/v3/users/4c6cb052975c42bfa81fff6dd2d4f0a0 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:53:34.569054 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c7c875-743b-4439-bc32-e9bc3f07552c None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:34.569540 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c7c875-743b-4439-bc32-e9bc3f07552c None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:34.569655 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c7c875-743b-4439-bc32-e9bc3f07552c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:34.588315 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-f5c7c875-743b-4439-bc32-e9bc3f07552c None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:53:34.589556 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-f5c7c875-743b-4439-bc32-e9bc3f07552c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:53:34.651174 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1414/2861] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:53:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:53:34.664616 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bdbdd5-c500-4b5c-bd68-93481f86566e admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:34.666507 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-a8bdbdd5-c500-4b5c-bd68-93481f86566e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:53:34.723803 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bdbdd5-c500-4b5c-bd68-93481f86566e admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:34.727344 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d2c7ec-e68c-4bf1-a403-be490c6a2720 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:34.727984 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2c7ec-e68c-4bf1-a403-be490c6a2720 service neutron] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:34.728264 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2c7ec-e68c-4bf1-a403-be490c6a2720 service neutron] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:34.728535 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2c7ec-e68c-4bf1-a403-be490c6a2720 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:34.737469 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d2c7ec-e68c-4bf1-a403-be490c6a2720 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:34.738885 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d2c7ec-e68c-4bf1-a403-be490c6a2720 service neutron] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:34.748195 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1448/2862] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:53:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:53:35.168012 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c7c875-743b-4439-bc32-e9bc3f07552c None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:35.170134 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-f5c7c875-743b-4439-bc32-e9bc3f07552c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:53:35.190295 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c7c875-743b-4439-bc32-e9bc3f07552c None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:35.196270 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199d8a8b-7f63-43e7-a6f6-5b89888541b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:35.197079 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d8a8b-7f63-43e7-a6f6-5b89888541b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:35.197391 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d8a8b-7f63-43e7-a6f6-5b89888541b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:35.197625 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d8a8b-7f63-43e7-a6f6-5b89888541b8 admin admin] PATH_INFO: `/v3/projects/c7afb898ff94475a9f3832f62e888f51` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:35.198799 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199d8a8b-7f63-43e7-a6f6-5b89888541b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7afb898ff94475a9f3832f62e888f51)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:35.200690 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199d8a8b-7f63-43e7-a6f6-5b89888541b8 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:35.212038 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:53:35.326812 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-199d8a8b-7f63-43e7-a6f6-5b89888541b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7afb898ff94475a9f3832f62e888f51', 'request_id': 'req-199d8a8b-7f63-43e7-a6f6-5b89888541b8'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:53:35.333710 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-199d8a8b-7f63-43e7-a6f6-5b89888541b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7afb898ff94475a9f3832f62e888f51', 'request_id': 'req-199d8a8b-7f63-43e7-a6f6-5b89888541b8'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:53:35.339355 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-199d8a8b-7f63-43e7-a6f6-5b89888541b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7afb898ff94475a9f3832f62e888f51', 'request_id': 'req-199d8a8b-7f63-43e7-a6f6-5b89888541b8'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:53:35.422751 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-199d8a8b-7f63-43e7-a6f6-5b89888541b8 admin admin] The token cache is being invalidate because project c7afb898ff94475a9f3832f62e888f51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:53:35.423098 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-199d8a8b-7f63-43e7-a6f6-5b89888541b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:53:35.423693 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-199d8a8b-7f63-43e7-a6f6-5b89888541b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:53:35.425378 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1415/2863] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:53:35 2022] DELETE /identity/v3/projects/c7afb898ff94475a9f3832f62e888f51 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:53:35.431130 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094fde2-e892-4d02-9342-e5e8f2cb47a8 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:35.431634 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094fde2-e892-4d02-9342-e5e8f2cb47a8 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:35.431733 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094fde2-e892-4d02-9342-e5e8f2cb47a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:35.449247 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-0094fde2-e892-4d02-9342-e5e8f2cb47a8 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:53:35.450480 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-0094fde2-e892-4d02-9342-e5e8f2cb47a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:53:35.501331 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:53:35.510455 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1449/2864] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:53:35.519474 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea30bee-53ba-4c1d-a74d-9027412ac8d4 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:35.519791 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea30bee-53ba-4c1d-a74d-9027412ac8d4 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:35.520098 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea30bee-53ba-4c1d-a74d-9027412ac8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:35.539232 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-3ea30bee-53ba-4c1d-a74d-9027412ac8d4 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:53:35.540694 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-3ea30bee-53ba-4c1d-a74d-9027412ac8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:53:35.549062 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1416/2865] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:53:35.553531 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0094fde2-e892-4d02-9342-e5e8f2cb47a8 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:35.563023 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0094fde2-e892-4d02-9342-e5e8f2cb47a8 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:35.568470 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0d5474-d923-4dcd-8d32-b5af0d7ba8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:35.569170 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d5474-d923-4dcd-8d32-b5af0d7ba8ce admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:35.569460 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d5474-d923-4dcd-8d32-b5af0d7ba8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:35.569753 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d5474-d923-4dcd-8d32-b5af0d7ba8ce admin admin] PATH_INFO: `/v3/domains` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:35.570502 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0d5474-d923-4dcd-8d32-b5af0d7ba8ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80392) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:53:35.570814 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0d5474-d923-4dcd-8d32-b5af0d7ba8ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:35.572414 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0d5474-d923-4dcd-8d32-b5af0d7ba8ce admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:35.586007 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1450/2866] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 10:53:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:53:35.590226 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea30bee-53ba-4c1d-a74d-9027412ac8d4 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:35.600622 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea30bee-53ba-4c1d-a74d-9027412ac8d4 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:35.605260 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42701b6-4c57-449a-9c56-0fa7057a3fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:35.605908 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42701b6-4c57-449a-9c56-0fa7057a3fc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:35.606186 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42701b6-4c57-449a-9c56-0fa7057a3fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:35.606461 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42701b6-4c57-449a-9c56-0fa7057a3fc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:35.607202 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42701b6-4c57-449a-9c56-0fa7057a3fc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:35.609116 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42701b6-4c57-449a-9c56-0fa7057a3fc6 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:35.681445 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1417/2867] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:53:35 2022] POST /identity/v3/projects => generated 387 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:53:35.685458 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0d5474-d923-4dcd-8d32-b5af0d7ba8ce admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:35.697276 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0d5474-d923-4dcd-8d32-b5af0d7ba8ce admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:35.754859 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7584aa97-4536-422a-8d90-7bfe4db0e18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:35.755529 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584aa97-4536-422a-8d90-7bfe4db0e18a admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:35.755814 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584aa97-4536-422a-8d90-7bfe4db0e18a admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:35.756091 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584aa97-4536-422a-8d90-7bfe4db0e18a admin admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:35.756784 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7584aa97-4536-422a-8d90-7bfe4db0e18a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:35.758787 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7584aa97-4536-422a-8d90-7bfe4db0e18a admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:35.857692 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1451/2868] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:53:35 2022] POST /identity/v3/users => generated 294 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:53:35.861768 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42701b6-4c57-449a-9c56-0fa7057a3fc6 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:35.873444 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42701b6-4c57-449a-9c56-0fa7057a3fc6 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:35.879405 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4618679-1063-4da8-ba46-2594b0a1133c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:35.880074 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4618679-1063-4da8-ba46-2594b0a1133c admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:35.880360 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4618679-1063-4da8-ba46-2594b0a1133c admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:35.880648 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4618679-1063-4da8-ba46-2594b0a1133c admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:35.881402 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4618679-1063-4da8-ba46-2594b0a1133c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:35.883043 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4618679-1063-4da8-ba46-2594b0a1133c admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:35.895677 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1418/2869] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:53:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:53:35.899735 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7584aa97-4536-422a-8d90-7bfe4db0e18a admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:35.909938 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7584aa97-4536-422a-8d90-7bfe4db0e18a admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:35.914565 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74016fd-b53e-41bc-b517-eabad4baccf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:35.915250 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74016fd-b53e-41bc-b517-eabad4baccf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:35.915790 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74016fd-b53e-41bc-b517-eabad4baccf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:35.916061 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74016fd-b53e-41bc-b517-eabad4baccf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:35.916780 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74016fd-b53e-41bc-b517-eabad4baccf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:35.918505 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74016fd-b53e-41bc-b517-eabad4baccf8 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:35.928955 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1452/2870] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:53:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:53:35.933296 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4618679-1063-4da8-ba46-2594b0a1133c admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:35.944078 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4618679-1063-4da8-ba46-2594b0a1133c admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:35.948744 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3baa5e-68cd-43cf-8b2f-8c673fbd24be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:35.949652 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3baa5e-68cd-43cf-8b2f-8c673fbd24be admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:35.949931 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3baa5e-68cd-43cf-8b2f-8c673fbd24be admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:35.950209 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3baa5e-68cd-43cf-8b2f-8c673fbd24be admin admin] PATH_INFO: `/v3/projects/93a3f8eca16e4446af86e0a1e73dedc0/users/149743e863e6493dbee5e043912bd9e5/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:35.965792 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3baa5e-68cd-43cf-8b2f-8c673fbd24be admin admin] RBAC: Authorizing `identity:create_grant(project_id=93a3f8eca16e4446af86e0a1e73dedc0, user_id=149743e863e6493dbee5e043912bd9e5, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:35.968623 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3baa5e-68cd-43cf-8b2f-8c673fbd24be admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:36.045706 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1419/2871] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:53:35 2022] PUT /identity/v3/projects/93a3f8eca16e4446af86e0a1e73dedc0/users/149743e863e6493dbee5e043912bd9e5/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:53:36.056530 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007c491-3f50-445f-956f-fea566ce034c None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:36.056822 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007c491-3f50-445f-956f-fea566ce034c None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:36.057129 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007c491-3f50-445f-956f-fea566ce034c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:36.085398 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-5007c491-3f50-445f-956f-fea566ce034c None None] MFA Rules not processed for user `149743e863e6493dbee5e043912bd9e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:53:36.086639 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-5007c491-3f50-445f-956f-fea566ce034c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:53:36.152923 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1453/2872] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:53:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:53:36.161099 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3baa5e-68cd-43cf-8b2f-8c673fbd24be admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:36.222568 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3baa5e-68cd-43cf-8b2f-8c673fbd24be admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:36.227311 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85974aa8-a6ae-432f-8888-7e9dfecb9196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:36.227973 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85974aa8-a6ae-432f-8888-7e9dfecb9196 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:36.228250 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85974aa8-a6ae-432f-8888-7e9dfecb9196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:36.228526 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85974aa8-a6ae-432f-8888-7e9dfecb9196 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:36.229241 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85974aa8-a6ae-432f-8888-7e9dfecb9196 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:36.231129 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85974aa8-a6ae-432f-8888-7e9dfecb9196 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:36.350278 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1420/2873] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:53:36 2022] POST /identity/v3/projects => generated 387 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:53:36.354109 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5007c491-3f50-445f-956f-fea566ce034c None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:36.365718 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5007c491-3f50-445f-956f-fea566ce034c None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:36.413772 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:53:36.422676 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ff6c1-4fd5-4fe9-afb7-b5f1bbce4259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:36.423349 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ff6c1-4fd5-4fe9-afb7-b5f1bbce4259 admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:36.424223 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ff6c1-4fd5-4fe9-afb7-b5f1bbce4259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:36.424517 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ff6c1-4fd5-4fe9-afb7-b5f1bbce4259 admin admin] PATH_INFO: `/v3/users` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:36.425249 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87ff6c1-4fd5-4fe9-afb7-b5f1bbce4259 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:36.427175 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87ff6c1-4fd5-4fe9-afb7-b5f1bbce4259 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:36.520428 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1454/2874] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:53:36 2022] POST /identity/v3/users => generated 300 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 10:53:36.524590 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85974aa8-a6ae-432f-8888-7e9dfecb9196 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:36.534985 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85974aa8-a6ae-432f-8888-7e9dfecb9196 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:36.540873 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265120a-734d-4fa5-a29e-0fdf4fd577ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:36.541697 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265120a-734d-4fa5-a29e-0fdf4fd577ce admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:36.541977 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265120a-734d-4fa5-a29e-0fdf4fd577ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:36.542253 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265120a-734d-4fa5-a29e-0fdf4fd577ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:36.543009 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7265120a-734d-4fa5-a29e-0fdf4fd577ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:36.544595 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7265120a-734d-4fa5-a29e-0fdf4fd577ce admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:36.558042 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1421/2875] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:53:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:53:36.562257 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ff6c1-4fd5-4fe9-afb7-b5f1bbce4259 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:36.572448 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ff6c1-4fd5-4fe9-afb7-b5f1bbce4259 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:36.577512 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a4e77-0b93-446a-978b-a40fb0838adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:36.578494 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a4e77-0b93-446a-978b-a40fb0838adb admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:36.578815 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a4e77-0b93-446a-978b-a40fb0838adb admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:36.579129 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a4e77-0b93-446a-978b-a40fb0838adb admin admin] PATH_INFO: `/v3/projects/6b7bd96d5b4d427aaf6a211b20206ec8/users/52a9c0001c7e4826a77a8c5e5764199e/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:36.594677 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6a4e77-0b93-446a-978b-a40fb0838adb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b7bd96d5b4d427aaf6a211b20206ec8, user_id=52a9c0001c7e4826a77a8c5e5764199e, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:36.597918 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6a4e77-0b93-446a-978b-a40fb0838adb admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:36.720371 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1455/2876] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:53:36 2022] PUT /identity/v3/projects/6b7bd96d5b4d427aaf6a211b20206ec8/users/52a9c0001c7e4826a77a8c5e5764199e/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:53:36.724865 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265120a-734d-4fa5-a29e-0fdf4fd577ce admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:36.734846 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265120a-734d-4fa5-a29e-0fdf4fd577ce admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:36.740447 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:53:36.792442 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c156ec0a-e7e7-47b2-a4fd-bea487723880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:36.793153 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c156ec0a-e7e7-47b2-a4fd-bea487723880 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:36.793647 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c156ec0a-e7e7-47b2-a4fd-bea487723880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:36.794111 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c156ec0a-e7e7-47b2-a4fd-bea487723880 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:36.795223 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c156ec0a-e7e7-47b2-a4fd-bea487723880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:36.796861 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c156ec0a-e7e7-47b2-a4fd-bea487723880 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:36.806921 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1422/2877] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:53:36 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:53:36.811143 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a4e77-0b93-446a-978b-a40fb0838adb admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:36.821565 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a4e77-0b93-446a-978b-a40fb0838adb admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:36.826094 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bf0955-68d8-4c4d-b33f-207db766976e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:36.826977 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf0955-68d8-4c4d-b33f-207db766976e admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:36.827393 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf0955-68d8-4c4d-b33f-207db766976e admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:36.827670 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf0955-68d8-4c4d-b33f-207db766976e admin admin] PATH_INFO: `/v3/projects/6b7bd96d5b4d427aaf6a211b20206ec8/users/52a9c0001c7e4826a77a8c5e5764199e/roles/e7b6a55ecf6c491487955aaefbf9c388` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:36.829641 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bf0955-68d8-4c4d-b33f-207db766976e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b7bd96d5b4d427aaf6a211b20206ec8, user_id=52a9c0001c7e4826a77a8c5e5764199e, role_id=e7b6a55ecf6c491487955aaefbf9c388)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:36.832237 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bf0955-68d8-4c4d-b33f-207db766976e admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:36.843121 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1456/2878] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:53:36 2022] PUT /identity/v3/projects/6b7bd96d5b4d427aaf6a211b20206ec8/users/52a9c0001c7e4826a77a8c5e5764199e/roles/e7b6a55ecf6c491487955aaefbf9c388 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:53:36.855113 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da6319-b365-417c-8db9-2b50dba62dc7 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:36.855404 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da6319-b365-417c-8db9-2b50dba62dc7 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:36.855684 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da6319-b365-417c-8db9-2b50dba62dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:36.882512 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-06da6319-b365-417c-8db9-2b50dba62dc7 None None] MFA Rules not processed for user `52a9c0001c7e4826a77a8c5e5764199e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:53:36.883823 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-06da6319-b365-417c-8db9-2b50dba62dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:53:36.954290 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1423/2879] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:53:36 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:53:36.976016 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bf0955-68d8-4c4d-b33f-207db766976e admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:36.977704 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-a8bf0955-68d8-4c4d-b33f-207db766976e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:53:37.059301 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bf0955-68d8-4c4d-b33f-207db766976e admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:37.063029 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c387fff-e29b-46c3-933e-6537c2afe3ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:37.063670 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c387fff-e29b-46c3-933e-6537c2afe3ad service cinder] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:37.063949 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c387fff-e29b-46c3-933e-6537c2afe3ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:37.064222 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c387fff-e29b-46c3-933e-6537c2afe3ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:37.073482 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c387fff-e29b-46c3-933e-6537c2afe3ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:37.074892 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c387fff-e29b-46c3-933e-6537c2afe3ad service cinder] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:37.084542 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1457/2880] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:53:36 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:53:37.113591 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da6319-b365-417c-8db9-2b50dba62dc7 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:37.178010 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da6319-b365-417c-8db9-2b50dba62dc7 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:37.182649 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bbf172-589f-4ff6-82ea-983ed6a18dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:37.183530 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bbf172-589f-4ff6-82ea-983ed6a18dab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:37.183811 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bbf172-589f-4ff6-82ea-983ed6a18dab admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:37.184139 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bbf172-589f-4ff6-82ea-983ed6a18dab admin admin] PATH_INFO: `/v3/users/149743e863e6493dbee5e043912bd9e5` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:37.185396 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bbf172-589f-4ff6-82ea-983ed6a18dab admin admin] RBAC: Authorizing `identity:delete_user(user_id=149743e863e6493dbee5e043912bd9e5)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:37.187297 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bbf172-589f-4ff6-82ea-983ed6a18dab admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:37.401458 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:53:37.413635 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-18bbf172-589f-4ff6-82ea-983ed6a18dab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '149743e863e6493dbee5e043912bd9e5'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:53:37.536718 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-18bbf172-589f-4ff6-82ea-983ed6a18dab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '149743e863e6493dbee5e043912bd9e5'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:53:37.537376 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-18bbf172-589f-4ff6-82ea-983ed6a18dab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '149743e863e6493dbee5e043912bd9e5'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:53:37.550048 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-18bbf172-589f-4ff6-82ea-983ed6a18dab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '149743e863e6493dbee5e043912bd9e5'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:53:37.557817 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-18bbf172-589f-4ff6-82ea-983ed6a18dab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '149743e863e6493dbee5e043912bd9e5'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:53:37.563734 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1424/2881] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:53:37 2022] DELETE /identity/v3/users/149743e863e6493dbee5e043912bd9e5 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:53:37.569082 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a54616-4f76-456e-b058-2158a86961c6 None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:37.569629 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a54616-4f76-456e-b058-2158a86961c6 None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:37.569732 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a54616-4f76-456e-b058-2158a86961c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:37.586408 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-a1a54616-4f76-456e-b058-2158a86961c6 None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:53:37.587659 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-a1a54616-4f76-456e-b058-2158a86961c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:53:37.646527 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1458/2882] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:53:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:53:37.656396 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bbf172-589f-4ff6-82ea-983ed6a18dab admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:37.657887 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-18bbf172-589f-4ff6-82ea-983ed6a18dab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:53:37.717608 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bbf172-589f-4ff6-82ea-983ed6a18dab admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:37.721307 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddeb7aa-4385-4a1f-b3a4-d2e90cb50c37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:37.721949 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddeb7aa-4385-4a1f-b3a4-d2e90cb50c37 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:37.722228 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddeb7aa-4385-4a1f-b3a4-d2e90cb50c37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:37.722527 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddeb7aa-4385-4a1f-b3a4-d2e90cb50c37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:37.731459 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddeb7aa-4385-4a1f-b3a4-d2e90cb50c37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:37.732871 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddeb7aa-4385-4a1f-b3a4-d2e90cb50c37 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:37.743299 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1425/2883] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:53:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:53:38.327869 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a54616-4f76-456e-b058-2158a86961c6 None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:38.329340 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-a1a54616-4f76-456e-b058-2158a86961c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:53:38.342046 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a54616-4f76-456e-b058-2158a86961c6 None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:38.347344 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90189e77-d311-471b-8b92-38185569decf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:38.348223 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90189e77-d311-471b-8b92-38185569decf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:38.348560 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90189e77-d311-471b-8b92-38185569decf admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:38.350330 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90189e77-d311-471b-8b92-38185569decf admin admin] PATH_INFO: `/v3/projects/93a3f8eca16e4446af86e0a1e73dedc0` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:38.351587 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90189e77-d311-471b-8b92-38185569decf admin admin] RBAC: Authorizing `identity:delete_project(project_id=93a3f8eca16e4446af86e0a1e73dedc0)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:38.354793 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90189e77-d311-471b-8b92-38185569decf admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:38.381574 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:53:38.472713 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-90189e77-d311-471b-8b92-38185569decf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93a3f8eca16e4446af86e0a1e73dedc0', 'request_id': 'req-90189e77-d311-471b-8b92-38185569decf'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:53:38.481063 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-90189e77-d311-471b-8b92-38185569decf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93a3f8eca16e4446af86e0a1e73dedc0', 'request_id': 'req-90189e77-d311-471b-8b92-38185569decf'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:53:38.487398 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-90189e77-d311-471b-8b92-38185569decf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93a3f8eca16e4446af86e0a1e73dedc0', 'request_id': 'req-90189e77-d311-471b-8b92-38185569decf'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:53:38.576609 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-90189e77-d311-471b-8b92-38185569decf admin admin] The token cache is being invalidate because project 93a3f8eca16e4446af86e0a1e73dedc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80392) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:53:38.577260 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-90189e77-d311-471b-8b92-38185569decf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:53:38.577547 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-90189e77-d311-471b-8b92-38185569decf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:53:38.579142 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1459/2884] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:53:38 2022] DELETE /identity/v3/projects/93a3f8eca16e4446af86e0a1e73dedc0 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:53:38.583925 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddeb7aa-4385-4a1f-b3a4-d2e90cb50c37 service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:38.594496 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddeb7aa-4385-4a1f-b3a4-d2e90cb50c37 service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:38.654161 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4439dfea-e7f4-49d4-8835-46ae8c1c2dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:38.655039 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439dfea-e7f4-49d4-8835-46ae8c1c2dc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:38.655313 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439dfea-e7f4-49d4-8835-46ae8c1c2dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:38.655619 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439dfea-e7f4-49d4-8835-46ae8c1c2dc6 admin admin] PATH_INFO: `/v3/users/52a9c0001c7e4826a77a8c5e5764199e` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:38.656825 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4439dfea-e7f4-49d4-8835-46ae8c1c2dc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52a9c0001c7e4826a77a8c5e5764199e)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:38.658767 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4439dfea-e7f4-49d4-8835-46ae8c1c2dc6 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:38.848246 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-4439dfea-e7f4-49d4-8835-46ae8c1c2dc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52a9c0001c7e4826a77a8c5e5764199e'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:53:38.925397 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-4439dfea-e7f4-49d4-8835-46ae8c1c2dc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52a9c0001c7e4826a77a8c5e5764199e'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:53:38.926033 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-4439dfea-e7f4-49d4-8835-46ae8c1c2dc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52a9c0001c7e4826a77a8c5e5764199e'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:53:38.927928 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:53:38.939258 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-4439dfea-e7f4-49d4-8835-46ae8c1c2dc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52a9c0001c7e4826a77a8c5e5764199e'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:53:38.946931 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-4439dfea-e7f4-49d4-8835-46ae8c1c2dc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52a9c0001c7e4826a77a8c5e5764199e'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:53:38.952783 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1426/2885] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:53:38 2022] DELETE /identity/v3/users/52a9c0001c7e4826a77a8c5e5764199e => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:53:39.361953 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90189e77-d311-471b-8b92-38185569decf admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:39.363583 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-90189e77-d311-471b-8b92-38185569decf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:53:39.378371 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90189e77-d311-471b-8b92-38185569decf admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:39.443774 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b233f54-1458-4c44-b736-87680fe53160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:39.444635 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b233f54-1458-4c44-b736-87680fe53160 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:39.444917 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b233f54-1458-4c44-b736-87680fe53160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:39.445222 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b233f54-1458-4c44-b736-87680fe53160 admin admin] PATH_INFO: `/v3/projects/6b7bd96d5b4d427aaf6a211b20206ec8` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:39.446438 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b233f54-1458-4c44-b736-87680fe53160 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b7bd96d5b4d427aaf6a211b20206ec8)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:39.448470 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b233f54-1458-4c44-b736-87680fe53160 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:39.567707 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-1b233f54-1458-4c44-b736-87680fe53160 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b7bd96d5b4d427aaf6a211b20206ec8', 'request_id': 'req-1b233f54-1458-4c44-b736-87680fe53160'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:53:39.574184 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-1b233f54-1458-4c44-b736-87680fe53160 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b7bd96d5b4d427aaf6a211b20206ec8', 'request_id': 'req-1b233f54-1458-4c44-b736-87680fe53160'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:53:39.581263 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-1b233f54-1458-4c44-b736-87680fe53160 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b7bd96d5b4d427aaf6a211b20206ec8', 'request_id': 'req-1b233f54-1458-4c44-b736-87680fe53160'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:53:39.669322 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-1b233f54-1458-4c44-b736-87680fe53160 admin admin] The token cache is being invalidate because project 6b7bd96d5b4d427aaf6a211b20206ec8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80392) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:53:39.669602 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-1b233f54-1458-4c44-b736-87680fe53160 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:53:39.670148 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-1b233f54-1458-4c44-b736-87680fe53160 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:53:39.671722 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1460/2886] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:53:39 2022] DELETE /identity/v3/projects/6b7bd96d5b4d427aaf6a211b20206ec8 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:53:39.679844 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa489c4-33f7-4395-9145-19f722eb614b None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:39.680131 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa489c4-33f7-4395-9145-19f722eb614b None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:39.680410 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa489c4-33f7-4395-9145-19f722eb614b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:39.699296 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-eaa489c4-33f7-4395-9145-19f722eb614b None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:53:39.700533 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-eaa489c4-33f7-4395-9145-19f722eb614b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:53:39.763781 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1427/2887] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:53:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:53:39.772211 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a20c2-631e-4ac0-8cbb-f1e265cf97ee None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:39.772498 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a20c2-631e-4ac0-8cbb-f1e265cf97ee None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:39.772820 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a20c2-631e-4ac0-8cbb-f1e265cf97ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:39.792167 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-7a8a20c2-631e-4ac0-8cbb-f1e265cf97ee None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:53:39.793458 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-7a8a20c2-631e-4ac0-8cbb-f1e265cf97ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:53:39.801365 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1461/2888] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:53:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:53:39.805707 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa489c4-33f7-4395-9145-19f722eb614b None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:39.815286 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa489c4-33f7-4395-9145-19f722eb614b None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:39.820633 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd9645b-5735-4cde-a409-13a4a0e6c98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:39.821339 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9645b-5735-4cde-a409-13a4a0e6c98e admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:39.821622 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9645b-5735-4cde-a409-13a4a0e6c98e admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:39.821900 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9645b-5735-4cde-a409-13a4a0e6c98e admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:39.822626 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd9645b-5735-4cde-a409-13a4a0e6c98e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 10:53:39.822939 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd9645b-5735-4cde-a409-13a4a0e6c98e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:39.824521 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd9645b-5735-4cde-a409-13a4a0e6c98e admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:39.836620 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1428/2889] 10.222.0.39 () {58 vars in 1152 bytes} [Mon Jul 18 10:53:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 10:53:39.840986 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8a20c2-631e-4ac0-8cbb-f1e265cf97ee None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:39.851305 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8a20c2-631e-4ac0-8cbb-f1e265cf97ee None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:39.856013 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc19f432-033c-4c50-9ba0-25150f07e405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:39.856686 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc19f432-033c-4c50-9ba0-25150f07e405 admin admin] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:39.856971 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc19f432-033c-4c50-9ba0-25150f07e405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:39.857294 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc19f432-033c-4c50-9ba0-25150f07e405 admin admin] PATH_INFO: `/v3/projects` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:39.858001 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc19f432-033c-4c50-9ba0-25150f07e405 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:39.859927 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc19f432-033c-4c50-9ba0-25150f07e405 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:39.955849 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1462/2890] 10.222.0.39 () {60 vars in 1152 bytes} [Mon Jul 18 10:53:39 2022] POST /identity/v3/projects => generated 373 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:53:39.960600 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd9645b-5735-4cde-a409-13a4a0e6c98e admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:39.970790 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd9645b-5735-4cde-a409-13a4a0e6c98e admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:40.028998 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dee03c5-1d0e-4f1c-9790-43505a8a7055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:40.029695 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee03c5-1d0e-4f1c-9790-43505a8a7055 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:40.029981 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee03c5-1d0e-4f1c-9790-43505a8a7055 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:40.030284 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee03c5-1d0e-4f1c-9790-43505a8a7055 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:40.030983 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dee03c5-1d0e-4f1c-9790-43505a8a7055 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:40.032893 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dee03c5-1d0e-4f1c-9790-43505a8a7055 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:40.115246 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1429/2891] 10.222.0.39 () {60 vars in 1143 bytes} [Mon Jul 18 10:53:39 2022] POST /identity/v3/users => generated 287 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 10:53:40.119797 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc19f432-033c-4c50-9ba0-25150f07e405 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:40.131198 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc19f432-033c-4c50-9ba0-25150f07e405 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:40.136176 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d008945b-2765-43a2-ada3-1720464bf337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:40.136835 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008945b-2765-43a2-ada3-1720464bf337 admin admin] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:40.137140 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008945b-2765-43a2-ada3-1720464bf337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:40.137416 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008945b-2765-43a2-ada3-1720464bf337 admin admin] PATH_INFO: `/v3/roles` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:40.138230 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d008945b-2765-43a2-ada3-1720464bf337 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:40.139895 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d008945b-2765-43a2-ada3-1720464bf337 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:40.151337 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1463/2892] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:53:40.155361 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dee03c5-1d0e-4f1c-9790-43505a8a7055 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:40.166259 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dee03c5-1d0e-4f1c-9790-43505a8a7055 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:40.171023 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d24e9e-49f5-4428-8c09-82081881f7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:40.171698 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d24e9e-49f5-4428-8c09-82081881f7ea admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:40.171974 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d24e9e-49f5-4428-8c09-82081881f7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:40.172254 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d24e9e-49f5-4428-8c09-82081881f7ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:40.172994 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d24e9e-49f5-4428-8c09-82081881f7ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:40.174694 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d24e9e-49f5-4428-8c09-82081881f7ea admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:40.187330 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1430/2893] 10.222.0.39 () {58 vars in 1121 bytes} [Mon Jul 18 10:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 10:53:40.191601 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d008945b-2765-43a2-ada3-1720464bf337 admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:40.197577 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:53:40.203216 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d008945b-2765-43a2-ada3-1720464bf337 admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:40.208209 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad80d0fb-196d-47a5-9cee-c48a6099214b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:40.209712 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80d0fb-196d-47a5-9cee-c48a6099214b admin admin] REQUEST_METHOD: `PUT` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:40.209992 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80d0fb-196d-47a5-9cee-c48a6099214b admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:40.210261 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80d0fb-196d-47a5-9cee-c48a6099214b admin admin] PATH_INFO: `/v3/projects/0b8b35293afb4e70b3fdd8f74fddc3d4/users/22c6b3dee1c04cf9b11b6d0fe85f854f/roles/907cee10dffd48b2bec00719e425d3bd` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:40.225494 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad80d0fb-196d-47a5-9cee-c48a6099214b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b8b35293afb4e70b3fdd8f74fddc3d4, user_id=22c6b3dee1c04cf9b11b6d0fe85f854f, role_id=907cee10dffd48b2bec00719e425d3bd)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:40.228221 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad80d0fb-196d-47a5-9cee-c48a6099214b admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:40.308537 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1464/2894] 10.222.0.39 () {60 vars in 1482 bytes} [Mon Jul 18 10:53:40 2022] PUT /identity/v3/projects/0b8b35293afb4e70b3fdd8f74fddc3d4/users/22c6b3dee1c04cf9b11b6d0fe85f854f/roles/907cee10dffd48b2bec00719e425d3bd => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:53:40.321216 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8485a-3ce5-4760-82e7-69c7cbdbdc5c None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:40.325317 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8485a-3ce5-4760-82e7-69c7cbdbdc5c None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:40.325317 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c8485a-3ce5-4760-82e7-69c7cbdbdc5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:40.350182 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-65c8485a-3ce5-4760-82e7-69c7cbdbdc5c None None] MFA Rules not processed for user `22c6b3dee1c04cf9b11b6d0fe85f854f`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:53:40.351410 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-65c8485a-3ce5-4760-82e7-69c7cbdbdc5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:53:40.377532 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:53:40.419236 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1431/2895] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:53:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:53:40.430356 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad80d0fb-196d-47a5-9cee-c48a6099214b admin admin] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:40.432066 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-ad80d0fb-196d-47a5-9cee-c48a6099214b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:53:40.489446 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad80d0fb-196d-47a5-9cee-c48a6099214b admin admin] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:40.493710 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c609e0a4-e715-41ba-98b3-e73a9ab041b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7cc4f041a5b242138a92a54633dcece6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:40.494352 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c609e0a4-e715-41ba-98b3-e73a9ab041b0 service cinder] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:40.494633 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c609e0a4-e715-41ba-98b3-e73a9ab041b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:40.494905 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c609e0a4-e715-41ba-98b3-e73a9ab041b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:40.503226 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c609e0a4-e715-41ba-98b3-e73a9ab041b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:40.504650 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c609e0a4-e715-41ba-98b3-e73a9ab041b0 service cinder] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:40.514138 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1465/2896] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:53:40 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 10:53:42.353862 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f719db-7b9b-4236-956d-c9cc8ccbec6d None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:42.354607 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f719db-7b9b-4236-956d-c9cc8ccbec6d None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:42.354607 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f719db-7b9b-4236-956d-c9cc8ccbec6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:42.372656 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-77f719db-7b9b-4236-956d-c9cc8ccbec6d None None] MFA Rules not processed for user `22c6b3dee1c04cf9b11b6d0fe85f854f`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:53:42.373807 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-77f719db-7b9b-4236-956d-c9cc8ccbec6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:53:42.381586 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1432/2897] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:53:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:53:43.964168 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c609e0a4-e715-41ba-98b3-e73a9ab041b0 service cinder] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:43.965732 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-c609e0a4-e715-41ba-98b3-e73a9ab041b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:53:44.038039 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c609e0a4-e715-41ba-98b3-e73a9ab041b0 service cinder] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:44.044207 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6bfa3-718b-437e-a947-6d01354e1575 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2330638e80a941cd9aeeb2fd615900d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:44.044868 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6bfa3-718b-437e-a947-6d01354e1575 service placement] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:44.045173 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6bfa3-718b-437e-a947-6d01354e1575 service placement] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:44.045450 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6bfa3-718b-437e-a947-6d01354e1575 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:44.047743 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-cbf6bfa3-718b-437e-a947-6d01354e1575 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:53:44.059863 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf6bfa3-718b-437e-a947-6d01354e1575 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:44.061459 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf6bfa3-718b-437e-a947-6d01354e1575 service placement] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:44.071783 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1466/2898] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:53:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:53:52.367199 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=18 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:53:54.067047 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=67,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:53:54.400545 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f719db-7b9b-4236-956d-c9cc8ccbec6d None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:54.401978 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-77f719db-7b9b-4236-956d-c9cc8ccbec6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:53:54.481772 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f719db-7b9b-4236-956d-c9cc8ccbec6d None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:54.487396 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f045a80b-73a7-4bd9-ac7f-ec609038d570 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bbebf16219943879df84bdc9a900516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:54.488054 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f045a80b-73a7-4bd9-ac7f-ec609038d570 service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:54.488334 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f045a80b-73a7-4bd9-ac7f-ec609038d570 service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:54.488624 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f045a80b-73a7-4bd9-ac7f-ec609038d570 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:54.491418 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-f045a80b-73a7-4bd9-ac7f-ec609038d570 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:53:54.504273 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f045a80b-73a7-4bd9-ac7f-ec609038d570 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:54.507666 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f045a80b-73a7-4bd9-ac7f-ec609038d570 service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:54.518927 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1433/2899] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:53:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:53:59.470715 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6bfa3-718b-437e-a947-6d01354e1575 service placement] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:53:59.472298 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-cbf6bfa3-718b-437e-a947-6d01354e1575 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:53:59.494235 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6bfa3-718b-437e-a947-6d01354e1575 service placement] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:53:59.499643 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f697aa81-0b90-4c74-8d90-8043de266fc5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bbebf16219943879df84bdc9a900516', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:53:59.500299 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697aa81-0b90-4c74-8d90-8043de266fc5 service nova] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:53:59.500579 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697aa81-0b90-4c74-8d90-8043de266fc5 service nova] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:53:59.500855 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f697aa81-0b90-4c74-8d90-8043de266fc5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:53:59.502726 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-f697aa81-0b90-4c74-8d90-8043de266fc5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:53:59.517493 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f697aa81-0b90-4c74-8d90-8043de266fc5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:53:59.519204 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f697aa81-0b90-4c74-8d90-8043de266fc5 service nova] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:53:59.530979 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1467/2900] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:53:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:54:02.284559 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc260b-99d6-4f69-8105-1f8f791c9d4d None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:54:02.285097 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc260b-99d6-4f69-8105-1f8f791c9d4d None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:54:02.285215 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc260b-99d6-4f69-8105-1f8f791c9d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:54:02.334342 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-54dc260b-99d6-4f69-8105-1f8f791c9d4d None None] MFA Rules not processed for user `88ad60446c5447a8bbd0096fa2133efb`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:54:02.335704 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-54dc260b-99d6-4f69-8105-1f8f791c9d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:54:02.402511 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1434/2901] 10.222.0.39 () {58 vars in 1009 bytes} [Mon Jul 18 10:54:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:54:02.563535 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f697aa81-0b90-4c74-8d90-8043de266fc5 service nova] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:54:02.565090 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-f697aa81-0b90-4c74-8d90-8043de266fc5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:54:02.663598 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f697aa81-0b90-4c74-8d90-8043de266fc5 service nova] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:54:02.668985 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611eead9-3f21-41f1-8098-b36db392e47f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c548474a8d94591ba58dd40e40a28d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:54:02.669664 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611eead9-3f21-41f1-8098-b36db392e47f service swift] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:54:02.669951 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611eead9-3f21-41f1-8098-b36db392e47f service swift] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:54:02.670230 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611eead9-3f21-41f1-8098-b36db392e47f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:54:02.678805 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611eead9-3f21-41f1-8098-b36db392e47f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:54:02.680420 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611eead9-3f21-41f1-8098-b36db392e47f service swift] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:54:02.689018 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1468/2902] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Jul 18 10:54:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 10:54:03.652260 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa8f43-067f-4906-bc12-62136df3a178 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:54:03.652761 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa8f43-067f-4906-bc12-62136df3a178 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:54:03.652873 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa8f43-067f-4906-bc12-62136df3a178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:54:03.671282 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-51aa8f43-067f-4906-bc12-62136df3a178 None None] MFA Rules not processed for user `88ad60446c5447a8bbd0096fa2133efb`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:54:03.672791 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-51aa8f43-067f-4906-bc12-62136df3a178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:54:03.680217 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1435/2903] 10.222.0.39 () {58 vars in 967 bytes} [Mon Jul 18 10:54:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:54:03.692008 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611eead9-3f21-41f1-8098-b36db392e47f service swift] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:54:03.703335 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611eead9-3f21-41f1-8098-b36db392e47f service swift] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:54:03.708881 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e15a4-d711-4e26-b3d9-a2ca494347d2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c548474a8d94591ba58dd40e40a28d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:54:03.709563 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e15a4-d711-4e26-b3d9-a2ca494347d2 service swift] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:54:03.709848 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e15a4-d711-4e26-b3d9-a2ca494347d2 service swift] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:54:03.710125 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e15a4-d711-4e26-b3d9-a2ca494347d2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:54:03.718488 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16e15a4-d711-4e26-b3d9-a2ca494347d2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:54:03.720065 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16e15a4-d711-4e26-b3d9-a2ca494347d2 service swift] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:54:03.729311 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1469/2904] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Jul 18 10:54:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 10:54:04.649699 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2fdcaf-3ae7-4922-9b5c-6e955524bebb None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:54:04.649987 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2fdcaf-3ae7-4922-9b5c-6e955524bebb None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:54:04.650268 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2fdcaf-3ae7-4922-9b5c-6e955524bebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:54:04.668768 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-af2fdcaf-3ae7-4922-9b5c-6e955524bebb None None] MFA Rules not processed for user `88ad60446c5447a8bbd0096fa2133efb`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:54:04.670032 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-af2fdcaf-3ae7-4922-9b5c-6e955524bebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:54:04.678078 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1436/2905] 10.222.0.39 () {58 vars in 1009 bytes} [Mon Jul 18 10:54:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:54:04.690172 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e15a4-d711-4e26-b3d9-a2ca494347d2 service swift] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:54:04.703018 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e15a4-d711-4e26-b3d9-a2ca494347d2 service swift] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:54:04.708104 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ffb3f-a90d-41cc-b543-04aa92ae435f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c548474a8d94591ba58dd40e40a28d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:54:04.708922 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ffb3f-a90d-41cc-b543-04aa92ae435f service swift] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:54:04.709348 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ffb3f-a90d-41cc-b543-04aa92ae435f service swift] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:54:04.709626 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ffb3f-a90d-41cc-b543-04aa92ae435f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:54:04.718417 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57ffb3f-a90d-41cc-b543-04aa92ae435f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:54:04.720136 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57ffb3f-a90d-41cc-b543-04aa92ae435f service swift] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:54:04.729261 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1470/2906] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Jul 18 10:54:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 10:54:05.462620 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34928a1f-f61f-46ab-bb8d-26e97aac2137 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:54:05.462936 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34928a1f-f61f-46ab-bb8d-26e97aac2137 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:54:05.463211 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34928a1f-f61f-46ab-bb8d-26e97aac2137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:54:05.481408 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-34928a1f-f61f-46ab-bb8d-26e97aac2137 None None] MFA Rules not processed for user `88ad60446c5447a8bbd0096fa2133efb`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:54:05.482612 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-34928a1f-f61f-46ab-bb8d-26e97aac2137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:54:05.489866 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1437/2907] 10.222.0.39 () {58 vars in 967 bytes} [Mon Jul 18 10:54:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 10:54:05.501799 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ffb3f-a90d-41cc-b543-04aa92ae435f service swift] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:54:05.513252 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ffb3f-a90d-41cc-b543-04aa92ae435f service swift] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:54:05.518336 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ec3379-2e28-4fa7-a54a-8e07d895f7e4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c548474a8d94591ba58dd40e40a28d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:54:05.518980 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec3379-2e28-4fa7-a54a-8e07d895f7e4 service swift] REQUEST_METHOD: `GET` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:54:05.519267 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec3379-2e28-4fa7-a54a-8e07d895f7e4 service swift] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:54:05.519546 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec3379-2e28-4fa7-a54a-8e07d895f7e4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:54:05.528530 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ec3379-2e28-4fa7-a54a-8e07d895f7e4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:54:05.530135 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ec3379-2e28-4fa7-a54a-8e07d895f7e4 service swift] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:54:05.538809 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1471/2908] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Jul 18 10:54:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 10:54:08.281997 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34928a1f-f61f-46ab-bb8d-26e97aac2137 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:54:08.325741 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:54:08.347463 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34928a1f-f61f-46ab-bb8d-26e97aac2137 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:54:08.352077 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e9d5e-0295-4011-8b7b-1631b868911a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:54:08.352961 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e9d5e-0295-4011-8b7b-1631b868911a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:54:08.353296 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e9d5e-0295-4011-8b7b-1631b868911a admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:54:08.353579 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e9d5e-0295-4011-8b7b-1631b868911a admin admin] PATH_INFO: `/v3/users/22c6b3dee1c04cf9b11b6d0fe85f854f` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:54:08.354790 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e9d5e-0295-4011-8b7b-1631b868911a admin admin] RBAC: Authorizing `identity:delete_user(user_id=22c6b3dee1c04cf9b11b6d0fe85f854f)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:54:08.363090 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e9d5e-0295-4011-8b7b-1631b868911a admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:54:08.561572 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-162e9d5e-0295-4011-8b7b-1631b868911a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22c6b3dee1c04cf9b11b6d0fe85f854f'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:54:08.662330 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-162e9d5e-0295-4011-8b7b-1631b868911a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22c6b3dee1c04cf9b11b6d0fe85f854f'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:54:08.662939 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-162e9d5e-0295-4011-8b7b-1631b868911a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22c6b3dee1c04cf9b11b6d0fe85f854f'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:54:08.675548 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-162e9d5e-0295-4011-8b7b-1631b868911a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22c6b3dee1c04cf9b11b6d0fe85f854f'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:54:08.682966 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-162e9d5e-0295-4011-8b7b-1631b868911a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22c6b3dee1c04cf9b11b6d0fe85f854f'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:54:08.688862 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1438/2909] 10.222.0.39 () {58 vars in 1223 bytes} [Mon Jul 18 10:54:08 2022] DELETE /identity/v3/users/22c6b3dee1c04cf9b11b6d0fe85f854f => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:54:08.693729 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1d413-a4d8-4069-9459-b042af20130a None None] REQUEST_METHOD: `POST` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:54:08.696745 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1d413-a4d8-4069-9459-b042af20130a None None] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:54:08.696745 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1d413-a4d8-4069-9459-b042af20130a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:54:08.712372 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.auth.core [None req-91d1d413-a4d8-4069-9459-b042af20130a None None] MFA Rules not processed for user `0a2289135265475ab7faec00c36046b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80392) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 10:54:08.713634 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-91d1d413-a4d8-4069-9459-b042af20130a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:54:08.772074 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1472/2910] 10.222.0.39 () {58 vars in 957 bytes} [Mon Jul 18 10:54:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 10:54:08.782024 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e9d5e-0295-4011-8b7b-1631b868911a admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:54:08.783474 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-162e9d5e-0295-4011-8b7b-1631b868911a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:54:08.841218 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e9d5e-0295-4011-8b7b-1631b868911a admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:54:08.844792 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b224a5-b80b-4252-ac80-b491d4f1ebff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f88e3a2b95e477bae1cc98e9e18dc24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:54:08.845467 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b224a5-b80b-4252-ac80-b491d4f1ebff service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:54:08.845748 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b224a5-b80b-4252-ac80-b491d4f1ebff service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:54:08.846021 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b224a5-b80b-4252-ac80-b491d4f1ebff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:54:08.855718 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b224a5-b80b-4252-ac80-b491d4f1ebff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:54:08.857160 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b224a5-b80b-4252-ac80-b491d4f1ebff service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:54:08.867423 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1439/2911] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:54:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:54:09.126339 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d1d413-a4d8-4069-9459-b042af20130a None None] Authenticating user token {{(pid=80392) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:54:09.127792 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.fernet_utils [None req-91d1d413-a4d8-4069-9459-b042af20130a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80392) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:54:09.139905 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d1d413-a4d8-4069-9459-b042af20130a None None] Validating token access rules against request {{(pid=80392) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:54:09.145124 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdde4eca-a1b5-4d10-8dce-97900b5e2264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2289135265475ab7faec00c36046b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec4a529f46e64ec0b911c3fbc2a942cb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80392) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:54:09.146519 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde4eca-a1b5-4d10-8dce-97900b5e2264 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:54:09.146885 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde4eca-a1b5-4d10-8dce-97900b5e2264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:54:09.147145 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde4eca-a1b5-4d10-8dce-97900b5e2264 admin admin] PATH_INFO: `/v3/projects/0b8b35293afb4e70b3fdd8f74fddc3d4` {{(pid=80392) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:54:09.148512 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdde4eca-a1b5-4d10-8dce-97900b5e2264 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b8b35293afb4e70b3fdd8f74fddc3d4)` {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:54:09.150458 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdde4eca-a1b5-4d10-8dce-97900b5e2264 admin admin] RBAC: Authorization granted {{(pid=80392) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:54:09.162815 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=100 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:54:09.336309 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-cdde4eca-a1b5-4d10-8dce-97900b5e2264 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b8b35293afb4e70b3fdd8f74fddc3d4', 'request_id': 'req-cdde4eca-a1b5-4d10-8dce-97900b5e2264'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:54:09.342710 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-cdde4eca-a1b5-4d10-8dce-97900b5e2264 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b8b35293afb4e70b3fdd8f74fddc3d4', 'request_id': 'req-cdde4eca-a1b5-4d10-8dce-97900b5e2264'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:54:09.348971 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-cdde4eca-a1b5-4d10-8dce-97900b5e2264 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b8b35293afb4e70b3fdd8f74fddc3d4', 'request_id': 'req-cdde4eca-a1b5-4d10-8dce-97900b5e2264'} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:54:09.479386 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-cdde4eca-a1b5-4d10-8dce-97900b5e2264 admin admin] The token cache is being invalidate because project 0b8b35293afb4e70b3fdd8f74fddc3d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80392) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 10:54:09.479693 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-cdde4eca-a1b5-4d10-8dce-97900b5e2264 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:54:09.480317 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG keystone.notifications [None req-cdde4eca-a1b5-4d10-8dce-97900b5e2264 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80392) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 10:54:09.481985 dv-cinder-837546-3-smb devstack@keystone.service[80392]: [pid: 80392|app: 0|req: 1473/2912] 10.222.0.39 () {58 vars in 1232 bytes} [Mon Jul 18 10:54:09 2022] DELETE /identity/v3/projects/0b8b35293afb4e70b3fdd8f74fddc3d4 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 10:54:18.862438 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=62,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:54:19.475203 dv-cinder-837546-3-smb devstack@keystone.service[80392]: DEBUG dbcounter [-] [80392] Writing DB stats keystone:SELECT=19,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80392) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:56:01.257502 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b224a5-b80b-4252-ac80-b491d4f1ebff service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 10:56:01.259035 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-91b224a5-b80b-4252-ac80-b491d4f1ebff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:56:01.334032 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b224a5-b80b-4252-ac80-b491d4f1ebff service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 10:56:01.395105 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845221f2-c4af-438e-8c2b-96d92896e647 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2330638e80a941cd9aeeb2fd615900d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6098fe56d304980aa14bd95b4b92c17', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 10:56:01.395666 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845221f2-c4af-438e-8c2b-96d92896e647 service placement] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 10:56:01.395947 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845221f2-c4af-438e-8c2b-96d92896e647 service placement] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 10:56:01.396222 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845221f2-c4af-438e-8c2b-96d92896e647 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 10:56:01.398015 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-845221f2-c4af-438e-8c2b-96d92896e647 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 10:56:01.409890 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845221f2-c4af-438e-8c2b-96d92896e647 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 10:56:01.411720 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845221f2-c4af-438e-8c2b-96d92896e647 service placement] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 10:56:01.422735 dv-cinder-837546-3-smb devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1440/2913] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Jul 18 10:56:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 10:56:11.417574 dv-cinder-837546-3-smb devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=58 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}